Jul 14 16:16:51 devstack cinder-volume[75925]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jul 14 16:16:51 devstack cinder-volume[75925]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 14 16:16:51 devstack cinder-volume[75925]: we strongly recommend against using it for new projects.
Jul 14 16:16:51 devstack cinder-volume[75925]: If you are already using Eventlet, we recommend migrating to a different
Jul 14 16:16:51 devstack cinder-volume[75925]: framework.  For more detail see
Jul 14 16:16:51 devstack cinder-volume[75925]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 14 16:16:51 devstack cinder-volume[75925]:   import eventlet  # noqa
Jul 14 16:16:54 devstack cinder-volume[75925]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75925) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 14 16:16:54 devstack cinder-volume[75925]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75925) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 14 16:16:54 devstack cinder-volume[75925]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75925) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 14 16:16:55 devstack cinder-volume[75925]: INFO dbcounter [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] Registered counter for database cinder
Jul 14 16:16:55 devstack cinder-volume[75925]: DEBUG oslo_db.sqlalchemy.engines [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75925) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 14 16:16:55 devstack cinder-volume[75925]: DEBUG dbcounter [-] [75925] Writer thread running {{(pid=75925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 14 16:16:55 devstack cinder-volume[75925]: INFO cinder.rpc [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jul 14 16:16:55 devstack cinder-volume[75925]: INFO cinder.rpc [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_db.sqlalchemy.engines [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75925) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 14 16:16:56 devstack cinder-volume[75925]: INFO cinder.volume.manager [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] Determined volume DB was empty at startup.
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG cinder.volume.manager [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75925) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jul 14 16:16:56 devstack cinder-volume[75925]: INFO cinder.volume.manager [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] Service not found for updating active_backend_id, assuming default for driver init.
Jul 14 16:16:56 devstack cinder-volume[75925]: WARNING stevedore.named [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 14 16:16:56 devstack cinder-volume[75925]: WARNING castellan.key_manager [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 14 16:16:56 devstack cinder-volume[75925]: WARNING cinder.keymgr.conf_key_mgr [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG cinder.volume.drivers.lvm [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75925) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_concurrency.processutils [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_concurrency.processutils [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] CMD "cinder-rtstool verify" returned: 0 in 0.509s {{(pid=75925) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_db.sqlalchemy.engines [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75925) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 14 16:16:56 devstack cinder-volume[75925]: INFO cinder.rpc [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Jul 14 16:16:56 devstack cinder-volume[75925]: INFO cinder.rpc [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Jul 14 16:16:56 devstack cinder-volume[75925]: WARNING stevedore.named [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 14 16:16:56 devstack cinder-volume[75925]: WARNING castellan.key_manager [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 14 16:16:56 devstack cinder-volume[75925]: INFO cinder.volume.manager [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_db.sqlalchemy.engines [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75925) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 14 16:16:56 devstack cinder-volume[75925]: INFO oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] Starting 1 workers
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] Started child 76089 {{(pid=75925) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] Full set of CONF: {{(pid=75925) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] ******************************************************************************** {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] Configuration options gathered from: {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] ================================================================================ {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jul 14 16:16:56 devstack cinder-volume[76089]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] allow_availability_zone_fallback = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] allow_compression_on_image_upload = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] allowed_direct_url_schemes     = [] {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] api_rate_limit                 = True {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] auth_strategy                  = keystone {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] az_cache_duration              = 3600 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] backend_availability_zone      = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] backend_host                   = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] backend_name                   = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] backend_stats_polling_interval = 60 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] backup_api_class               = cinder.backup.api.API {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] backup_name_template           = backup-%s {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] backup_use_same_host           = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] backup_use_temp_snapshot       = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] chap_password                  = **** {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] chap_username                  =  {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] cinder_internal_tenant_project_id = cf3b09c69d95444c88eabba304030e30 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] cinder_internal_tenant_user_id = 088138043d294834a037842a1c9d0f70 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] cloned_volume_same_az          = True {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] cluster                        = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] compression_format             = gzip {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] compute_api_class              = cinder.compute.nova.API {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] config_dir                     = [] {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] config_source                  = [] {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] control_exchange               = openstack {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] debug                          = True {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] default_availability_zone      = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] default_group_type             = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] default_volume_type            = lvmdriver-1 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] disk_geometry                  = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] driver_client_cert             = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] driver_client_cert_key         = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] driver_data_namespace          = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] driver_ssl_cert_path           = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] driver_ssl_cert_verify         = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] driver_use_ssl                 = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] enable_force_upload            = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] enable_new_services            = True {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] enable_unsupported_driver      = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] enforce_multipath_for_image_xfer = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] filter_function                = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[76089]: INFO cinder.volume.manager [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] Starting volume driver LVMVolumeDriver (3.0.0)
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] glance_api_insecure            = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] glance_api_servers             = ['http://192.168.122.108/image'] {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] glance_api_ssl_compression     = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] glance_ca_certificates_file    = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] glance_catalog_info            = image:glance:publicURL {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] glance_certfile                = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] glance_keyfile                 = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] glance_num_retries             = 3 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] glance_request_timeout         = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] goodness_function              = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] graceful_shutdown_timeout      = 5 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] group_api_class                = cinder.group.api.API {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] host                           = devstack {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] image_compress_on_upload       = True {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] image_conversion_address_space_limit = 1 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] image_conversion_cpu_limit     = 60 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] image_conversion_disable       = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] image_upload_use_cinder_backend = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] image_upload_use_internal_tenant = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] image_volume_cache_enabled     = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] image_volume_cache_max_count   = 0 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] image_volume_cache_max_size_gb = 0 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] init_host_max_objects_retrieval = 0 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] iscsi_target_flags             =  {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] iscsi_write_cache              = on {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] iser_helper                    = tgtadm {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] iser_ip_address                = 192.168.122.108 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] iser_port                      = 3260 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] log_color                      = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] log_config_append              = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] log_dir                        = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] log_file                       = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] log_options                    = True {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] log_rotate_interval            = 1 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] log_rotate_interval_type       = days {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] log_rotation_type              = none {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] max_age                        = 0 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] max_logfile_count              = 30 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] max_logfile_size_mb            = 200 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] max_over_subscription_ratio    = 20.0 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] message_reap_interval          = 86400 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] message_ttl                    = 2592000 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] migration_create_volume_timeout_secs = 300 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] monkey_patch                   = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] monkey_patch_modules           = [] {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] my_ip                          = 192.168.122.108 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] no_snapshot_gb_quota           = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] num_iser_scan_tries            = 3 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] num_shell_tries                = 3 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] num_volume_device_scan_tries   = 3 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] nvmeof_conn_info_version       = 1 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] nvmet_ns_id                    = 10 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] nvmet_port_id                  = 1 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] osapi_max_limit                = 1000 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] osapi_volume_ext_list          = [] {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] osapi_volume_listen_port       = 8776 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] osapi_volume_use_ssl           = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] osapi_volume_workers           = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] per_volume_size_limit          = -1 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] periodic_fuzzy_delay           = 60 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] periodic_interval              = 60 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] public_endpoint                = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] publish_errors                 = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] quota_backup_gigabytes         = 1000 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] quota_backups                  = 10 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] quota_gigabytes                = 1000 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] quota_groups                   = 10 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:16:56 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] quota_snapshots                = 10 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] quota_volumes                  = 10 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] rate_limit_burst               = 0 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] rate_limit_except_level        = CRITICAL {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] rate_limit_interval            = 0 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] reinit_driver_count            = 3 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] replication_device             = **** {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] report_discard_supported       = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] report_interval                = 120 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] reservation_clean_interval     = 86400 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] reservation_expire             = 86400 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] reserved_image_namespaces      = [] {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] reserved_percentage            = 0 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] rpc_response_timeout           = 120 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] run_external_periodic_tasks    = True {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] scst_target_driver             = iscsi {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] scst_target_iqn_name           = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] service_down_time              = 720 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] shell_completion               = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] snapshot_name_template         = snapshot-%s {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] snapshot_same_host             = True {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] split_loggers                  = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] state_path                     = /opt/stack/data/cinder {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] storage_availability_zone      = nova {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] storage_protocol               = iSCSI {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] syslog_log_facility            = LOG_USER {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] target_helper                  = lioadm {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] target_ip_address              = 192.168.122.108 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:56 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] target_port                    = 3260 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] target_protocol                = iscsi {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] target_secondary_ip_addresses  = [] {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] trace_flags                    = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] transport_url                  = **** {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] until_refresh                  = 0 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] use_chap_auth                  = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] use_default_quota_class        = True {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:57 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] use_journal                    = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] use_json                       = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:57 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] use_multipath_for_image_xfer   = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] use_stderr                     = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] use_syslog                     = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] verify_glance_signatures       = enabled {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] volume_api_class               = cinder.volume.api.API {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] volume_backend_name            = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] volume_clear                   = zero {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] volume_clear_ionice            = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] volume_clear_size              = 0 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] volume_copy_bps_limit          = 0 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] volume_dd_blocksize            = 1M {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] volume_name_template           = volume-%s {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] volume_service_inithost_offload = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] volume_usage_audit_period      = month {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] zoning_mode                    = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] oslo_concurrency.disable_process_locking = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] keystone_authtoken.auth_section = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] keystone_authtoken.auth_type   = password {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] keystone_authtoken.auth_version = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] keystone_authtoken.cache       = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] keystone_authtoken.certfile    = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] keystone_authtoken.include_service_catalog = True {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] keystone_authtoken.insecure    = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] keystone_authtoken.interface   = public {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] keystone_authtoken.keyfile     = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] keystone_authtoken.memcache_password =  {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack sudo[76093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack sudo[76093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] keystone_authtoken.memcache_username =  {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] keystone_authtoken.region_name = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] keystone_authtoken.service_type = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.108/identity {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] cache.backend                  = dogpile.cache.null {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] cache.backend_argument         = **** {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] cache.backend_expiration_time  = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] cache.config_prefix            = cache.oslo {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] cache.debug_cache_backend      = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] cache.enable_retry_client      = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] cache.enable_socket_keepalive  = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] cache.enabled                  = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] cache.expiration_time          = 600 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] cache.hashclient_retry_attempts = 2 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] cache.memcache_dead_retry      = 300 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] cache.memcache_sasl_enabled    = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] cache.password                 = **** {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] cache.proxies                  = [] {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] cache.redis_db                 = 0 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] cache.redis_server             = localhost:6379 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] cache.retry_attempts           = 2 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] cache.retry_delay              = 0.0 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] cache.socket_keepalive_count   = 1 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] cache.socket_keepalive_idle    = 1 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] cache.socket_keepalive_interval = 1 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] cache.socket_timeout           = 1.0 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] cache.tls_allowed_ciphers      = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] cache.tls_cafile               = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] cache.tls_certfile             = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] cache.tls_enabled              = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] cache.tls_keyfile              = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] cache.username                 = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] coordination.backend_url       = **** {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] database.asyncio_connection    = **** {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] database.asyncio_slave_connection = **** {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] database.backend               = sqlalchemy {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] database.connection            = **** {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] database.connection_debug      = 0 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] database.connection_parameters =  {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] database.connection_recycle_time = 3600 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] database.connection_trace      = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] database.db_inc_retry_interval = True {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] database.db_max_retries        = 20 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] database.db_max_retry_interval = 10 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] database.db_retry_interval     = 1 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] database.max_overflow          = 50 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] database.max_pool_size         = 5 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] database.max_retries           = 10 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] database.mysql_wsrep_sync_wait = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] database.pool_timeout          = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] database.retry_interval        = 10 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] database.slave_connection      = **** {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] database.sqlite_synchronous    = True {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] database.synchronous_reader    = True {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] database.use_db_reconnect      = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] profiler.connection_string     = messaging:// {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] profiler.enabled               = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] profiler.es_doc_type           = notification {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] profiler.es_scroll_size        = 10000 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] profiler.es_scroll_time        = 2m {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] profiler.filter_error_trace    = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] profiler.hmac_keys             = **** {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] profiler.sentinel_service_name = mymaster {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] profiler.socket_timeout        = 0.1 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] profiler.trace_requests        = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] profiler.trace_sqlalchemy      = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] profiler_jaeger.process_tags   = {} {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] profiler_jaeger.service_name_prefix = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] profiler_otlp.service_name_prefix = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] oslo_policy.enforce_new_defaults = True {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] oslo_policy.enforce_scope      = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] oslo_policy.policy_default_rule = default {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] privsep_osbrick.group          = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] privsep_osbrick.helper_command = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] privsep_osbrick.user           = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] cinder_sys_admin.group         = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] cinder_sys_admin.helper_command = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] cinder_sys_admin.user          = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] service_user.auth_section      = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] service_user.auth_type         = password {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] service_user.cafile            = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] service_user.certfile          = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] service_user.collect_timing    = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] service_user.insecure          = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] service_user.keyfile           = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] service_user.send_service_user_token = True {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] service_user.split_loggers     = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] service_user.timeout           = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] glance.auth_section            = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] glance.auth_type               = password {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] glance.certfile                = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] glance.collect_timing          = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] glance.insecure                = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] glance.keyfile                 = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] glance.region_name             = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] glance.split_loggers           = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] glance.timeout                 = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] backend_defaults.backend_availability_zone = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] backend_defaults.chap_password = **** {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] backend_defaults.chap_username =  {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] backend_defaults.disk_geometry = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] backend_defaults.driver_client_cert = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] backend_defaults.driver_client_cert_key = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] backend_defaults.driver_data_namespace = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] backend_defaults.driver_use_ssl = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] backend_defaults.extra_capabilities = {} {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] backend_defaults.filter_function = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] backend_defaults.goodness_function = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] backend_defaults.iscsi_target_flags =  {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] backend_defaults.iscsi_write_cache = on {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] backend_defaults.iser_helper   = tgtadm {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] backend_defaults.iser_ip_address = 192.168.122.108 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] backend_defaults.iser_port     = 3260 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] backend_defaults.lvm_share_target = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] backend_defaults.lvm_type      = auto {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] backend_defaults.num_shell_tries = 3 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] backend_defaults.replication_device = **** {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] backend_defaults.report_discard_supported = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] backend_defaults.reserved_percentage = 0 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] backend_defaults.target_helper = tgtadm {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] backend_defaults.target_ip_address = 192.168.122.108 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] backend_defaults.target_port   = 3260 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] backend_defaults.target_protocol = iscsi {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] backend_defaults.trace_flags   = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] backend_defaults.unique_fqdn_network = True {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] backend_defaults.use_chap_auth = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] backend_defaults.volume_backend_name = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] backend_defaults.volume_clear  = zero {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] backend_defaults.volume_clear_ionice = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] backend_defaults.volume_clear_size = 0 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] oslo_reports.file_event_handler = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] oslo_reports.log_dir           = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] lvmdriver-1.backend_host       = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] lvmdriver-1.chap_password      = **** {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] lvmdriver-1.chap_username      = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] lvmdriver-1.disk_geometry      = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] lvmdriver-1.driver_client_cert = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] lvmdriver-1.extra_capabilities = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] lvmdriver-1.filter_function    = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] lvmdriver-1.goodness_function  = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] lvmdriver-1.iser_helper        = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] lvmdriver-1.iser_ip_address    = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] lvmdriver-1.iser_port          = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] lvmdriver-1.lvm_share_target   = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] lvmdriver-1.lvm_type           = auto {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] lvmdriver-1.num_shell_tries    = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] lvmdriver-1.replication_device = **** {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] lvmdriver-1.report_discard_supported = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] lvmdriver-1.reserved_percentage = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] lvmdriver-1.scst_target_driver = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] lvmdriver-1.storage_protocol   = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] lvmdriver-1.target_helper      = lioadm {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] lvmdriver-1.target_ip_address  = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] lvmdriver-1.target_port        = 3260 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] lvmdriver-1.trace_flags        = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] lvmdriver-1.use_chap_auth      = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] lvmdriver-1.volume_clear       = zero {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] lvmdriver-1.volume_clear_size  = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] lvmdriver-1.volumes_dir        = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] oslo_messaging_notifications.driver = [] {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] oslo_messaging_notifications.retry = -1 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] key_manager.fixed_key          = **** {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] barbican.barbican_api_version  = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] barbican.barbican_endpoint     = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] barbican.barbican_endpoint_type = public {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] barbican.barbican_region_name  = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] barbican.cafile                = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] barbican.certfile              = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] barbican.collect_timing        = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] barbican.insecure              = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] barbican.keyfile               = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] barbican.number_of_retries     = 60 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] barbican.retry_delay           = 1 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] barbican.send_service_user_token = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] barbican.split_loggers         = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] barbican.timeout               = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] barbican.verify_ssl            = True {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] barbican.verify_ssl_path       = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] barbican_service_user.auth_section = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] barbican_service_user.auth_type = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] barbican_service_user.cafile   = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] barbican_service_user.certfile = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] barbican_service_user.collect_timing = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] barbican_service_user.insecure = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] barbican_service_user.keyfile  = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] barbican_service_user.split_loggers = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] barbican_service_user.timeout  = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] vault.approle_role_id          = **** {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] vault.approle_secret_id        = **** {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] vault.auth_method              = approle {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] vault.auth_path                = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] vault.kv_mountpoint            = secret {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] vault.kv_path                  = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] vault.kv_version               = 2 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] vault.namespace                = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] vault.root_token_id            = **** {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] vault.ssl_ca_crt_file          = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] vault.timeout                  = 60.0 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] vault.token_file               = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] vault.token_role               = None {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] vault.use_ssl                  = False {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:16:57 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] ******************************************************************************** {{(pid=75925) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jul 14 16:16:57 devstack sudo[76093]: pam_unix(sudo:session): session closed for user root
Jul 14 16:16:57 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.295s {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:16:57 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:16:57 devstack sudo[76096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 14 16:16:57 devstack sudo[76096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:16:57 devstack sudo[76096]: pam_unix(sudo:session): session closed for user root
Jul 14 16:16:57 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.266s {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:16:57 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 16:16:57 devstack cinder-volume[76089]: INFO cinder.brick.local_dev.lvm [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Jul 14 16:16:57 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:16:57 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:16:57 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:16:57 devstack sudo[76126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 14 16:16:57 devstack sudo[76126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:16:57 devstack sudo[76126]: pam_unix(sudo:session): session closed for user root
Jul 14 16:16:57 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:16:57 devstack cinder-volume[76089]: DEBUG cinder.brick.local_dev.lvm [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76089) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}}
Jul 14 16:16:57 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:16:57 devstack sudo[76243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 14 16:16:57 devstack sudo[76243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:16:58 devstack sudo[76243]: pam_unix(sudo:session): session closed for user root
Jul 14 16:16:58 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.498s {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:16:58 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:16:58 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:16:58 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:16:58 devstack sudo[76435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 14 16:16:58 devstack sudo[76435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:16:58 devstack sudo[76435]: pam_unix(sudo:session): session closed for user root
Jul 14 16:16:58 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:16:58 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:16:58 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:16:58 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:16:58 devstack sudo[76533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Jul 14 16:16:58 devstack sudo[76533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:16:58 devstack sudo[76533]: pam_unix(sudo:session): session closed for user root
Jul 14 16:16:58 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.248s {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:16:58 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:16:58 devstack sudo[76621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 14 16:16:58 devstack sudo[76621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:16:59 devstack sudo[76621]: pam_unix(sudo:session): session closed for user root
Jul 14 16:16:59 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.335s {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:16:59 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:16:59 devstack sudo[76701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 14 16:16:59 devstack sudo[76701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:16:59 devstack sudo[76701]: pam_unix(sudo:session): session closed for user root
Jul 14 16:16:59 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:16:59 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:16:59 devstack sudo[76709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 14 16:16:59 devstack sudo[76709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:16:59 devstack sudo[76709]: pam_unix(sudo:session): session closed for user root
Jul 14 16:16:59 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.301s {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:16:59 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:16:59 devstack sudo[76790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 14 16:16:59 devstack sudo[76790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:17:00 devstack sudo[76790]: pam_unix(sudo:session): session closed for user root
Jul 14 16:17:00 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:17:00 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:17:00 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:17:00 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:17:00 devstack sudo[76800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 14 16:17:00 devstack sudo[76800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:17:00 devstack sudo[76800]: pam_unix(sudo:session): session closed for user root
Jul 14 16:17:00 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.294s {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:17:00 devstack cinder-volume[76089]: INFO cinder.volume.drivers.lvm [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] Enabling LVM thin provisioning by default because a thin pool exists.
Jul 14 16:17:00 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:17:00 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:17:00 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:17:00 devstack sudo[76884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 14 16:17:00 devstack sudo[76884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:17:00 devstack sudo[76884]: pam_unix(sudo:session): session closed for user root
Jul 14 16:17:00 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.251s {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:17:00 devstack cinder-volume[76089]: DEBUG cinder.volume.drivers.lvm [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] Updating volume stats {{(pid=76089) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Jul 14 16:17:00 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:17:00 devstack sudo[76887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 14 16:17:00 devstack sudo[76887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:17:00 devstack sudo[76887]: pam_unix(sudo:session): session closed for user root
Jul 14 16:17:00 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:17:00 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:17:00 devstack sudo[76890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 14 16:17:00 devstack sudo[76890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:17:01 devstack sudo[76890]: pam_unix(sudo:session): session closed for user root
Jul 14 16:17:01 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:17:01 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:17:01 devstack sudo[76893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 14 16:17:01 devstack sudo[76893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:17:01 devstack sudo[76893]: pam_unix(sudo:session): session closed for user root
Jul 14 16:17:01 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:17:01 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:17:01 devstack sudo[76896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 14 16:17:01 devstack sudo[76896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:17:01 devstack sudo[76896]: pam_unix(sudo:session): session closed for user root
Jul 14 16:17:01 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:17:01 devstack cinder-volume[76089]: INFO cinder.volume.driver [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] Driver hasn't implemented _init_vendor_properties()
Jul 14 16:17:01 devstack cinder-volume[76089]: DEBUG cinder.volume.driver [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76089) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jul 14 16:17:01 devstack cinder-volume[76089]: DEBUG oslo_db.sqlalchemy.engines [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76089) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 14 16:17:01 devstack cinder-volume[76089]: DEBUG dbcounter [-] [76089] Writer thread running {{(pid=76089) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 14 16:17:01 devstack cinder-volume[76089]: DEBUG cinder.db.api [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] Building query based on filter {{(pid=76089) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jul 14 16:17:01 devstack cinder-volume[76089]: DEBUG cinder.image.image_utils [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76089) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jul 14 16:17:01 devstack cinder-volume[76089]: INFO cinder.keymgr.migration [None req-df85771f-6900-4ef2-abbd-f1fb8ba3598f None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jul 14 16:17:01 devstack cinder-volume[76089]: DEBUG cinder.volume.drivers.lvm [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] Updating volume stats {{(pid=76089) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Jul 14 16:17:01 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:17:01 devstack sudo[76904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 14 16:17:01 devstack sudo[76904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:17:02 devstack sudo[76904]: pam_unix(sudo:session): session closed for user root
Jul 14 16:17:02 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:17:02 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:17:02 devstack sudo[76907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 14 16:17:02 devstack sudo[76907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:17:02 devstack sudo[76907]: pam_unix(sudo:session): session closed for user root
Jul 14 16:17:02 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:17:02 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:17:02 devstack sudo[76910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 14 16:17:02 devstack sudo[76910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:17:02 devstack sudo[76910]: pam_unix(sudo:session): session closed for user root
Jul 14 16:17:02 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.245s {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:17:02 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:17:02 devstack sudo[76915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 14 16:17:02 devstack sudo[76915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:17:02 devstack sudo[76915]: pam_unix(sudo:session): session closed for user root
Jul 14 16:17:02 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:17:02 devstack cinder-volume[76089]: DEBUG cinder.manager [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] Notifying Schedulers of capabilities ... {{(pid=76089) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:17:02 devstack cinder-volume[76089]: INFO cinder.volume.manager [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] Driver initialization completed successfully.
Jul 14 16:17:02 devstack cinder-volume[76089]: INFO cinder.manager [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] Initiating service 2 cleanup
Jul 14 16:17:02 devstack cinder-volume[76089]: INFO cinder.manager [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] Service 2 cleanup completed.
Jul 14 16:17:02 devstack cinder-volume[76089]: DEBUG cinder.service [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] Creating RPC server for service cinder-volume {{(pid=76089) start /opt/stack/cinder/cinder/service.py:231}}
Jul 14 16:17:02 devstack cinder-volume[76089]: DEBUG cinder.service [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76089) start /opt/stack/cinder/cinder/service.py:237}}
Jul 14 16:17:03 devstack cinder-volume[76089]: INFO cinder.volume.manager [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Jul 14 16:17:03 devstack cinder-volume[76089]: DEBUG cinder.volume.drivers.lvm [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] Updating volume stats {{(pid=76089) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Jul 14 16:17:03 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:17:03 devstack sudo[76918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 14 16:17:03 devstack sudo[76918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:17:03 devstack sudo[76918]: pam_unix(sudo:session): session closed for user root
Jul 14 16:17:03 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:17:03 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:17:03 devstack sudo[76922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 14 16:17:03 devstack sudo[76922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:17:03 devstack sudo[76922]: pam_unix(sudo:session): session closed for user root
Jul 14 16:17:03 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:17:03 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:17:03 devstack sudo[76932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 14 16:17:03 devstack sudo[76932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:17:03 devstack sudo[76932]: pam_unix(sudo:session): session closed for user root
Jul 14 16:17:03 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:17:03 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:17:03 devstack sudo[76935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 14 16:17:03 devstack sudo[76935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:17:04 devstack sudo[76935]: pam_unix(sudo:session): session closed for user root
Jul 14 16:17:04 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:17:04 devstack cinder-volume[76089]: INFO cinder.volume.manager [None req-d5e25bf5-2499-48b5-8480-76a352fc429e None None] Driver post RPC initialization completed successfully.
Jul 14 16:17:06 devstack cinder-volume[75925]: DEBUG dbcounter [-] [75925] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75925) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 16:17:14 devstack cinder-volume[76089]: DEBUG dbcounter [-] [76089] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76089) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 16:17:14 devstack cinder-volume[76089]: DEBUG dbcounter [-] [76089] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=76089) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 16:17:50 devstack cinder-volume[76089]: DEBUG oslo_service.periodic_task [None req-f1c8f92d-f7db-4a13-8507-ead69bc55ead None None] Running periodic task VolumeManager._thread_info {{(pid=76089) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 16:17:50 devstack cinder-volume[76089]: DEBUG cinder.volume.manager [None req-f1c8f92d-f7db-4a13-8507-ead69bc55ead None None] thread count: 6 {{(pid=76089) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 14 16:17:50 devstack cinder-volume[76089]: DEBUG cinder.volume.manager [None req-f1c8f92d-f7db-4a13-8507-ead69bc55ead None None] thread info: [<_MainThread(MainThread, started 138166694195328)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138166583019456)>, <Thread(Thread-3 (stat_writer), started daemon 138166583803264)>, <Thread(Rabbit-heartbeat, started daemon 138166582196608)>, <Thread(Thread-5 (_runner), started daemon 138166581987712)>, <Thread(Thread-7 (_runner), started daemon 138166582083968)>] {{(pid=76089) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 14 16:18:50 devstack cinder-volume[76089]: DEBUG oslo_service.periodic_task [None req-f1c8f92d-f7db-4a13-8507-ead69bc55ead None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76089) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 16:18:50 devstack cinder-volume[76089]: DEBUG cinder.volume.drivers.lvm [None req-f1c8f92d-f7db-4a13-8507-ead69bc55ead None None] Updating volume stats {{(pid=76089) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Jul 14 16:18:50 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-f1c8f92d-f7db-4a13-8507-ead69bc55ead None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:18:50 devstack sudo[82164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 14 16:18:50 devstack sudo[82164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:18:50 devstack sudo[82164]: pam_unix(sudo:session): session closed for user root
Jul 14 16:18:50 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-f1c8f92d-f7db-4a13-8507-ead69bc55ead None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.243s {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:18:50 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-f1c8f92d-f7db-4a13-8507-ead69bc55ead None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:18:50 devstack sudo[82167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 14 16:18:50 devstack sudo[82167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:18:50 devstack sudo[82167]: pam_unix(sudo:session): session closed for user root
Jul 14 16:18:50 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-f1c8f92d-f7db-4a13-8507-ead69bc55ead None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:18:50 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-f1c8f92d-f7db-4a13-8507-ead69bc55ead None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:18:50 devstack sudo[82170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 14 16:18:50 devstack sudo[82170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:18:50 devstack sudo[82170]: pam_unix(sudo:session): session closed for user root
Jul 14 16:18:50 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-f1c8f92d-f7db-4a13-8507-ead69bc55ead None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.251s {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:18:50 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-f1c8f92d-f7db-4a13-8507-ead69bc55ead None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:18:50 devstack sudo[82173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 14 16:18:50 devstack sudo[82173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:18:51 devstack sudo[82173]: pam_unix(sudo:session): session closed for user root
Jul 14 16:18:51 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-f1c8f92d-f7db-4a13-8507-ead69bc55ead None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:18:51 devstack cinder-volume[76089]: DEBUG cinder.manager [None req-f1c8f92d-f7db-4a13-8507-ead69bc55ead None None] Notifying Schedulers of capabilities ... {{(pid=76089) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:18:51 devstack cinder-volume[76089]: DEBUG oslo_service.periodic_task [None req-f1c8f92d-f7db-4a13-8507-ead69bc55ead None None] Running periodic task VolumeManager._thread_info {{(pid=76089) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 16:18:51 devstack cinder-volume[76089]: DEBUG cinder.volume.manager [None req-f1c8f92d-f7db-4a13-8507-ead69bc55ead None None] thread count: 6 {{(pid=76089) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 14 16:18:51 devstack cinder-volume[76089]: DEBUG cinder.volume.manager [None req-f1c8f92d-f7db-4a13-8507-ead69bc55ead None None] thread info: [<_MainThread(MainThread, started 138166694195328)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138166583019456)>, <Thread(Thread-3 (stat_writer), started daemon 138166583803264)>, <Thread(Rabbit-heartbeat, started daemon 138166582196608)>, <Thread(Thread-5 (_runner), started daemon 138166581987712)>, <Thread(Thread-7 (_runner), started daemon 138166582083968)>] {{(pid=76089) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 14 16:19:14 devstack cinder-volume[76089]: DEBUG dbcounter [-] [76089] Writing DB stats cinder:SELECT=1 {{(pid=76089) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 16:19:14 devstack cinder-volume[76089]: DEBUG dbcounter [-] [76089] Writing DB stats cinder:UPDATE=1 {{(pid=76089) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 16:19:50 devstack cinder-volume[76089]: DEBUG oslo_service.periodic_task [None req-f1c8f92d-f7db-4a13-8507-ead69bc55ead None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76089) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 16:19:50 devstack cinder-volume[76089]: DEBUG cinder.volume.drivers.lvm [None req-f1c8f92d-f7db-4a13-8507-ead69bc55ead None None] Updating volume stats {{(pid=76089) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Jul 14 16:19:50 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-f1c8f92d-f7db-4a13-8507-ead69bc55ead None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:19:50 devstack sudo[83731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 14 16:19:50 devstack sudo[83731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:19:50 devstack sudo[83731]: pam_unix(sudo:session): session closed for user root
Jul 14 16:19:50 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-f1c8f92d-f7db-4a13-8507-ead69bc55ead None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:19:50 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-f1c8f92d-f7db-4a13-8507-ead69bc55ead None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:19:50 devstack sudo[83765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 14 16:19:50 devstack sudo[83765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:19:50 devstack sudo[83765]: pam_unix(sudo:session): session closed for user root
Jul 14 16:19:50 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-f1c8f92d-f7db-4a13-8507-ead69bc55ead None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:19:50 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-f1c8f92d-f7db-4a13-8507-ead69bc55ead None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:19:50 devstack sudo[83774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 14 16:19:50 devstack sudo[83774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:19:50 devstack sudo[83774]: pam_unix(sudo:session): session closed for user root
Jul 14 16:19:50 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-f1c8f92d-f7db-4a13-8507-ead69bc55ead None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.263s {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:19:50 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-f1c8f92d-f7db-4a13-8507-ead69bc55ead None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:19:50 devstack sudo[83795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 14 16:19:50 devstack sudo[83795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:19:51 devstack sudo[83795]: pam_unix(sudo:session): session closed for user root
Jul 14 16:19:51 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-f1c8f92d-f7db-4a13-8507-ead69bc55ead None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.302s {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:19:51 devstack cinder-volume[76089]: DEBUG cinder.manager [None req-f1c8f92d-f7db-4a13-8507-ead69bc55ead None None] Notifying Schedulers of capabilities ... {{(pid=76089) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:19:51 devstack cinder-volume[76089]: DEBUG oslo_service.periodic_task [None req-f1c8f92d-f7db-4a13-8507-ead69bc55ead None None] Running periodic task VolumeManager._thread_info {{(pid=76089) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 16:19:51 devstack cinder-volume[76089]: DEBUG cinder.volume.manager [None req-f1c8f92d-f7db-4a13-8507-ead69bc55ead None None] thread count: 6 {{(pid=76089) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 14 16:19:51 devstack cinder-volume[76089]: DEBUG cinder.volume.manager [None req-f1c8f92d-f7db-4a13-8507-ead69bc55ead None None] thread info: [<_MainThread(MainThread, started 138166694195328)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138166583019456)>, <Thread(Thread-3 (stat_writer), started daemon 138166583803264)>, <Thread(Rabbit-heartbeat, started daemon 138166582196608)>, <Thread(Thread-5 (_runner), started daemon 138166581987712)>, <Thread(Thread-7 (_runner), started daemon 138166582083968)>] {{(pid=76089) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 14 16:20:50 devstack cinder-volume[76089]: DEBUG oslo_service.periodic_task [None req-f1c8f92d-f7db-4a13-8507-ead69bc55ead None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76089) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 16:20:50 devstack cinder-volume[76089]: DEBUG cinder.volume.drivers.lvm [None req-f1c8f92d-f7db-4a13-8507-ead69bc55ead None None] Updating volume stats {{(pid=76089) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Jul 14 16:20:50 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-f1c8f92d-f7db-4a13-8507-ead69bc55ead None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:20:50 devstack sudo[85206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 14 16:20:50 devstack sudo[85206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:20:50 devstack sudo[85206]: pam_unix(sudo:session): session closed for user root
Jul 14 16:20:50 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-f1c8f92d-f7db-4a13-8507-ead69bc55ead None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:20:50 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-f1c8f92d-f7db-4a13-8507-ead69bc55ead None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:20:50 devstack sudo[85212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 14 16:20:50 devstack sudo[85212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:20:50 devstack sudo[85212]: pam_unix(sudo:session): session closed for user root
Jul 14 16:20:50 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-f1c8f92d-f7db-4a13-8507-ead69bc55ead None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:20:50 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-f1c8f92d-f7db-4a13-8507-ead69bc55ead None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:20:50 devstack sudo[85215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 14 16:20:50 devstack sudo[85215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:20:50 devstack sudo[85215]: pam_unix(sudo:session): session closed for user root
Jul 14 16:20:50 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-f1c8f92d-f7db-4a13-8507-ead69bc55ead None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.270s {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:20:50 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-f1c8f92d-f7db-4a13-8507-ead69bc55ead None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:20:51 devstack sudo[85219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 14 16:20:51 devstack sudo[85219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:20:51 devstack sudo[85219]: pam_unix(sudo:session): session closed for user root
Jul 14 16:20:51 devstack cinder-volume[76089]: DEBUG oslo_concurrency.processutils [None req-f1c8f92d-f7db-4a13-8507-ead69bc55ead None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=76089) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:20:51 devstack cinder-volume[76089]: DEBUG cinder.manager [None req-f1c8f92d-f7db-4a13-8507-ead69bc55ead None None] Notifying Schedulers of capabilities ... {{(pid=76089) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:20:51 devstack cinder-volume[76089]: DEBUG oslo_service.periodic_task [None req-f1c8f92d-f7db-4a13-8507-ead69bc55ead None None] Running periodic task VolumeManager._thread_info {{(pid=76089) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 16:20:51 devstack cinder-volume[76089]: DEBUG cinder.volume.manager [None req-f1c8f92d-f7db-4a13-8507-ead69bc55ead None None] thread count: 6 {{(pid=76089) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 14 16:20:51 devstack cinder-volume[76089]: DEBUG cinder.volume.manager [None req-f1c8f92d-f7db-4a13-8507-ead69bc55ead None None] thread info: [<_MainThread(MainThread, started 138166694195328)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 138166583019456)>, <Thread(Thread-3 (stat_writer), started daemon 138166583803264)>, <Thread(Rabbit-heartbeat, started daemon 138166582196608)>, <Thread(Thread-5 (_runner), started daemon 138166581987712)>, <Thread(Thread-7 (_runner), started daemon 138166582083968)>] {{(pid=76089) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 14 16:21:14 devstack cinder-volume[76089]: DEBUG dbcounter [-] [76089] Writing DB stats cinder:SELECT=1 {{(pid=76089) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 16:21:14 devstack cinder-volume[76089]: DEBUG dbcounter [-] [76089] Writing DB stats cinder:UPDATE=1 {{(pid=76089) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 16:21:31 devstack cinder-volume[75925]: INFO oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] Caught SIGTERM, stopping children
Jul 14 16:21:31 devstack cinder-volume[75925]: DEBUG oslo_concurrency.lockutils [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] Acquiring lock "singleton_lock" {{(pid=75925) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 14 16:21:31 devstack cinder-volume[75925]: DEBUG oslo_concurrency.lockutils [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] Acquired lock "singleton_lock" {{(pid=75925) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 14 16:21:31 devstack cinder-volume[75925]: DEBUG oslo_concurrency.lockutils [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] Releasing lock "singleton_lock" {{(pid=75925) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 14 16:21:31 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] Stop services. {{(pid=75925) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Jul 14 16:21:31 devstack cinder-volume[75925]: DEBUG oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] Killing children. {{(pid=75925) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Jul 14 16:21:31 devstack cinder-volume[75925]: INFO oslo_service.backend._eventlet.service [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] Waiting on 1 children to exit
Jul 14 16:21:36 devstack cinder-volume[76089]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting
Jul 14 16:21:36 devstack cinder-volume[86155]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jul 14 16:21:36 devstack cinder-volume[86155]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 14 16:21:36 devstack cinder-volume[86155]: we strongly recommend against using it for new projects.
Jul 14 16:21:36 devstack cinder-volume[86155]: If you are already using Eventlet, we recommend migrating to a different
Jul 14 16:21:36 devstack cinder-volume[86155]: framework.  For more detail see
Jul 14 16:21:36 devstack cinder-volume[86155]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 14 16:21:36 devstack cinder-volume[86155]:   import eventlet  # noqa
Jul 14 16:21:38 devstack cinder-volume[76089]: DEBUG oslo_concurrency.lockutils [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] Acquiring lock "singleton_lock" {{(pid=76089) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 14 16:21:38 devstack cinder-volume[76089]: DEBUG oslo_concurrency.lockutils [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] Acquired lock "singleton_lock" {{(pid=76089) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 14 16:21:38 devstack cinder-volume[76089]: DEBUG oslo_concurrency.lockutils [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] Releasing lock "singleton_lock" {{(pid=76089) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 14 16:21:38 devstack cinder-volume[76089]: WARNING amqp [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 14 16:21:38 devstack cinder-volume[76089]: WARNING amqp [None req-aa9bab83-5cb1-4b44-923b-7a5a6bec17b9 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 14 16:21:38 devstack cinder-volume[86155]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86155) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 14 16:21:38 devstack cinder-volume[86155]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86155) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 14 16:21:38 devstack cinder-volume[86155]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86155) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 14 16:21:39 devstack cinder-volume[86155]: INFO dbcounter [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] Registered counter for database cinder
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_db.sqlalchemy.engines [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86155) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG dbcounter [-] [86155] Writer thread running {{(pid=86155) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 14 16:21:39 devstack cinder-volume[86155]: INFO cinder.rpc [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jul 14 16:21:39 devstack cinder-volume[86155]: INFO cinder.rpc [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_db.sqlalchemy.engines [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86155) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 14 16:21:39 devstack cinder-volume[86155]: INFO cinder.volume.manager [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] Determined volume DB was empty at startup.
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG cinder.volume.manager [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86155) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jul 14 16:21:39 devstack cinder-volume[86155]: INFO cinder.volume.manager [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] Service not found for updating active_backend_id, assuming default for driver init.
Jul 14 16:21:39 devstack cinder-volume[86155]: WARNING stevedore.named [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 14 16:21:39 devstack cinder-volume[86155]: WARNING castellan.key_manager [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 14 16:21:39 devstack cinder-volume[86155]: WARNING cinder.keymgr.conf_key_mgr [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 14 16:21:39 devstack cinder-volume[86155]: INFO cinder.volume.manager [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] Image-volume cache disabled for host devstack@QuobyteHD.
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_db.sqlalchemy.engines [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86155) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 14 16:21:39 devstack cinder-volume[86155]: INFO oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] Starting 1 workers
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] Started child 86377 {{(pid=86155) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] Full set of CONF: {{(pid=86155) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] ******************************************************************************** {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] Configuration options gathered from: {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] ================================================================================ {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] allow_availability_zone_fallback = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] allow_compression_on_image_upload = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] allowed_direct_url_schemes     = [] {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] api_rate_limit                 = True {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] auth_strategy                  = keystone {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86377]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_availability_zone      = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_host                   = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_name                   = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_stats_polling_interval = 60 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backup_api_class               = cinder.backup.api.API {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backup_name_template           = backup-%s {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backup_use_same_host           = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backup_use_temp_snapshot       = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] chap_password                  = **** {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] chap_username                  =  {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] cinder_internal_tenant_project_id = cf3b09c69d95444c88eabba304030e30 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] cinder_internal_tenant_user_id = 088138043d294834a037842a1c9d0f70 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] cluster                        = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] compression_format             = gzip {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] compute_api_class              = cinder.compute.nova.API {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] config_dir                     = [] {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] config_source                  = [] {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] control_exchange               = openstack {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] debug                          = True {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] default_availability_zone      = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] default_group_type             = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] default_volume_type            = QuobyteHD {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] disk_geometry                  = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] driver_client_cert             = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] driver_client_cert_key         = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] driver_data_namespace          = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] driver_ssl_cert_path           = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] driver_ssl_cert_verify         = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] driver_use_ssl                 = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] enable_new_services            = True {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] enable_unsupported_driver      = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] enabled_backends               = ['QuobyteHD'] {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] enforce_multipath_for_image_xfer = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] filter_function                = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] glance_api_insecure            = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] glance_api_servers             = ['http://192.168.122.108/image'] {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] glance_api_ssl_compression     = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] glance_ca_certificates_file    = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] glance_catalog_info            = image:glance:publicURL {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] glance_certfile                = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] glance_keyfile                 = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] glance_num_retries             = 3 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] glance_request_timeout         = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] goodness_function              = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] graceful_shutdown_timeout      = 5 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] group_api_class                = cinder.group.api.API {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] host                           = devstack {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] image_compress_on_upload       = True {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] image_conversion_address_space_limit = 1 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] image_conversion_cpu_limit     = 60 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] image_conversion_disable       = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] image_upload_use_cinder_backend = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] image_upload_use_internal_tenant = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] image_volume_cache_enabled     = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] image_volume_cache_max_count   = 0 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] image_volume_cache_max_size_gb = 0 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] init_host_max_objects_retrieval = 0 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] instance_format                = [instance: %(uuid)s]  {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] iscsi_target_flags             =  {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] iscsi_write_cache              = on {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] iser_helper                    = tgtadm {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] iser_ip_address                = 192.168.122.108 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] iser_port                      = 3260 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] log_color                      = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] log_config_append              = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] log_dir                        = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86377]: INFO cinder.volume.manager [None req-06c76ef9-029d-4490-b6ea-d580e4171543 None None] Starting volume driver QuobyteDriver (1.1.14)
Jul 14 16:21:39 devstack cinder-volume[86377]: DEBUG cinder.volume.drivers.remotefs [None req-06c76ef9-029d-4490-b6ea-d580e4171543 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86377) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] log_file                       = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] log_options                    = True {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] log_rotate_interval            = 1 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] log_rotate_interval_type       = days {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] log_rotation_type              = none {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] max_age                        = 0 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] max_logfile_count              = 30 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] max_logfile_size_mb            = 200 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:39 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] max_over_subscription_ratio    = 20.0 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] message_reap_interval          = 86400 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] message_ttl                    = 2592000 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] migration_create_volume_timeout_secs = 300 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] monkey_patch                   = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] monkey_patch_modules           = [] {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] my_ip                          = 192.168.122.108 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] no_snapshot_gb_quota           = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] num_iser_scan_tries            = 3 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] num_shell_tries                = 3 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] num_volume_device_scan_tries   = 3 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] nvmeof_conn_info_version       = 1 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] nvmet_ns_id                    = 10 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] nvmet_port_id                  = 1 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] osapi_max_limit                = 1000 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] osapi_volume_ext_list          = [] {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] osapi_volume_listen            = 0.0.0.0 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] osapi_volume_listen_port       = 8776 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] osapi_volume_use_ssl           = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] osapi_volume_workers           = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] per_volume_size_limit          = -1 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] periodic_fuzzy_delay           = 60 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] periodic_interval              = 60 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] project_id_regex               = [0-9a-f\-]+ {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] public_endpoint                = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] publish_errors                 = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] quota_backup_gigabytes         = 1000 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] quota_backups                  = 10 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] quota_gigabytes                = 1000 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] quota_groups                   = 10 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] quota_snapshots                = 10 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] quota_volumes                  = 10 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] rate_limit_burst               = 0 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] rate_limit_except_level        = CRITICAL {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] rate_limit_interval            = 0 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] reinit_driver_count            = 3 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] replication_device             = **** {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] report_discard_supported       = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] report_interval                = 120 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] reservation_clean_interval     = 86400 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] reservation_expire             = 86400 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] reserved_image_namespaces      = [] {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] reserved_percentage            = 0 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] rpc_response_timeout           = 120 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] run_external_periodic_tasks    = True {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] scst_target_driver             = iscsi {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] scst_target_iqn_name           = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] service_down_time              = 720 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] shell_completion               = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] snapshot_name_template         = snapshot-%s {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] split_loggers                  = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] state_path                     = /opt/stack/data/cinder {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] storage_availability_zone      = nova {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] storage_protocol               = iSCSI {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] syslog_log_facility            = LOG_USER {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] target_helper                  = lioadm {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] target_ip_address              = 192.168.122.108 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] target_port                    = 3260 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] target_protocol                = iscsi {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] target_secondary_ip_addresses  = [] {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] trace_flags                    = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] transfer_api_class             = cinder.transfer.api.API {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] transport_url                  = **** {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] until_refresh                  = 0 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] use_chap_auth                  = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] use_default_quota_class        = True {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] use_journal                    = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] use_json                       = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] use_multipath_for_image_xfer   = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] use_stderr                     = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] use_syslog                     = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] verify_glance_signatures       = enabled {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] volume_api_class               = cinder.volume.api.API {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] volume_backend_name            = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] volume_clear                   = zero {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] volume_clear_ionice            = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] volume_clear_size              = 0 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] volume_copy_bps_limit          = 0 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] volume_dd_blocksize            = 1M {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] volume_name_template           = volume-%s {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] volume_service_inithost_offload = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] volume_usage_audit_period      = month {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] zoning_mode                    = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] oslo_concurrency.disable_process_locking = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] keystone_authtoken.auth_section = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] keystone_authtoken.auth_type   = password {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] keystone_authtoken.auth_version = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] keystone_authtoken.cache       = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] keystone_authtoken.certfile    = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] keystone_authtoken.delay_auth_decision = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] keystone_authtoken.http_connect_timeout = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] keystone_authtoken.include_service_catalog = True {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] keystone_authtoken.insecure    = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] keystone_authtoken.interface   = public {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] keystone_authtoken.keyfile     = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] keystone_authtoken.memcache_password =  {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] keystone_authtoken.memcache_username =  {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] keystone_authtoken.region_name = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] keystone_authtoken.service_token_roles_required = True {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] keystone_authtoken.service_type = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] keystone_authtoken.token_cache_time = 300 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.108/identity {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] cache.backend                  = dogpile.cache.null {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] cache.backend_argument         = **** {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] cache.backend_expiration_time  = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] cache.config_prefix            = cache.oslo {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] cache.debug_cache_backend      = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] cache.enable_retry_client      = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] cache.enable_socket_keepalive  = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] cache.enabled                  = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] cache.expiration_time          = 600 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] cache.hashclient_retry_attempts = 2 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] cache.memcache_dead_retry      = 300 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] cache.memcache_pool_maxsize    = 10 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] cache.memcache_sasl_enabled    = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] cache.password                 = **** {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] cache.proxies                  = [] {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] cache.redis_db                 = 0 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] cache.redis_sentinel_service_name = mymaster {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] cache.redis_server             = localhost:6379 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] cache.retry_attempts           = 2 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] cache.retry_delay              = 0.0 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] cache.socket_keepalive_count   = 1 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] cache.socket_keepalive_idle    = 1 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] cache.socket_keepalive_interval = 1 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] cache.socket_timeout           = 1.0 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] cache.tls_allowed_ciphers      = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] cache.tls_cafile               = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] cache.tls_certfile             = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] cache.tls_enabled              = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] cache.tls_keyfile              = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] cache.username                 = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] coordination.backend_url       = **** {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] database.asyncio_connection    = **** {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] database.asyncio_slave_connection = **** {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] database.backend               = sqlalchemy {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] database.connection            = **** {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] database.connection_debug      = 0 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] database.connection_parameters =  {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] database.connection_recycle_time = 3600 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] database.connection_trace      = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] database.db_inc_retry_interval = True {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] database.db_max_retries        = 20 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] database.db_max_retry_interval = 10 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] database.db_retry_interval     = 1 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] database.max_overflow          = 50 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] database.max_pool_size         = 5 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] database.max_retries           = 10 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] database.mysql_wsrep_sync_wait = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] database.pool_timeout          = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] database.retry_interval        = 10 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] database.slave_connection      = **** {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] database.sqlite_synchronous    = True {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] database.synchronous_reader    = True {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86377]: DEBUG cinder.volume.drivers.quobyte [None req-06c76ef9-029d-4490-b6ea-d580e4171543 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86377) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Jul 14 16:21:40 devstack cinder-volume[86377]: WARNING cinder.volume.drivers.quobyte [None req-06c76ef9-029d-4490-b6ea-d580e4171543 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Jul 14 16:21:40 devstack cinder-volume[86377]: WARNING cinder.volume.drivers.quobyte [None req-06c76ef9-029d-4490-b6ea-d580e4171543 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] database.use_db_reconnect      = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] profiler.connection_string     = messaging:// {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] profiler.enabled               = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] profiler.es_doc_type           = notification {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] profiler.es_scroll_size        = 10000 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] profiler.es_scroll_time        = 2m {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] profiler.filter_error_trace    = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] profiler.hmac_keys             = **** {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] profiler.sentinel_service_name = mymaster {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] profiler.socket_timeout        = 0.1 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] profiler.trace_requests        = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86377]: DEBUG oslo_concurrency.processutils [None req-06c76ef9-029d-4490-b6ea-d580e4171543 None None] Running cmd (subprocess): mount.quobyte {{(pid=86377) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] profiler.trace_sqlalchemy      = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] profiler_jaeger.process_tags   = {} {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] profiler_jaeger.service_name_prefix = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] profiler_otlp.service_name_prefix = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] oslo_policy.enforce_new_defaults = True {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] oslo_policy.enforce_scope      = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] oslo_policy.policy_default_rule = default {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] oslo_policy.policy_file        = policy.yaml {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] oslo_policy.remote_timeout     = 60.0 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] privsep_osbrick.group          = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] privsep_osbrick.helper_command = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] privsep_osbrick.user           = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] cinder_sys_admin.group         = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] cinder_sys_admin.helper_command = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] cinder_sys_admin.user          = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] service_user.auth_section      = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] service_user.auth_type         = password {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] service_user.cafile            = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] service_user.certfile          = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] service_user.collect_timing    = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] service_user.insecure          = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] service_user.keyfile           = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] service_user.send_service_user_token = True {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] service_user.split_loggers     = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] service_user.timeout           = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] glance.auth_section            = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] glance.auth_type               = password {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] glance.certfile                = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] glance.collect_timing          = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] glance.insecure                = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] glance.keyfile                 = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] glance.region_name             = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] glance.split_loggers           = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] glance.timeout                 = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_defaults.backend_availability_zone = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_defaults.chap_password = **** {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_defaults.chap_username =  {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_defaults.disk_geometry = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_defaults.driver_client_cert = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_defaults.driver_client_cert_key = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_defaults.driver_data_namespace = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_defaults.driver_use_ssl = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_defaults.enable_unsupported_driver = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_defaults.extra_capabilities = {} {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_defaults.filter_function = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_defaults.goodness_function = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_defaults.iscsi_target_flags =  {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_defaults.iscsi_write_cache = on {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_defaults.iser_helper   = tgtadm {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_defaults.iser_ip_address = 192.168.122.108 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_defaults.iser_port     = 3260 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_defaults.nas_host      =  {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_defaults.nas_login     = admin {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_defaults.nas_mount_options = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_defaults.nas_password  = **** {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_defaults.nas_private_key =  {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_defaults.nas_share_path =  {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_defaults.nas_ssh_port  = 22 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_defaults.num_shell_tries = 3 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_defaults.nvmet_port_id = 1 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_defaults.quobyte_client_cfg = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_defaults.quobyte_volume_url = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_defaults.replication_device = **** {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_defaults.report_discard_supported = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_defaults.reserved_percentage = 0 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_defaults.scst_target_driver = iscsi {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_defaults.scst_target_iqn_name = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_defaults.storage_protocol = iSCSI {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_defaults.target_helper = tgtadm {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_defaults.target_ip_address = 192.168.122.108 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_defaults.target_port   = 3260 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_defaults.target_protocol = iscsi {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_defaults.trace_flags   = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_defaults.unique_fqdn_network = True {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_defaults.use_chap_auth = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_defaults.volume_backend_name = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_defaults.volume_clear  = zero {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_defaults.volume_clear_ionice = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_defaults.volume_clear_size = 0 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] oslo_reports.file_event_handler = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] oslo_reports.log_dir           = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] QuobyteHD.backend_availability_zone = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] QuobyteHD.backend_host         = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] QuobyteHD.chap_password        = **** {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] QuobyteHD.chap_username        = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] QuobyteHD.chiscsi_conf         = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] QuobyteHD.disk_geometry        = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] QuobyteHD.driver_client_cert   = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] QuobyteHD.driver_client_cert_key = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] QuobyteHD.driver_data_namespace = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] QuobyteHD.driver_use_ssl       = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] QuobyteHD.extra_capabilities   = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] QuobyteHD.filter_function      = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] QuobyteHD.goodness_function    = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] QuobyteHD.iscsi_target_flags   = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] QuobyteHD.iscsi_write_cache    = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] QuobyteHD.iser_helper          = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] QuobyteHD.iser_ip_address      = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] QuobyteHD.iser_port            = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] QuobyteHD.iser_target_prefix   = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] QuobyteHD.nas_host             = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] QuobyteHD.nas_login            = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] QuobyteHD.nas_mount_options    = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] QuobyteHD.nas_password         = **** {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] QuobyteHD.nas_private_key      = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] QuobyteHD.nas_share_path       = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] QuobyteHD.nas_ssh_port         = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] QuobyteHD.num_shell_tries      = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] QuobyteHD.nvmet_ns_id          = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] QuobyteHD.nvmet_port_id        = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] QuobyteHD.replication_device   = **** {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] QuobyteHD.report_discard_supported = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] QuobyteHD.reserved_percentage  = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] QuobyteHD.scst_target_driver   = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] QuobyteHD.storage_protocol     = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] QuobyteHD.target_helper        = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] QuobyteHD.target_ip_address    = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] QuobyteHD.target_port          = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] QuobyteHD.target_prefix        = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] QuobyteHD.target_protocol      = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] QuobyteHD.trace_flags          = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] QuobyteHD.unique_fqdn_network  = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] QuobyteHD.use_chap_auth        = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] QuobyteHD.volume_clear         = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] QuobyteHD.volume_clear_ionice  = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] QuobyteHD.volume_clear_size    = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] QuobyteHD.volumes_dir          = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] oslo_messaging_rabbit.ssl      = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] oslo_messaging_rabbit.ssl_version =  {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] oslo_messaging_notifications.driver = [] {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] oslo_messaging_notifications.retry = -1 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] oslo_messaging_notifications.transport_url = **** {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] key_manager.fixed_key          = **** {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] barbican.barbican_api_version  = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] barbican.barbican_endpoint     = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] barbican.barbican_endpoint_type = public {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] barbican.barbican_region_name  = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] barbican.cafile                = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] barbican.certfile              = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] barbican.collect_timing        = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] barbican.insecure              = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] barbican.keyfile               = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] barbican.number_of_retries     = 60 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] barbican.retry_delay           = 1 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] barbican.send_service_user_token = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] barbican.split_loggers         = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] barbican.timeout               = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] barbican.verify_ssl            = True {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] barbican.verify_ssl_path       = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] barbican_service_user.auth_section = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] barbican_service_user.auth_type = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] barbican_service_user.cafile   = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] barbican_service_user.certfile = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] barbican_service_user.collect_timing = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] barbican_service_user.insecure = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] barbican_service_user.keyfile  = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack quobyte-client[86382]: Reading configuration file: /etc/quobyte/client.cfg
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] barbican_service_user.split_loggers = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] barbican_service_user.timeout  = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] vault.approle_role_id          = **** {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] vault.approle_secret_id        = **** {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] vault.auth_method              = approle {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] vault.auth_path                = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] vault.kv_mountpoint            = secret {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack quobyte-client[86382]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] vault.kv_path                  = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] vault.kv_version               = 2 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] vault.namespace                = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] vault.root_token_id            = **** {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] vault.ssl_ca_crt_file          = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] vault.timeout                  = 60.0 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] vault.token_file               = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] vault.token_role               = None {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] vault.use_ssl                  = False {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:40 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] ******************************************************************************** {{(pid=86155) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jul 14 16:21:40 devstack cinder-volume[86377]: DEBUG oslo_concurrency.processutils [None req-06c76ef9-029d-4490-b6ea-d580e4171543 None None] CMD "mount.quobyte" returned: 1 in 0.124s {{(pid=86377) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:21:40 devstack cinder-volume[86377]: DEBUG oslo_concurrency.lockutils [None req-06c76ef9-029d-4490-b6ea-d580e4171543 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86377) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:21:40 devstack cinder-volume[86377]: DEBUG oslo_concurrency.lockutils [None req-06c76ef9-029d-4490-b6ea-d580e4171543 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86377) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:21:40 devstack cinder-volume[86377]: DEBUG cinder.volume.drivers.quobyte [None req-06c76ef9-029d-4490-b6ea-d580e4171543 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=86377) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:21:40 devstack cinder-volume[86377]: INFO cinder.volume.drivers.quobyte [None req-06c76ef9-029d-4490-b6ea-d580e4171543 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 ...
Jul 14 16:21:40 devstack cinder-volume[86377]: DEBUG oslo_concurrency.processutils [None req-06c76ef9-029d-4490-b6ea-d580e4171543 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c -c /etc/quobyte/client-cinder.cfg {{(pid=86377) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:21:40 devstack sudo[86383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c -c /etc/quobyte/client-cinder.cfg
Jul 14 16:21:40 devstack sudo[86383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:21:40 devstack sudo[86383]: pam_unix(sudo:session): session closed for user root
Jul 14 16:21:40 devstack cinder-volume[86377]: DEBUG oslo_concurrency.processutils [None req-06c76ef9-029d-4490-b6ea-d580e4171543 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.388s {{(pid=86377) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:21:40 devstack cinder-volume[86377]: INFO cinder.volume.drivers.quobyte [None req-06c76ef9-029d-4490-b6ea-d580e4171543 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 succeeded
Jul 14 16:21:40 devstack cinder-volume[86377]: DEBUG cinder.volume.drivers.quobyte [None req-06c76ef9-029d-4490-b6ea-d580e4171543 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=86377) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:21:40 devstack cinder-volume[86377]: DEBUG oslo_concurrency.lockutils [None req-06c76ef9-029d-4490-b6ea-d580e4171543 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.401s {{(pid=86377) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:21:40 devstack cinder-volume[86377]: DEBUG oslo_concurrency.processutils [None req-06c76ef9-029d-4490-b6ea-d580e4171543 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=86377) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:21:40 devstack sudo[86452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:21:40 devstack sudo[86452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:21:40 devstack sudo[86452]: pam_unix(sudo:session): session closed for user root
Jul 14 16:21:40 devstack cinder-volume[86377]: DEBUG oslo_concurrency.processutils [None req-06c76ef9-029d-4490-b6ea-d580e4171543 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.265s {{(pid=86377) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:21:40 devstack cinder-volume[86377]: INFO cinder.volume.driver [None req-06c76ef9-029d-4490-b6ea-d580e4171543 None None] Driver hasn't implemented _init_vendor_properties()
Jul 14 16:21:40 devstack cinder-volume[86377]: DEBUG cinder.volume.driver [None req-06c76ef9-029d-4490-b6ea-d580e4171543 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6650619506836, 'free_capacity_gb': 1775.6650619506836, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86377) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jul 14 16:21:41 devstack cinder-volume[86377]: DEBUG oslo_db.sqlalchemy.engines [None req-06c76ef9-029d-4490-b6ea-d580e4171543 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86377) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 14 16:21:41 devstack cinder-volume[86377]: DEBUG dbcounter [-] [86377] Writer thread running {{(pid=86377) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 14 16:21:41 devstack cinder-volume[86377]: DEBUG cinder.db.api [None req-06c76ef9-029d-4490-b6ea-d580e4171543 None None] Building query based on filter {{(pid=86377) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jul 14 16:21:41 devstack cinder-volume[86377]: DEBUG cinder.image.image_utils [None req-06c76ef9-029d-4490-b6ea-d580e4171543 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86377) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jul 14 16:21:41 devstack cinder-volume[86377]: INFO cinder.keymgr.migration [None req-aa0cc144-5163-4d6e-84f6-bb1c73d19718 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jul 14 16:21:41 devstack cinder-volume[86377]: DEBUG oslo_concurrency.lockutils [None req-06c76ef9-029d-4490-b6ea-d580e4171543 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86377) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:21:41 devstack cinder-volume[86377]: DEBUG oslo_concurrency.lockutils [None req-06c76ef9-029d-4490-b6ea-d580e4171543 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86377) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:21:41 devstack cinder-volume[86377]: DEBUG cinder.volume.drivers.quobyte [None req-06c76ef9-029d-4490-b6ea-d580e4171543 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=86377) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:21:41 devstack cinder-volume[86377]: DEBUG cinder.volume.drivers.quobyte [None req-06c76ef9-029d-4490-b6ea-d580e4171543 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=86377) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:21:41 devstack cinder-volume[86377]: DEBUG oslo_concurrency.lockutils [None req-06c76ef9-029d-4490-b6ea-d580e4171543 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86377) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:21:41 devstack cinder-volume[86377]: DEBUG oslo_concurrency.processutils [None req-06c76ef9-029d-4490-b6ea-d580e4171543 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=86377) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:21:41 devstack sudo[86469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:21:41 devstack sudo[86469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:21:41 devstack sudo[86469]: pam_unix(sudo:session): session closed for user root
Jul 14 16:21:41 devstack cinder-volume[86377]: DEBUG oslo_concurrency.processutils [None req-06c76ef9-029d-4490-b6ea-d580e4171543 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.283s {{(pid=86377) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:21:41 devstack cinder-volume[86377]: DEBUG cinder.manager [None req-06c76ef9-029d-4490-b6ea-d580e4171543 None None] Notifying Schedulers of capabilities ... {{(pid=86377) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:21:41 devstack cinder-volume[86377]: INFO cinder.volume.manager [None req-06c76ef9-029d-4490-b6ea-d580e4171543 None None] Driver initialization completed successfully.
Jul 14 16:21:41 devstack cinder-volume[86377]: INFO cinder.manager [None req-06c76ef9-029d-4490-b6ea-d580e4171543 None None] Initiating service 3 cleanup
Jul 14 16:21:41 devstack cinder-volume[86377]: INFO cinder.manager [None req-06c76ef9-029d-4490-b6ea-d580e4171543 None None] Service 3 cleanup completed.
Jul 14 16:21:41 devstack cinder-volume[86377]: DEBUG cinder.service [None req-06c76ef9-029d-4490-b6ea-d580e4171543 None None] Creating RPC server for service cinder-volume {{(pid=86377) start /opt/stack/cinder/cinder/service.py:231}}
Jul 14 16:21:41 devstack cinder-volume[86377]: DEBUG cinder.service [None req-06c76ef9-029d-4490-b6ea-d580e4171543 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86377) start /opt/stack/cinder/cinder/service.py:237}}
Jul 14 16:21:41 devstack cinder-volume[86377]: INFO cinder.volume.manager [None req-06c76ef9-029d-4490-b6ea-d580e4171543 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Jul 14 16:21:41 devstack cinder-volume[86377]: DEBUG oslo_concurrency.lockutils [None req-06c76ef9-029d-4490-b6ea-d580e4171543 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86377) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:21:41 devstack cinder-volume[86377]: DEBUG oslo_concurrency.lockutils [None req-06c76ef9-029d-4490-b6ea-d580e4171543 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86377) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:21:41 devstack cinder-volume[86377]: DEBUG cinder.volume.drivers.quobyte [None req-06c76ef9-029d-4490-b6ea-d580e4171543 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=86377) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:21:41 devstack cinder-volume[86377]: DEBUG cinder.volume.drivers.quobyte [None req-06c76ef9-029d-4490-b6ea-d580e4171543 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=86377) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:21:41 devstack cinder-volume[86377]: DEBUG oslo_concurrency.lockutils [None req-06c76ef9-029d-4490-b6ea-d580e4171543 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86377) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:21:41 devstack cinder-volume[86377]: DEBUG oslo_concurrency.processutils [None req-06c76ef9-029d-4490-b6ea-d580e4171543 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=86377) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:21:41 devstack sudo[86480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:21:41 devstack sudo[86480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:21:41 devstack sudo[86480]: pam_unix(sudo:session): session closed for user root
Jul 14 16:21:41 devstack cinder-volume[86377]: DEBUG oslo_concurrency.processutils [None req-06c76ef9-029d-4490-b6ea-d580e4171543 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.274s {{(pid=86377) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:21:42 devstack cinder-volume[86377]: INFO cinder.volume.manager [None req-06c76ef9-029d-4490-b6ea-d580e4171543 None None] Driver post RPC initialization completed successfully.
Jul 14 16:21:46 devstack cinder-volume[86377]: DEBUG oslo_concurrency.lockutils [None req-57bccfe1-2a08-48bb-a3c4-a40ccce5027c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86377) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:21:46 devstack cinder-volume[86377]: DEBUG oslo_concurrency.lockutils [None req-57bccfe1-2a08-48bb-a3c4-a40ccce5027c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86377) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:21:46 devstack cinder-volume[86377]: DEBUG cinder.volume.drivers.quobyte [None req-57bccfe1-2a08-48bb-a3c4-a40ccce5027c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=86377) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:21:46 devstack cinder-volume[86377]: DEBUG cinder.volume.drivers.quobyte [None req-57bccfe1-2a08-48bb-a3c4-a40ccce5027c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=86377) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:21:46 devstack cinder-volume[86377]: DEBUG oslo_concurrency.lockutils [None req-57bccfe1-2a08-48bb-a3c4-a40ccce5027c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86377) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:21:46 devstack cinder-volume[86377]: DEBUG oslo_concurrency.processutils [None req-57bccfe1-2a08-48bb-a3c4-a40ccce5027c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=86377) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:21:46 devstack sudo[86683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:21:46 devstack sudo[86683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:21:46 devstack sudo[86683]: pam_unix(sudo:session): session closed for user root
Jul 14 16:21:46 devstack cinder-volume[86377]: DEBUG oslo_concurrency.processutils [None req-57bccfe1-2a08-48bb-a3c4-a40ccce5027c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.266s {{(pid=86377) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:21:46 devstack cinder-volume[86377]: DEBUG cinder.manager [None req-57bccfe1-2a08-48bb-a3c4-a40ccce5027c None None] Notifying Schedulers of capabilities ... {{(pid=86377) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:21:47 devstack cinder-volume[86155]: INFO oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] Caught SIGTERM, stopping children
Jul 14 16:21:47 devstack cinder-volume[86155]: DEBUG oslo_concurrency.lockutils [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] Acquiring lock "singleton_lock" {{(pid=86155) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 14 16:21:47 devstack cinder-volume[86155]: DEBUG oslo_concurrency.lockutils [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] Acquired lock "singleton_lock" {{(pid=86155) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 14 16:21:47 devstack cinder-volume[86155]: DEBUG oslo_concurrency.lockutils [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] Releasing lock "singleton_lock" {{(pid=86155) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 14 16:21:47 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] Stop services. {{(pid=86155) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Jul 14 16:21:47 devstack cinder-volume[86155]: DEBUG oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] Killing children. {{(pid=86155) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Jul 14 16:21:47 devstack cinder-volume[86155]: INFO oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] Waiting on 1 children to exit
Jul 14 16:21:49 devstack cinder-volume[86377]: DEBUG oslo_concurrency.lockutils [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] Acquiring lock "singleton_lock" {{(pid=86377) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 14 16:21:49 devstack cinder-volume[86377]: DEBUG oslo_concurrency.lockutils [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] Acquired lock "singleton_lock" {{(pid=86377) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 14 16:21:49 devstack cinder-volume[86377]: DEBUG oslo_concurrency.lockutils [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] Releasing lock "singleton_lock" {{(pid=86377) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 14 16:21:49 devstack cinder-volume[86377]: WARNING amqp [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 14 16:21:50 devstack cinder-volume[86377]: WARNING amqp [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 14 16:21:50 devstack cinder-volume[86155]: INFO oslo_service.backend._eventlet.service [None req-f73cddb7-958c-4df7-addf-cfc4b037511f None None] Child 86377 exited with status 0
Jul 14 16:21:50 devstack cinder-volume[86851]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jul 14 16:21:50 devstack cinder-volume[86851]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 14 16:21:50 devstack cinder-volume[86851]: we strongly recommend against using it for new projects.
Jul 14 16:21:50 devstack cinder-volume[86851]: If you are already using Eventlet, we recommend migrating to a different
Jul 14 16:21:50 devstack cinder-volume[86851]: framework.  For more detail see
Jul 14 16:21:50 devstack cinder-volume[86851]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 14 16:21:50 devstack cinder-volume[86851]:   import eventlet  # noqa
Jul 14 16:21:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86851) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 14 16:21:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86851) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 14 16:21:54 devstack cinder-volume[86851]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86851) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 14 16:21:55 devstack cinder-volume[86851]: INFO dbcounter [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] Registered counter for database cinder
Jul 14 16:21:55 devstack cinder-volume[86851]: DEBUG oslo_db.sqlalchemy.engines [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86851) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 14 16:21:55 devstack cinder-volume[86851]: DEBUG dbcounter [-] [86851] Writer thread running {{(pid=86851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 14 16:21:55 devstack cinder-volume[86851]: INFO cinder.rpc [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jul 14 16:21:55 devstack cinder-volume[86851]: INFO cinder.rpc [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jul 14 16:21:55 devstack cinder-volume[86851]: DEBUG oslo_db.sqlalchemy.engines [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86851) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 14 16:21:55 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] Determined volume DB was empty at startup.
Jul 14 16:21:55 devstack cinder-volume[86851]: DEBUG cinder.volume.manager [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86851) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jul 14 16:21:55 devstack cinder-volume[86851]: WARNING stevedore.named [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 14 16:21:55 devstack cinder-volume[86851]: WARNING castellan.key_manager [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 14 16:21:55 devstack cinder-volume[86851]: WARNING cinder.keymgr.conf_key_mgr [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 14 16:21:55 devstack cinder-volume[86851]: INFO cinder.volume.manager [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] Image-volume cache disabled for host devstack@QuobyteHD.
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_db.sqlalchemy.engines [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86851) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 14 16:21:56 devstack cinder-volume[86851]: INFO oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] Starting 1 workers
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] Started child 87166 {{(pid=86851) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] Full set of CONF: {{(pid=86851) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] ******************************************************************************** {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] Configuration options gathered from: {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] ================================================================================ {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] allow_availability_zone_fallback = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] allow_compression_on_image_upload = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] allowed_direct_url_schemes     = [] {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] api_rate_limit                 = True {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] auth_strategy                  = keystone {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[87166]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_availability_zone      = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_host                   = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_name                   = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_stats_polling_interval = 60 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backup_api_class               = cinder.backup.api.API {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backup_name_template           = backup-%s {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backup_use_same_host           = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backup_use_temp_snapshot       = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] chap_password                  = **** {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] chap_username                  =  {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] cinder_internal_tenant_project_id = cf3b09c69d95444c88eabba304030e30 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] cinder_internal_tenant_user_id = 088138043d294834a037842a1c9d0f70 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] cluster                        = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] compression_format             = gzip {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] compute_api_class              = cinder.compute.nova.API {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] config_dir                     = [] {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] config_source                  = [] {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] control_exchange               = openstack {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] debug                          = True {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] default_availability_zone      = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] default_group_type             = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] default_volume_type            = QuobyteHD {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] disk_geometry                  = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] driver_client_cert             = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] driver_client_cert_key         = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] driver_data_namespace          = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] driver_ssl_cert_path           = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] driver_ssl_cert_verify         = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] driver_use_ssl                 = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] enable_new_services            = True {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] enable_unsupported_driver      = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] enabled_backends               = ['QuobyteHD'] {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] enforce_multipath_for_image_xfer = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] filter_function                = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] glance_api_insecure            = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] glance_api_servers             = ['http://192.168.122.108/image'] {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] glance_api_ssl_compression     = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] glance_ca_certificates_file    = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] glance_catalog_info            = image:glance:publicURL {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] glance_certfile                = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] glance_keyfile                 = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] glance_num_retries             = 3 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] glance_request_timeout         = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] goodness_function              = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] graceful_shutdown_timeout      = 5 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] group_api_class                = cinder.group.api.API {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] host                           = devstack {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] image_compress_on_upload       = True {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] image_conversion_address_space_limit = 1 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] image_conversion_cpu_limit     = 60 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] image_conversion_disable       = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] image_upload_use_cinder_backend = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] image_upload_use_internal_tenant = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] image_volume_cache_enabled     = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] image_volume_cache_max_count   = 0 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] image_volume_cache_max_size_gb = 0 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] init_host_max_objects_retrieval = 0 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] instance_format                = [instance: %(uuid)s]  {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] iscsi_target_flags             =  {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] iscsi_write_cache              = on {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] iser_helper                    = tgtadm {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] iser_ip_address                = 192.168.122.108 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] iser_port                      = 3260 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] log_color                      = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] log_config_append              = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] log_dir                        = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] log_file                       = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] log_options                    = True {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] log_rotate_interval            = 1 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] log_rotate_interval_type       = days {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] log_rotation_type              = none {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-ba8a52b8-ace5-401b-a711-b4719e1efefa None None] Starting volume driver QuobyteDriver (1.1.14)
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-ba8a52b8-ace5-401b-a711-b4719e1efefa None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87166) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] max_age                        = 0 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] max_logfile_count              = 30 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] max_logfile_size_mb            = 200 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] max_over_subscription_ratio    = 20.0 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] message_reap_interval          = 86400 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] message_ttl                    = 2592000 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] migration_create_volume_timeout_secs = 300 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] monkey_patch                   = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] monkey_patch_modules           = [] {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] my_ip                          = 192.168.122.108 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] no_snapshot_gb_quota           = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] num_iser_scan_tries            = 3 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] num_shell_tries                = 3 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] num_volume_device_scan_tries   = 3 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] nvmeof_conn_info_version       = 1 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] nvmet_ns_id                    = 10 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] nvmet_port_id                  = 1 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] osapi_max_limit                = 1000 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] osapi_volume_ext_list          = [] {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] osapi_volume_listen            = 0.0.0.0 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] osapi_volume_listen_port       = 8776 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] osapi_volume_use_ssl           = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] osapi_volume_workers           = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] per_volume_size_limit          = -1 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] periodic_fuzzy_delay           = 60 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] periodic_interval              = 60 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] project_id_regex               = [0-9a-f\-]+ {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] public_endpoint                = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] publish_errors                 = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] quota_backup_gigabytes         = 1000 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] quota_backups                  = 10 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] quota_gigabytes                = 1000 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] quota_groups                   = 10 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] quota_snapshots                = 10 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] quota_volumes                  = 10 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] rate_limit_burst               = 0 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] rate_limit_except_level        = CRITICAL {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] rate_limit_interval            = 0 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] reinit_driver_count            = 3 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] replication_device             = **** {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] report_discard_supported       = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] report_interval                = 120 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] reservation_clean_interval     = 86400 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] reservation_expire             = 86400 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] reserved_image_namespaces      = [] {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] reserved_percentage            = 0 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] rpc_response_timeout           = 120 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] run_external_periodic_tasks    = True {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] scst_target_driver             = iscsi {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] scst_target_iqn_name           = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] service_down_time              = 720 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] shell_completion               = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] snapshot_name_template         = snapshot-%s {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] split_loggers                  = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] state_path                     = /opt/stack/data/cinder {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] storage_availability_zone      = nova {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] storage_protocol               = iSCSI {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] syslog_log_facility            = LOG_USER {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] target_helper                  = lioadm {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] target_ip_address              = 192.168.122.108 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] target_port                    = 3260 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] target_protocol                = iscsi {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] target_secondary_ip_addresses  = [] {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] trace_flags                    = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] transfer_api_class             = cinder.transfer.api.API {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] transport_url                  = **** {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] until_refresh                  = 0 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] use_chap_auth                  = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] use_default_quota_class        = True {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] use_journal                    = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] use_json                       = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] use_multipath_for_image_xfer   = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] use_stderr                     = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] use_syslog                     = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] verify_glance_signatures       = enabled {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] volume_api_class               = cinder.volume.api.API {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] volume_backend_name            = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] volume_clear                   = zero {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] volume_clear_ionice            = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] volume_clear_size              = 0 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] volume_copy_bps_limit          = 0 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] volume_dd_blocksize            = 1M {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] volume_name_template           = volume-%s {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] volume_service_inithost_offload = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] volume_usage_audit_period      = month {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] zoning_mode                    = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] oslo_concurrency.disable_process_locking = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] keystone_authtoken.auth_section = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] keystone_authtoken.auth_type   = password {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] keystone_authtoken.auth_version = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] keystone_authtoken.cache       = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] keystone_authtoken.certfile    = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] keystone_authtoken.delay_auth_decision = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] keystone_authtoken.http_connect_timeout = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] keystone_authtoken.include_service_catalog = True {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] keystone_authtoken.insecure    = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] keystone_authtoken.interface   = public {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] keystone_authtoken.keyfile     = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] keystone_authtoken.memcache_password =  {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] keystone_authtoken.memcache_username =  {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] keystone_authtoken.region_name = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] keystone_authtoken.service_token_roles_required = True {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] keystone_authtoken.service_type = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] keystone_authtoken.token_cache_time = 300 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.108/identity {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] cache.backend                  = dogpile.cache.null {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] cache.backend_argument         = **** {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] cache.backend_expiration_time  = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] cache.config_prefix            = cache.oslo {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] cache.debug_cache_backend      = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] cache.enable_retry_client      = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] cache.enable_socket_keepalive  = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] cache.enabled                  = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] cache.expiration_time          = 600 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] cache.hashclient_retry_attempts = 2 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] cache.memcache_dead_retry      = 300 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] cache.memcache_pool_maxsize    = 10 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] cache.memcache_sasl_enabled    = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] cache.password                 = **** {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] cache.proxies                  = [] {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] cache.redis_db                 = 0 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] cache.redis_sentinel_service_name = mymaster {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] cache.redis_server             = localhost:6379 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] cache.retry_attempts           = 2 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] cache.retry_delay              = 0.0 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] cache.socket_keepalive_count   = 1 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] cache.socket_keepalive_idle    = 1 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] cache.socket_keepalive_interval = 1 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] cache.socket_timeout           = 1.0 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] cache.tls_allowed_ciphers      = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] cache.tls_cafile               = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] cache.tls_certfile             = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] cache.tls_enabled              = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] cache.tls_keyfile              = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] cache.username                 = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] coordination.backend_url       = **** {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] database.asyncio_connection    = **** {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] database.asyncio_slave_connection = **** {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] database.backend               = sqlalchemy {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] database.connection            = **** {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] database.connection_debug      = 0 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] database.connection_parameters =  {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ba8a52b8-ace5-401b-a711-b4719e1efefa None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87166) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Jul 14 16:21:56 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.quobyte [None req-ba8a52b8-ace5-401b-a711-b4719e1efefa None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Jul 14 16:21:56 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.quobyte [None req-ba8a52b8-ace5-401b-a711-b4719e1efefa None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] database.connection_recycle_time = 3600 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] database.connection_trace      = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] database.db_inc_retry_interval = True {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] database.db_max_retries        = 20 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ba8a52b8-ace5-401b-a711-b4719e1efefa None None] Running cmd (subprocess): mount.quobyte {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] database.db_max_retry_interval = 10 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] database.db_retry_interval     = 1 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] database.max_overflow          = 50 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] database.max_pool_size         = 5 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] database.max_retries           = 10 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] database.mysql_wsrep_sync_wait = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] database.pool_timeout          = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] database.retry_interval        = 10 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] database.slave_connection      = **** {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] database.sqlite_synchronous    = True {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] database.synchronous_reader    = True {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] database.use_db_reconnect      = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] profiler.connection_string     = messaging:// {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] profiler.enabled               = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] profiler.es_doc_type           = notification {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] profiler.es_scroll_size        = 10000 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] profiler.es_scroll_time        = 2m {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] profiler.filter_error_trace    = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] profiler.hmac_keys             = **** {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] profiler.sentinel_service_name = mymaster {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] profiler.socket_timeout        = 0.1 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] profiler.trace_requests        = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] profiler.trace_sqlalchemy      = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] profiler_jaeger.process_tags   = {} {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] profiler_jaeger.service_name_prefix = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] profiler_otlp.service_name_prefix = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] oslo_policy.enforce_new_defaults = True {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] oslo_policy.enforce_scope      = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] oslo_policy.policy_default_rule = default {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] oslo_policy.policy_file        = policy.yaml {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] oslo_policy.remote_timeout     = 60.0 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] privsep_osbrick.group          = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] privsep_osbrick.helper_command = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] privsep_osbrick.user           = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] cinder_sys_admin.group         = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] cinder_sys_admin.helper_command = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] cinder_sys_admin.user          = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] service_user.auth_section      = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] service_user.auth_type         = password {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] service_user.cafile            = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] service_user.certfile          = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] service_user.collect_timing    = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] service_user.insecure          = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] service_user.keyfile           = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] service_user.send_service_user_token = True {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] service_user.split_loggers     = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] service_user.timeout           = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] glance.auth_section            = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] glance.auth_type               = password {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] glance.certfile                = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] glance.collect_timing          = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] glance.insecure                = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] glance.keyfile                 = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] glance.region_name             = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] glance.split_loggers           = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] glance.timeout                 = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_defaults.backend_availability_zone = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_defaults.chap_password = **** {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_defaults.chap_username =  {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_defaults.disk_geometry = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_defaults.driver_client_cert = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_defaults.driver_client_cert_key = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_defaults.driver_data_namespace = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_defaults.driver_use_ssl = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_defaults.enable_unsupported_driver = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_defaults.extra_capabilities = {} {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_defaults.filter_function = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_defaults.goodness_function = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_defaults.iscsi_target_flags =  {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_defaults.iscsi_write_cache = on {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_defaults.iser_helper   = tgtadm {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_defaults.iser_ip_address = 192.168.122.108 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_defaults.iser_port     = 3260 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack quobyte-client[87167]: Reading configuration file: /etc/quobyte/client.cfg
Jul 14 16:21:56 devstack quobyte-client[87167]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_defaults.nas_host      =  {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_defaults.nas_login     = admin {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ba8a52b8-ace5-401b-a711-b4719e1efefa None None] CMD "mount.quobyte" returned: 1 in 0.059s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:21:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ba8a52b8-ace5-401b-a711-b4719e1efefa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:21:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ba8a52b8-ace5-401b-a711-b4719e1efefa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_defaults.nas_mount_options = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ba8a52b8-ace5-401b-a711-b4719e1efefa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_defaults.nas_password  = **** {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_defaults.nas_private_key =  {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_defaults.nas_share_path =  {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_defaults.nas_ssh_port  = 22 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_defaults.num_shell_tries = 3 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_defaults.nvmet_port_id = 1 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_defaults.quobyte_client_cfg = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_defaults.quobyte_volume_url = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_defaults.replication_device = **** {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_defaults.report_discard_supported = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_defaults.reserved_percentage = 0 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_defaults.scst_target_driver = iscsi {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_defaults.scst_target_iqn_name = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_defaults.storage_protocol = iSCSI {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ba8a52b8-ace5-401b-a711-b4719e1efefa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ba8a52b8-ace5-401b-a711-b4719e1efefa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_defaults.target_helper = tgtadm {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ba8a52b8-ace5-401b-a711-b4719e1efefa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_defaults.target_ip_address = 192.168.122.108 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_defaults.target_port   = 3260 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_defaults.target_protocol = iscsi {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_defaults.trace_flags   = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_defaults.unique_fqdn_network = True {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_defaults.use_chap_auth = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_defaults.volume_backend_name = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_defaults.volume_clear  = zero {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_defaults.volume_clear_ionice = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_defaults.volume_clear_size = 0 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] oslo_reports.file_event_handler = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] oslo_reports.log_dir           = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] QuobyteHD.backend_availability_zone = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] QuobyteHD.backend_host         = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] QuobyteHD.chap_password        = **** {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] QuobyteHD.chap_username        = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] QuobyteHD.chiscsi_conf         = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] QuobyteHD.disk_geometry        = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] QuobyteHD.driver_client_cert   = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] QuobyteHD.driver_client_cert_key = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] QuobyteHD.driver_data_namespace = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] QuobyteHD.driver_use_ssl       = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] QuobyteHD.extra_capabilities   = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] QuobyteHD.filter_function      = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] QuobyteHD.goodness_function    = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] QuobyteHD.iscsi_target_flags   = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] QuobyteHD.iscsi_write_cache    = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] QuobyteHD.iser_helper          = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] QuobyteHD.iser_ip_address      = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] QuobyteHD.iser_port            = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] QuobyteHD.iser_target_prefix   = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] QuobyteHD.nas_host             = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] QuobyteHD.nas_login            = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] QuobyteHD.nas_mount_options    = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] QuobyteHD.nas_password         = **** {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] QuobyteHD.nas_private_key      = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] QuobyteHD.nas_share_path       = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] QuobyteHD.nas_ssh_port         = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] QuobyteHD.num_shell_tries      = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] QuobyteHD.nvmet_ns_id          = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] QuobyteHD.nvmet_port_id        = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] QuobyteHD.replication_device   = **** {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] QuobyteHD.report_discard_supported = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] QuobyteHD.reserved_percentage  = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] QuobyteHD.scst_target_driver   = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] QuobyteHD.storage_protocol     = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] QuobyteHD.target_helper        = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] QuobyteHD.target_ip_address    = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] QuobyteHD.target_port          = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] QuobyteHD.target_prefix        = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] QuobyteHD.target_protocol      = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] QuobyteHD.trace_flags          = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] QuobyteHD.unique_fqdn_network  = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] QuobyteHD.use_chap_auth        = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] QuobyteHD.volume_clear         = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] QuobyteHD.volume_clear_ionice  = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] QuobyteHD.volume_clear_size    = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] QuobyteHD.volumes_dir          = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack sudo[87168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack sudo[87168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] oslo_messaging_rabbit.ssl      = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] oslo_messaging_rabbit.ssl_version =  {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] oslo_messaging_notifications.driver = [] {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] oslo_messaging_notifications.retry = -1 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] oslo_messaging_notifications.transport_url = **** {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] key_manager.fixed_key          = **** {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] barbican.barbican_api_version  = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] barbican.barbican_endpoint     = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] barbican.barbican_endpoint_type = public {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] barbican.barbican_region_name  = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] barbican.cafile                = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] barbican.certfile              = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] barbican.collect_timing        = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] barbican.insecure              = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] barbican.keyfile               = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] barbican.number_of_retries     = 60 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] barbican.retry_delay           = 1 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] barbican.send_service_user_token = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] barbican.split_loggers         = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] barbican.timeout               = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] barbican.verify_ssl            = True {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] barbican.verify_ssl_path       = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] barbican_service_user.auth_section = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] barbican_service_user.auth_type = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] barbican_service_user.cafile   = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] barbican_service_user.certfile = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] barbican_service_user.collect_timing = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] barbican_service_user.insecure = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] barbican_service_user.keyfile  = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] barbican_service_user.split_loggers = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] barbican_service_user.timeout  = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] vault.approle_role_id          = **** {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] vault.approle_secret_id        = **** {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] vault.auth_method              = approle {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] vault.auth_path                = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] vault.kv_mountpoint            = secret {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] vault.kv_path                  = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] vault.kv_version               = 2 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] vault.namespace                = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] vault.root_token_id            = **** {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] vault.ssl_ca_crt_file          = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] vault.timeout                  = 60.0 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] vault.token_file               = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] vault.token_role               = None {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] vault.use_ssl                  = False {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 14 16:21:56 devstack cinder-volume[86851]: DEBUG oslo_service.backend._eventlet.service [None req-37012587-8e8b-4541-a7a0-15814766e4ca None None] ******************************************************************************** {{(pid=86851) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jul 14 16:21:56 devstack sudo[87168]: pam_unix(sudo:session): session closed for user root
Jul 14 16:21:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ba8a52b8-ace5-401b-a711-b4719e1efefa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.286s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:21:56 devstack cinder-volume[87166]: INFO cinder.volume.driver [None req-ba8a52b8-ace5-401b-a711-b4719e1efefa None None] Driver hasn't implemented _init_vendor_properties()
Jul 14 16:21:56 devstack cinder-volume[87166]: DEBUG cinder.volume.driver [None req-ba8a52b8-ace5-401b-a711-b4719e1efefa None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6650619506836, 'free_capacity_gb': 1775.6650619506836, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87166) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jul 14 16:21:56 devstack cinder-volume[87166]: DEBUG oslo_db.sqlalchemy.engines [None req-ba8a52b8-ace5-401b-a711-b4719e1efefa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87166) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 14 16:21:56 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writer thread running {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 14 16:21:56 devstack cinder-volume[87166]: DEBUG cinder.db.api [None req-ba8a52b8-ace5-401b-a711-b4719e1efefa None None] Building query based on filter {{(pid=87166) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jul 14 16:21:56 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-ba8a52b8-ace5-401b-a711-b4719e1efefa None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87166) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jul 14 16:21:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ba8a52b8-ace5-401b-a711-b4719e1efefa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:21:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ba8a52b8-ace5-401b-a711-b4719e1efefa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:21:56 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ba8a52b8-ace5-401b-a711-b4719e1efefa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:21:56 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ba8a52b8-ace5-401b-a711-b4719e1efefa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:21:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ba8a52b8-ace5-401b-a711-b4719e1efefa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:21:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ba8a52b8-ace5-401b-a711-b4719e1efefa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:21:56 devstack cinder-volume[87166]: INFO cinder.keymgr.migration [None req-abb147b5-6cdf-48b8-9983-b8bc2a0b303c None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jul 14 16:21:56 devstack sudo[87173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:21:56 devstack sudo[87173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:21:57 devstack sudo[87173]: pam_unix(sudo:session): session closed for user root
Jul 14 16:21:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ba8a52b8-ace5-401b-a711-b4719e1efefa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.249s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:21:57 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-ba8a52b8-ace5-401b-a711-b4719e1efefa None None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:21:57 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-ba8a52b8-ace5-401b-a711-b4719e1efefa None None] Driver initialization completed successfully.
Jul 14 16:21:57 devstack cinder-volume[87166]: INFO cinder.manager [None req-ba8a52b8-ace5-401b-a711-b4719e1efefa None None] Initiating service 3 cleanup
Jul 14 16:21:57 devstack cinder-volume[87166]: INFO cinder.manager [None req-ba8a52b8-ace5-401b-a711-b4719e1efefa None None] Service 3 cleanup completed.
Jul 14 16:21:57 devstack cinder-volume[87166]: DEBUG cinder.service [None req-ba8a52b8-ace5-401b-a711-b4719e1efefa None None] Creating RPC server for service cinder-volume {{(pid=87166) start /opt/stack/cinder/cinder/service.py:231}}
Jul 14 16:21:57 devstack cinder-volume[87166]: DEBUG cinder.service [None req-ba8a52b8-ace5-401b-a711-b4719e1efefa None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87166) start /opt/stack/cinder/cinder/service.py:237}}
Jul 14 16:21:57 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-ba8a52b8-ace5-401b-a711-b4719e1efefa None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Jul 14 16:21:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ba8a52b8-ace5-401b-a711-b4719e1efefa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:21:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ba8a52b8-ace5-401b-a711-b4719e1efefa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:21:57 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ba8a52b8-ace5-401b-a711-b4719e1efefa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:21:57 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ba8a52b8-ace5-401b-a711-b4719e1efefa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:21:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ba8a52b8-ace5-401b-a711-b4719e1efefa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:21:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ba8a52b8-ace5-401b-a711-b4719e1efefa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:21:57 devstack sudo[87176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:21:57 devstack sudo[87176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:21:57 devstack sudo[87176]: pam_unix(sudo:session): session closed for user root
Jul 14 16:21:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ba8a52b8-ace5-401b-a711-b4719e1efefa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.230s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:21:57 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-ba8a52b8-ace5-401b-a711-b4719e1efefa None None] Driver post RPC initialization completed successfully.
Jul 14 16:22:06 devstack cinder-volume[86851]: DEBUG dbcounter [-] [86851] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86851) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 16:22:07 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:SELECT=2 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 16:22:07 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 16:22:35 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Running periodic task VolumeManager._thread_info {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 16:22:35 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] thread count: 6 {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 14 16:22:35 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] thread info: [<_MainThread(MainThread, started 128606490927232)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128606415432960)>, <Thread(Thread-3 (stat_writer), started daemon 128606378859328)>, <Thread(Rabbit-heartbeat, started daemon 128606379646144)>, <Thread(Thread-5 (_runner), started daemon 128606377685824)>, <Thread(Thread-7 (_runner), started daemon 128606377701888)>] {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 14 16:22:55 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-3087f262-816c-47cd-89e9-d621e0de00be tempest-VolumesTestJSON-1942998715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:22:55 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3087f262-816c-47cd-89e9-d621e0de00be tempest-VolumesTestJSON-1942998715 None] Flow 'volume_create_manager' (8f87ed54-020e-48f0-88db-7d9ca90aa923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:22:55 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3087f262-816c-47cd-89e9-d621e0de00be tempest-VolumesTestJSON-1942998715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86a6c8ff-6b95-4632-b4a2-7d440cd1ddfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:22:55 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3087f262-816c-47cd-89e9-d621e0de00be tempest-VolumesTestJSON-1942998715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86a6c8ff-6b95-4632-b4a2-7d440cd1ddfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-490965783',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1136b6b-5f5c-43d0-a0ef-dc22d58c69b2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c668cd3347344d0586ccc80cda318585',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:22:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:22:56Z,use_quota=True,user_id='8309e63ef9a1481ca902049305813b39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:22:55 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3087f262-816c-47cd-89e9-d621e0de00be tempest-VolumesTestJSON-1942998715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c60a74c-9799-4426-8b02-0d4d37624d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:22:55 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3087f262-816c-47cd-89e9-d621e0de00be tempest-VolumesTestJSON-1942998715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c60a74c-9799-4426-8b02-0d4d37624d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:22:55 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3087f262-816c-47cd-89e9-d621e0de00be tempest-VolumesTestJSON-1942998715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36c8c85b-8922-4df7-b095-39d9d5ed61d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:22:55 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3087f262-816c-47cd-89e9-d621e0de00be tempest-VolumesTestJSON-1942998715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36c8c85b-8922-4df7-b095-39d9d5ed61d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1136b6b-5f5c-43d0-a0ef-dc22d58c69b2', 'volume_name': 'volume-b1136b6b-5f5c-43d0-a0ef-dc22d58c69b2', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:22:55 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3087f262-816c-47cd-89e9-d621e0de00be tempest-VolumesTestJSON-1942998715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e53a24f-bc42-4e43-8819-fd82155ee041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:22:55 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3087f262-816c-47cd-89e9-d621e0de00be tempest-VolumesTestJSON-1942998715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e53a24f-bc42-4e43-8819-fd82155ee041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:22:55 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3087f262-816c-47cd-89e9-d621e0de00be tempest-VolumesTestJSON-1942998715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61dddfde-1a4e-4c20-a0fa-107e2a183d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:22:55 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-3087f262-816c-47cd-89e9-d621e0de00be tempest-VolumesTestJSON-1942998715 None] Volume b1136b6b-5f5c-43d0-a0ef-dc22d58c69b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1136b6b-5f5c-43d0-a0ef-dc22d58c69b2', 'volume_size': 1}
Jul 14 16:22:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3087f262-816c-47cd-89e9-d621e0de00be tempest-VolumesTestJSON-1942998715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:22:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3087f262-816c-47cd-89e9-d621e0de00be tempest-VolumesTestJSON-1942998715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:22:55 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-3087f262-816c-47cd-89e9-d621e0de00be tempest-VolumesTestJSON-1942998715 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-490965783',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1136b6b-5f5c-43d0-a0ef-dc22d58c69b2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c668cd3347344d0586ccc80cda318585',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:22:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:22:56Z,use_quota=True,user_id='8309e63ef9a1481ca902049305813b39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:22:55 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-3087f262-816c-47cd-89e9-d621e0de00be tempest-VolumesTestJSON-1942998715 None] Creating volume b1136b6b-5f5c-43d0-a0ef-dc22d58c69b2 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:22:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3087f262-816c-47cd-89e9-d621e0de00be tempest-VolumesTestJSON-1942998715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:22:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3087f262-816c-47cd-89e9-d621e0de00be tempest-VolumesTestJSON-1942998715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:22:55 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-3087f262-816c-47cd-89e9-d621e0de00be tempest-VolumesTestJSON-1942998715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:22:55 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-3087f262-816c-47cd-89e9-d621e0de00be tempest-VolumesTestJSON-1942998715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:22:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3087f262-816c-47cd-89e9-d621e0de00be tempest-VolumesTestJSON-1942998715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:22:55 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-3087f262-816c-47cd-89e9-d621e0de00be tempest-VolumesTestJSON-1942998715 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:22:55 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-3087f262-816c-47cd-89e9-d621e0de00be tempest-VolumesTestJSON-1942998715 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:22:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3087f262-816c-47cd-89e9-d621e0de00be tempest-VolumesTestJSON-1942998715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1136b6b-5f5c-43d0-a0ef-dc22d58c69b2 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:22:55 devstack sudo[87383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1136b6b-5f5c-43d0-a0ef-dc22d58c69b2 1073741824
Jul 14 16:22:55 devstack sudo[87383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:22:56 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7b3bd70-e1db-43e8-8719-13b732ba9d0a tempest-TaggedAttachmentsTest-77102883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:22:56 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c7b3bd70-e1db-43e8-8719-13b732ba9d0a tempest-TaggedAttachmentsTest-77102883 None] Flow 'volume_create_manager' (61ac1262-968a-4c57-911e-f602a4180a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:22:56 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c7b3bd70-e1db-43e8-8719-13b732ba9d0a tempest-TaggedAttachmentsTest-77102883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d0e7876-1e73-454c-8ff2-40cbf7642df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:22:56 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c7b3bd70-e1db-43e8-8719-13b732ba9d0a tempest-TaggedAttachmentsTest-77102883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d0e7876-1e73-454c-8ff2-40cbf7642df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:22:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-435225797',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=035a2faf-7d96-4f01-b964-2db415638fbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be03ef573478445889187f93c141741c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:22:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:22:56Z,use_quota=True,user_id='b5bf5ecf5bbf47af81e6920754c034c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:22:56 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c7b3bd70-e1db-43e8-8719-13b732ba9d0a tempest-TaggedAttachmentsTest-77102883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe7d012c-76a3-45af-bd72-ebc67279af5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:22:56 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c7b3bd70-e1db-43e8-8719-13b732ba9d0a tempest-TaggedAttachmentsTest-77102883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe7d012c-76a3-45af-bd72-ebc67279af5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:22:56 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c7b3bd70-e1db-43e8-8719-13b732ba9d0a tempest-TaggedAttachmentsTest-77102883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96066840-9d0c-4dc1-addb-03808b9a3098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:22:56 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c7b3bd70-e1db-43e8-8719-13b732ba9d0a tempest-TaggedAttachmentsTest-77102883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96066840-9d0c-4dc1-addb-03808b9a3098) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '035a2faf-7d96-4f01-b964-2db415638fbf', 'volume_name': 'volume-035a2faf-7d96-4f01-b964-2db415638fbf', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:22:56 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c7b3bd70-e1db-43e8-8719-13b732ba9d0a tempest-TaggedAttachmentsTest-77102883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15d5c0cb-c20c-4ed7-8590-4e7a05f379f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:22:56 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c7b3bd70-e1db-43e8-8719-13b732ba9d0a tempest-TaggedAttachmentsTest-77102883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15d5c0cb-c20c-4ed7-8590-4e7a05f379f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:22:56 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c7b3bd70-e1db-43e8-8719-13b732ba9d0a tempest-TaggedAttachmentsTest-77102883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4404a842-bb2f-431d-ba98-1be166146bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:22:56 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-c7b3bd70-e1db-43e8-8719-13b732ba9d0a tempest-TaggedAttachmentsTest-77102883 None] Volume 035a2faf-7d96-4f01-b964-2db415638fbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-035a2faf-7d96-4f01-b964-2db415638fbf', 'volume_size': 1}
Jul 14 16:22:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c7b3bd70-e1db-43e8-8719-13b732ba9d0a tempest-TaggedAttachmentsTest-77102883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:22:56 devstack sudo[87383]: pam_unix(sudo:session): session closed for user root
Jul 14 16:22:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3087f262-816c-47cd-89e9-d621e0de00be tempest-VolumesTestJSON-1942998715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1136b6b-5f5c-43d0-a0ef-dc22d58c69b2 1073741824" returned: 0 in 0.706s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:22:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3087f262-816c-47cd-89e9-d621e0de00be tempest-VolumesTestJSON-1942998715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1136b6b-5f5c-43d0-a0ef-dc22d58c69b2 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:22:56 devstack sudo[87708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1136b6b-5f5c-43d0-a0ef-dc22d58c69b2
Jul 14 16:22:56 devstack sudo[87708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:22:57 devstack sudo[87708]: pam_unix(sudo:session): session closed for user root
Jul 14 16:22:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3087f262-816c-47cd-89e9-d621e0de00be tempest-VolumesTestJSON-1942998715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1136b6b-5f5c-43d0-a0ef-dc22d58c69b2" returned: 0 in 0.286s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:22:57 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-3087f262-816c-47cd-89e9-d621e0de00be tempest-VolumesTestJSON-1942998715 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:22:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3087f262-816c-47cd-89e9-d621e0de00be tempest-VolumesTestJSON-1942998715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:22:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c7b3bd70-e1db-43e8-8719-13b732ba9d0a tempest-TaggedAttachmentsTest-77102883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.930s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:22:57 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-c7b3bd70-e1db-43e8-8719-13b732ba9d0a tempest-TaggedAttachmentsTest-77102883 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:22:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-435225797',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=035a2faf-7d96-4f01-b964-2db415638fbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be03ef573478445889187f93c141741c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:22:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:22:56Z,use_quota=True,user_id='b5bf5ecf5bbf47af81e6920754c034c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:22:57 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-c7b3bd70-e1db-43e8-8719-13b732ba9d0a tempest-TaggedAttachmentsTest-77102883 None] Creating volume 035a2faf-7d96-4f01-b964-2db415638fbf {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:22:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c7b3bd70-e1db-43e8-8719-13b732ba9d0a tempest-TaggedAttachmentsTest-77102883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:22:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c7b3bd70-e1db-43e8-8719-13b732ba9d0a tempest-TaggedAttachmentsTest-77102883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:22:57 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-c7b3bd70-e1db-43e8-8719-13b732ba9d0a tempest-TaggedAttachmentsTest-77102883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:22:57 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-c7b3bd70-e1db-43e8-8719-13b732ba9d0a tempest-TaggedAttachmentsTest-77102883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:22:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c7b3bd70-e1db-43e8-8719-13b732ba9d0a tempest-TaggedAttachmentsTest-77102883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:22:57 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-c7b3bd70-e1db-43e8-8719-13b732ba9d0a tempest-TaggedAttachmentsTest-77102883 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:22:57 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-c7b3bd70-e1db-43e8-8719-13b732ba9d0a tempest-TaggedAttachmentsTest-77102883 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:22:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c7b3bd70-e1db-43e8-8719-13b732ba9d0a tempest-TaggedAttachmentsTest-77102883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-035a2faf-7d96-4f01-b964-2db415638fbf 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:22:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3087f262-816c-47cd-89e9-d621e0de00be tempest-VolumesTestJSON-1942998715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61dddfde-1a4e-4c20-a0fa-107e2a183d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1136b6b-5f5c-43d0-a0ef-dc22d58c69b2', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:22:57 devstack sudo[87714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-035a2faf-7d96-4f01-b964-2db415638fbf 1073741824
Jul 14 16:22:57 devstack sudo[87714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:22:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3087f262-816c-47cd-89e9-d621e0de00be tempest-VolumesTestJSON-1942998715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6b338ae-b6b5-487c-ad94-38f59e44ad4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:22:57 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-3087f262-816c-47cd-89e9-d621e0de00be tempest-VolumesTestJSON-1942998715 None] Volume volume-b1136b6b-5f5c-43d0-a0ef-dc22d58c69b2 (b1136b6b-5f5c-43d0-a0ef-dc22d58c69b2): created successfully
Jul 14 16:22:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3087f262-816c-47cd-89e9-d621e0de00be tempest-VolumesTestJSON-1942998715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6b338ae-b6b5-487c-ad94-38f59e44ad4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:22:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3087f262-816c-47cd-89e9-d621e0de00be tempest-VolumesTestJSON-1942998715 None] Flow 'volume_create_manager' (8f87ed54-020e-48f0-88db-7d9ca90aa923) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:22:57 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-3087f262-816c-47cd-89e9-d621e0de00be tempest-VolumesTestJSON-1942998715 None] Created volume successfully.
Jul 14 16:22:57 devstack sudo[87714]: pam_unix(sudo:session): session closed for user root
Jul 14 16:22:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c7b3bd70-e1db-43e8-8719-13b732ba9d0a tempest-TaggedAttachmentsTest-77102883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-035a2faf-7d96-4f01-b964-2db415638fbf 1073741824" returned: 0 in 0.498s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:22:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c7b3bd70-e1db-43e8-8719-13b732ba9d0a tempest-TaggedAttachmentsTest-77102883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-035a2faf-7d96-4f01-b964-2db415638fbf {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:22:57 devstack sudo[87724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-035a2faf-7d96-4f01-b964-2db415638fbf
Jul 14 16:22:57 devstack sudo[87724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:22:57 devstack sudo[87724]: pam_unix(sudo:session): session closed for user root
Jul 14 16:22:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c7b3bd70-e1db-43e8-8719-13b732ba9d0a tempest-TaggedAttachmentsTest-77102883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-035a2faf-7d96-4f01-b964-2db415638fbf" returned: 0 in 0.298s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:22:57 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-c7b3bd70-e1db-43e8-8719-13b732ba9d0a tempest-TaggedAttachmentsTest-77102883 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:22:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c7b3bd70-e1db-43e8-8719-13b732ba9d0a tempest-TaggedAttachmentsTest-77102883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:22:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c7b3bd70-e1db-43e8-8719-13b732ba9d0a tempest-TaggedAttachmentsTest-77102883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4404a842-bb2f-431d-ba98-1be166146bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-035a2faf-7d96-4f01-b964-2db415638fbf', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:22:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c7b3bd70-e1db-43e8-8719-13b732ba9d0a tempest-TaggedAttachmentsTest-77102883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a7cead6-3b23-4162-b849-4742fe565a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:22:57 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-c7b3bd70-e1db-43e8-8719-13b732ba9d0a tempest-TaggedAttachmentsTest-77102883 None] Volume volume-035a2faf-7d96-4f01-b964-2db415638fbf (035a2faf-7d96-4f01-b964-2db415638fbf): created successfully
Jul 14 16:22:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c7b3bd70-e1db-43e8-8719-13b732ba9d0a tempest-TaggedAttachmentsTest-77102883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a7cead6-3b23-4162-b849-4742fe565a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:22:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c7b3bd70-e1db-43e8-8719-13b732ba9d0a tempest-TaggedAttachmentsTest-77102883 None] Flow 'volume_create_manager' (61ac1262-968a-4c57-911e-f602a4180a5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:22:57 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-c7b3bd70-e1db-43e8-8719-13b732ba9d0a tempest-TaggedAttachmentsTest-77102883 None] Created volume successfully.
Jul 14 16:22:58 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e9853fc-e2a4-4b00-a078-3d7e517094d4 tempest-VolumesTestJSON-1942998715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:22:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4e9853fc-e2a4-4b00-a078-3d7e517094d4 tempest-VolumesTestJSON-1942998715 None] Flow 'volume_create_manager' (1d0e28cb-37fa-4e51-ae0e-28751d645ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:22:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4e9853fc-e2a4-4b00-a078-3d7e517094d4 tempest-VolumesTestJSON-1942998715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa3ea1b3-ad59-4d3c-9fb1-8cb95806d162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:22:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4e9853fc-e2a4-4b00-a078-3d7e517094d4 tempest-VolumesTestJSON-1942998715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa3ea1b3-ad59-4d3c-9fb1-8cb95806d162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:22:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1841966446',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4893a0cc-8ad0-4c90-a0f1-9f88742487d8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c668cd3347344d0586ccc80cda318585',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:22:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:22:59Z,use_quota=True,user_id='8309e63ef9a1481ca902049305813b39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:22:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4e9853fc-e2a4-4b00-a078-3d7e517094d4 tempest-VolumesTestJSON-1942998715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e74eb4f-c151-4304-b8b8-19c6c77d74e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:22:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4e9853fc-e2a4-4b00-a078-3d7e517094d4 tempest-VolumesTestJSON-1942998715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e74eb4f-c151-4304-b8b8-19c6c77d74e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:22:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4e9853fc-e2a4-4b00-a078-3d7e517094d4 tempest-VolumesTestJSON-1942998715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fa53e48-be06-458f-92d7-aeaa940d879b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:22:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4e9853fc-e2a4-4b00-a078-3d7e517094d4 tempest-VolumesTestJSON-1942998715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fa53e48-be06-458f-92d7-aeaa940d879b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4893a0cc-8ad0-4c90-a0f1-9f88742487d8', 'volume_name': 'volume-4893a0cc-8ad0-4c90-a0f1-9f88742487d8', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:22:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4e9853fc-e2a4-4b00-a078-3d7e517094d4 tempest-VolumesTestJSON-1942998715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b758e48d-f50f-4043-94a1-a43bc54cdf5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:22:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4e9853fc-e2a4-4b00-a078-3d7e517094d4 tempest-VolumesTestJSON-1942998715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b758e48d-f50f-4043-94a1-a43bc54cdf5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:22:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4e9853fc-e2a4-4b00-a078-3d7e517094d4 tempest-VolumesTestJSON-1942998715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0731c8c-20cd-4f92-9f9c-bf815c13558a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:22:59 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-4e9853fc-e2a4-4b00-a078-3d7e517094d4 tempest-VolumesTestJSON-1942998715 None] Volume 4893a0cc-8ad0-4c90-a0f1-9f88742487d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4893a0cc-8ad0-4c90-a0f1-9f88742487d8', 'volume_size': 1}
Jul 14 16:22:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-4e9853fc-e2a4-4b00-a078-3d7e517094d4 tempest-VolumesTestJSON-1942998715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:22:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-4e9853fc-e2a4-4b00-a078-3d7e517094d4 tempest-VolumesTestJSON-1942998715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:22:59 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-4e9853fc-e2a4-4b00-a078-3d7e517094d4 tempest-VolumesTestJSON-1942998715 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:22:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1841966446',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4893a0cc-8ad0-4c90-a0f1-9f88742487d8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c668cd3347344d0586ccc80cda318585',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:22:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:22:59Z,use_quota=True,user_id='8309e63ef9a1481ca902049305813b39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:22:59 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-4e9853fc-e2a4-4b00-a078-3d7e517094d4 tempest-VolumesTestJSON-1942998715 None] Creating volume 4893a0cc-8ad0-4c90-a0f1-9f88742487d8 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:22:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-4e9853fc-e2a4-4b00-a078-3d7e517094d4 tempest-VolumesTestJSON-1942998715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:22:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-4e9853fc-e2a4-4b00-a078-3d7e517094d4 tempest-VolumesTestJSON-1942998715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:22:59 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-4e9853fc-e2a4-4b00-a078-3d7e517094d4 tempest-VolumesTestJSON-1942998715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:22:59 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-4e9853fc-e2a4-4b00-a078-3d7e517094d4 tempest-VolumesTestJSON-1942998715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:22:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-4e9853fc-e2a4-4b00-a078-3d7e517094d4 tempest-VolumesTestJSON-1942998715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:22:59 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-4e9853fc-e2a4-4b00-a078-3d7e517094d4 tempest-VolumesTestJSON-1942998715 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:22:59 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-4e9853fc-e2a4-4b00-a078-3d7e517094d4 tempest-VolumesTestJSON-1942998715 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:22:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4e9853fc-e2a4-4b00-a078-3d7e517094d4 tempest-VolumesTestJSON-1942998715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4893a0cc-8ad0-4c90-a0f1-9f88742487d8 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:22:59 devstack sudo[87779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4893a0cc-8ad0-4c90-a0f1-9f88742487d8 1073741824
Jul 14 16:22:59 devstack sudo[87779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:23:00 devstack sudo[87779]: pam_unix(sudo:session): session closed for user root
Jul 14 16:23:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4e9853fc-e2a4-4b00-a078-3d7e517094d4 tempest-VolumesTestJSON-1942998715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4893a0cc-8ad0-4c90-a0f1-9f88742487d8 1073741824" returned: 0 in 1.115s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:23:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4e9853fc-e2a4-4b00-a078-3d7e517094d4 tempest-VolumesTestJSON-1942998715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4893a0cc-8ad0-4c90-a0f1-9f88742487d8 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:23:00 devstack sudo[87800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4893a0cc-8ad0-4c90-a0f1-9f88742487d8
Jul 14 16:23:00 devstack sudo[87800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:23:00 devstack sudo[87800]: pam_unix(sudo:session): session closed for user root
Jul 14 16:23:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4e9853fc-e2a4-4b00-a078-3d7e517094d4 tempest-VolumesTestJSON-1942998715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4893a0cc-8ad0-4c90-a0f1-9f88742487d8" returned: 0 in 0.417s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:23:00 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-4e9853fc-e2a4-4b00-a078-3d7e517094d4 tempest-VolumesTestJSON-1942998715 None] <== create_volume: return (1668ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:23:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-4e9853fc-e2a4-4b00-a078-3d7e517094d4 tempest-VolumesTestJSON-1942998715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.672s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:23:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4e9853fc-e2a4-4b00-a078-3d7e517094d4 tempest-VolumesTestJSON-1942998715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0731c8c-20cd-4f92-9f9c-bf815c13558a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4893a0cc-8ad0-4c90-a0f1-9f88742487d8', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:23:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4e9853fc-e2a4-4b00-a078-3d7e517094d4 tempest-VolumesTestJSON-1942998715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30ca7e2e-9f4d-4db0-80a2-3bd955e9962a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:23:00 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-4e9853fc-e2a4-4b00-a078-3d7e517094d4 tempest-VolumesTestJSON-1942998715 None] Volume volume-4893a0cc-8ad0-4c90-a0f1-9f88742487d8 (4893a0cc-8ad0-4c90-a0f1-9f88742487d8): created successfully
Jul 14 16:23:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4e9853fc-e2a4-4b00-a078-3d7e517094d4 tempest-VolumesTestJSON-1942998715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30ca7e2e-9f4d-4db0-80a2-3bd955e9962a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:23:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4e9853fc-e2a4-4b00-a078-3d7e517094d4 tempest-VolumesTestJSON-1942998715 None] Flow 'volume_create_manager' (1d0e28cb-37fa-4e51-ae0e-28751d645ef3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:23:01 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-4e9853fc-e2a4-4b00-a078-3d7e517094d4 tempest-VolumesTestJSON-1942998715 None] Created volume successfully.
Jul 14 16:23:03 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-18bd76a8-aaba-4f10-a633-b70f7637d2b8 tempest-VolumesTestJSON-1942998715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:23:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-18bd76a8-aaba-4f10-a633-b70f7637d2b8 tempest-VolumesTestJSON-1942998715 None] Flow 'volume_create_manager' (d335f4f3-a37f-49c3-9f9f-4af286ecf137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:23:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-18bd76a8-aaba-4f10-a633-b70f7637d2b8 tempest-VolumesTestJSON-1942998715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91e2aa02-12c2-460b-9485-a801fe33e72a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:23:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-18bd76a8-aaba-4f10-a633-b70f7637d2b8 tempest-VolumesTestJSON-1942998715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91e2aa02-12c2-460b-9485-a801fe33e72a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-551528850',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da5430b2-8165-44d2-aa79-eef85d095883,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c668cd3347344d0586ccc80cda318585',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:23:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:23:03Z,use_quota=True,user_id='8309e63ef9a1481ca902049305813b39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:23:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-18bd76a8-aaba-4f10-a633-b70f7637d2b8 tempest-VolumesTestJSON-1942998715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e51f317f-e400-4c64-8816-5e40c13bdba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:23:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-18bd76a8-aaba-4f10-a633-b70f7637d2b8 tempest-VolumesTestJSON-1942998715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e51f317f-e400-4c64-8816-5e40c13bdba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:23:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-18bd76a8-aaba-4f10-a633-b70f7637d2b8 tempest-VolumesTestJSON-1942998715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (716e1882-d8e0-41e8-92d1-d5a1e8c1003e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:23:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-18bd76a8-aaba-4f10-a633-b70f7637d2b8 tempest-VolumesTestJSON-1942998715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (716e1882-d8e0-41e8-92d1-d5a1e8c1003e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da5430b2-8165-44d2-aa79-eef85d095883', 'volume_name': 'volume-da5430b2-8165-44d2-aa79-eef85d095883', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:23:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-18bd76a8-aaba-4f10-a633-b70f7637d2b8 tempest-VolumesTestJSON-1942998715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f772c061-a6e3-45d9-9426-23c9b6733152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:23:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-18bd76a8-aaba-4f10-a633-b70f7637d2b8 tempest-VolumesTestJSON-1942998715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f772c061-a6e3-45d9-9426-23c9b6733152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:23:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-18bd76a8-aaba-4f10-a633-b70f7637d2b8 tempest-VolumesTestJSON-1942998715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cadd962-6f76-48fd-aa63-6c7ad7461cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:23:03 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-18bd76a8-aaba-4f10-a633-b70f7637d2b8 tempest-VolumesTestJSON-1942998715 None] Volume da5430b2-8165-44d2-aa79-eef85d095883: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da5430b2-8165-44d2-aa79-eef85d095883', 'volume_size': 1}
Jul 14 16:23:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-18bd76a8-aaba-4f10-a633-b70f7637d2b8 tempest-VolumesTestJSON-1942998715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:23:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-18bd76a8-aaba-4f10-a633-b70f7637d2b8 tempest-VolumesTestJSON-1942998715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:23:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-18bd76a8-aaba-4f10-a633-b70f7637d2b8 tempest-VolumesTestJSON-1942998715 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-551528850',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da5430b2-8165-44d2-aa79-eef85d095883,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c668cd3347344d0586ccc80cda318585',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:23:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:23:03Z,use_quota=True,user_id='8309e63ef9a1481ca902049305813b39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:23:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-18bd76a8-aaba-4f10-a633-b70f7637d2b8 tempest-VolumesTestJSON-1942998715 None] Creating volume da5430b2-8165-44d2-aa79-eef85d095883 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:23:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-18bd76a8-aaba-4f10-a633-b70f7637d2b8 tempest-VolumesTestJSON-1942998715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:23:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-18bd76a8-aaba-4f10-a633-b70f7637d2b8 tempest-VolumesTestJSON-1942998715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:23:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-18bd76a8-aaba-4f10-a633-b70f7637d2b8 tempest-VolumesTestJSON-1942998715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:23:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-18bd76a8-aaba-4f10-a633-b70f7637d2b8 tempest-VolumesTestJSON-1942998715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:23:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-18bd76a8-aaba-4f10-a633-b70f7637d2b8 tempest-VolumesTestJSON-1942998715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:23:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-18bd76a8-aaba-4f10-a633-b70f7637d2b8 tempest-VolumesTestJSON-1942998715 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:23:03 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-18bd76a8-aaba-4f10-a633-b70f7637d2b8 tempest-VolumesTestJSON-1942998715 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:23:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-18bd76a8-aaba-4f10-a633-b70f7637d2b8 tempest-VolumesTestJSON-1942998715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-da5430b2-8165-44d2-aa79-eef85d095883 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:23:03 devstack sudo[87807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-da5430b2-8165-44d2-aa79-eef85d095883 1073741824
Jul 14 16:23:03 devstack sudo[87807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:23:03 devstack sudo[87807]: pam_unix(sudo:session): session closed for user root
Jul 14 16:23:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-18bd76a8-aaba-4f10-a633-b70f7637d2b8 tempest-VolumesTestJSON-1942998715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-da5430b2-8165-44d2-aa79-eef85d095883 1073741824" returned: 0 in 0.690s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:23:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-18bd76a8-aaba-4f10-a633-b70f7637d2b8 tempest-VolumesTestJSON-1942998715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-da5430b2-8165-44d2-aa79-eef85d095883 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:23:04 devstack sudo[87813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-da5430b2-8165-44d2-aa79-eef85d095883
Jul 14 16:23:04 devstack sudo[87813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:23:04 devstack sudo[87813]: pam_unix(sudo:session): session closed for user root
Jul 14 16:23:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-18bd76a8-aaba-4f10-a633-b70f7637d2b8 tempest-VolumesTestJSON-1942998715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-da5430b2-8165-44d2-aa79-eef85d095883" returned: 0 in 0.457s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:23:04 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-18bd76a8-aaba-4f10-a633-b70f7637d2b8 tempest-VolumesTestJSON-1942998715 None] <== create_volume: return (1208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:23:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-18bd76a8-aaba-4f10-a633-b70f7637d2b8 tempest-VolumesTestJSON-1942998715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.210s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:23:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-18bd76a8-aaba-4f10-a633-b70f7637d2b8 tempest-VolumesTestJSON-1942998715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cadd962-6f76-48fd-aa63-6c7ad7461cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da5430b2-8165-44d2-aa79-eef85d095883', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:23:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-18bd76a8-aaba-4f10-a633-b70f7637d2b8 tempest-VolumesTestJSON-1942998715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaf04e2b-8f5a-4a5e-816a-71e852eadd71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:23:04 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-18bd76a8-aaba-4f10-a633-b70f7637d2b8 tempest-VolumesTestJSON-1942998715 None] Volume volume-da5430b2-8165-44d2-aa79-eef85d095883 (da5430b2-8165-44d2-aa79-eef85d095883): created successfully
Jul 14 16:23:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-18bd76a8-aaba-4f10-a633-b70f7637d2b8 tempest-VolumesTestJSON-1942998715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaf04e2b-8f5a-4a5e-816a-71e852eadd71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:23:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-18bd76a8-aaba-4f10-a633-b70f7637d2b8 tempest-VolumesTestJSON-1942998715 None] Flow 'volume_create_manager' (d335f4f3-a37f-49c3-9f9f-4af286ecf137) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:23:04 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-18bd76a8-aaba-4f10-a633-b70f7637d2b8 tempest-VolumesTestJSON-1942998715 None] Created volume successfully.
Jul 14 16:23:04 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f910b12-4592-4850-922b-cdf0b29f3096 tempest-VolumesAdminNegativeTest-488819407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:23:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-7f910b12-4592-4850-922b-cdf0b29f3096 tempest-VolumesAdminNegativeTest-488819407 None] Flow 'volume_create_manager' (11ec525c-f09a-42a6-a64b-38f6b0fbb6f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:23:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-7f910b12-4592-4850-922b-cdf0b29f3096 tempest-VolumesAdminNegativeTest-488819407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa33335b-79da-4d47-9fa8-0aa496dc0146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:23:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-7f910b12-4592-4850-922b-cdf0b29f3096 tempest-VolumesAdminNegativeTest-488819407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa33335b-79da-4d47-9fa8-0aa496dc0146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:23:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1160662474',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0b6e876-90a2-418b-8462-8d60206e1c5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fba66bc71cb946f29e13611ba0ce6bb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:23:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:23:05Z,use_quota=True,user_id='c7e761ff1ec741d48447db3d07b5aec9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:23:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-7f910b12-4592-4850-922b-cdf0b29f3096 tempest-VolumesAdminNegativeTest-488819407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc835dfb-1c2b-4a0d-9236-8accec0d7e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:23:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-7f910b12-4592-4850-922b-cdf0b29f3096 tempest-VolumesAdminNegativeTest-488819407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc835dfb-1c2b-4a0d-9236-8accec0d7e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:23:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-7f910b12-4592-4850-922b-cdf0b29f3096 tempest-VolumesAdminNegativeTest-488819407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7a624bc-5802-4f09-94bb-c5ec7bc6e0f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:23:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-7f910b12-4592-4850-922b-cdf0b29f3096 tempest-VolumesAdminNegativeTest-488819407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7a624bc-5802-4f09-94bb-c5ec7bc6e0f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0b6e876-90a2-418b-8462-8d60206e1c5b', 'volume_name': 'volume-b0b6e876-90a2-418b-8462-8d60206e1c5b', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:23:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-7f910b12-4592-4850-922b-cdf0b29f3096 tempest-VolumesAdminNegativeTest-488819407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (666a1a20-4d85-446a-9d30-a92b946e2fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:23:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-7f910b12-4592-4850-922b-cdf0b29f3096 tempest-VolumesAdminNegativeTest-488819407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (666a1a20-4d85-446a-9d30-a92b946e2fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:23:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-7f910b12-4592-4850-922b-cdf0b29f3096 tempest-VolumesAdminNegativeTest-488819407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f7e2baa-8dfe-41b2-8000-867607351298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:23:05 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-7f910b12-4592-4850-922b-cdf0b29f3096 tempest-VolumesAdminNegativeTest-488819407 None] Volume b0b6e876-90a2-418b-8462-8d60206e1c5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0b6e876-90a2-418b-8462-8d60206e1c5b', 'volume_size': 1}
Jul 14 16:23:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-7f910b12-4592-4850-922b-cdf0b29f3096 tempest-VolumesAdminNegativeTest-488819407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:23:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-7f910b12-4592-4850-922b-cdf0b29f3096 tempest-VolumesAdminNegativeTest-488819407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:23:05 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-7f910b12-4592-4850-922b-cdf0b29f3096 tempest-VolumesAdminNegativeTest-488819407 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:23:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1160662474',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0b6e876-90a2-418b-8462-8d60206e1c5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fba66bc71cb946f29e13611ba0ce6bb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:23:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:23:05Z,use_quota=True,user_id='c7e761ff1ec741d48447db3d07b5aec9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:23:05 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-7f910b12-4592-4850-922b-cdf0b29f3096 tempest-VolumesAdminNegativeTest-488819407 None] Creating volume b0b6e876-90a2-418b-8462-8d60206e1c5b {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:23:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-7f910b12-4592-4850-922b-cdf0b29f3096 tempest-VolumesAdminNegativeTest-488819407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:23:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-7f910b12-4592-4850-922b-cdf0b29f3096 tempest-VolumesAdminNegativeTest-488819407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:23:05 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-7f910b12-4592-4850-922b-cdf0b29f3096 tempest-VolumesAdminNegativeTest-488819407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:23:05 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-7f910b12-4592-4850-922b-cdf0b29f3096 tempest-VolumesAdminNegativeTest-488819407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:23:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-7f910b12-4592-4850-922b-cdf0b29f3096 tempest-VolumesAdminNegativeTest-488819407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:23:05 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-7f910b12-4592-4850-922b-cdf0b29f3096 tempest-VolumesAdminNegativeTest-488819407 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:23:05 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-7f910b12-4592-4850-922b-cdf0b29f3096 tempest-VolumesAdminNegativeTest-488819407 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:23:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7f910b12-4592-4850-922b-cdf0b29f3096 tempest-VolumesAdminNegativeTest-488819407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b0b6e876-90a2-418b-8462-8d60206e1c5b 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:23:05 devstack sudo[87816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b0b6e876-90a2-418b-8462-8d60206e1c5b 1073741824
Jul 14 16:23:05 devstack sudo[87816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:23:05 devstack sudo[87816]: pam_unix(sudo:session): session closed for user root
Jul 14 16:23:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7f910b12-4592-4850-922b-cdf0b29f3096 tempest-VolumesAdminNegativeTest-488819407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b0b6e876-90a2-418b-8462-8d60206e1c5b 1073741824" returned: 0 in 0.833s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:23:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7f910b12-4592-4850-922b-cdf0b29f3096 tempest-VolumesAdminNegativeTest-488819407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b0b6e876-90a2-418b-8462-8d60206e1c5b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:23:05 devstack sudo[87828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b0b6e876-90a2-418b-8462-8d60206e1c5b
Jul 14 16:23:05 devstack sudo[87828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:23:06 devstack sudo[87828]: pam_unix(sudo:session): session closed for user root
Jul 14 16:23:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7f910b12-4592-4850-922b-cdf0b29f3096 tempest-VolumesAdminNegativeTest-488819407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b0b6e876-90a2-418b-8462-8d60206e1c5b" returned: 0 in 0.358s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:23:06 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-7f910b12-4592-4850-922b-cdf0b29f3096 tempest-VolumesAdminNegativeTest-488819407 None] <== create_volume: return (1258ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:23:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-7f910b12-4592-4850-922b-cdf0b29f3096 tempest-VolumesAdminNegativeTest-488819407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.261s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:23:06 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-7f910b12-4592-4850-922b-cdf0b29f3096 tempest-VolumesAdminNegativeTest-488819407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f7e2baa-8dfe-41b2-8000-867607351298) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0b6e876-90a2-418b-8462-8d60206e1c5b', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:23:06 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-7f910b12-4592-4850-922b-cdf0b29f3096 tempest-VolumesAdminNegativeTest-488819407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82fc8dba-93fe-4302-a811-c33fcb9da329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:23:06 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-7f910b12-4592-4850-922b-cdf0b29f3096 tempest-VolumesAdminNegativeTest-488819407 None] Volume volume-b0b6e876-90a2-418b-8462-8d60206e1c5b (b0b6e876-90a2-418b-8462-8d60206e1c5b): created successfully
Jul 14 16:23:06 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-7f910b12-4592-4850-922b-cdf0b29f3096 tempest-VolumesAdminNegativeTest-488819407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82fc8dba-93fe-4302-a811-c33fcb9da329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:23:06 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-7f910b12-4592-4850-922b-cdf0b29f3096 tempest-VolumesAdminNegativeTest-488819407 None] Flow 'volume_create_manager' (11ec525c-f09a-42a6-a64b-38f6b0fbb6f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:23:06 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-7f910b12-4592-4850-922b-cdf0b29f3096 tempest-VolumesAdminNegativeTest-488819407 None] Created volume successfully.
Jul 14 16:23:07 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-50e04474-9015-477b-a099-9dfb3f554951 tempest-VolumesAdminNegativeTest-488819407 None] Acquiring lock "cinder-b0b6e876-90a2-418b-8462-8d60206e1c5b-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:23:07 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-50e04474-9015-477b-a099-9dfb3f554951 tempest-VolumesAdminNegativeTest-488819407 None] Lock "cinder-b0b6e876-90a2-418b-8462-8d60206e1c5b-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:23:07 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-50e04474-9015-477b-a099-9dfb3f554951 tempest-VolumesAdminNegativeTest-488819407 None] Acquiring lock "cinder-quobyte-b0b6e876-90a2-418b-8462-8d60206e1c5b" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:23:07 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-50e04474-9015-477b-a099-9dfb3f554951 tempest-VolumesAdminNegativeTest-488819407 None] Lock "cinder-quobyte-b0b6e876-90a2-418b-8462-8d60206e1c5b" acquired by "delete_volume" :: waited 0.039s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:23:07 devstack cinder-volume[87166]: INFO oslo.privsep.daemon [None req-50e04474-9015-477b-a099-9dfb3f554951 tempest-VolumesAdminNegativeTest-488819407 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpg2iixit_/privsep.sock']
Jul 14 16:23:07 devstack sudo[87885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpg2iixit_/privsep.sock
Jul 14 16:23:07 devstack sudo[87885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:23:08 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-fa22360b-654c-4d8f-a5f2-bec87684a280 tempest-VolumesTestJSON-1942998715 None] Acquiring lock "cinder-da5430b2-8165-44d2-aa79-eef85d095883-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:23:08 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-fa22360b-654c-4d8f-a5f2-bec87684a280 tempest-VolumesTestJSON-1942998715 None] Lock "cinder-da5430b2-8165-44d2-aa79-eef85d095883-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:23:08 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-fa22360b-654c-4d8f-a5f2-bec87684a280 tempest-VolumesTestJSON-1942998715 None] Acquiring lock "cinder-quobyte-da5430b2-8165-44d2-aa79-eef85d095883" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:23:08 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-fa22360b-654c-4d8f-a5f2-bec87684a280 tempest-VolumesTestJSON-1942998715 None] Lock "cinder-quobyte-da5430b2-8165-44d2-aa79-eef85d095883" acquired by "delete_volume" :: waited 0.056s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:23:09 devstack cinder-volume[87166]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning:
Jul 14 16:23:09 devstack cinder-volume[87166]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 14 16:23:09 devstack cinder-volume[87166]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Jul 14 16:23:09 devstack cinder-volume[87166]: WARNING oslo.privsep.daemon [-] privsep log: 
Jul 14 16:23:09 devstack cinder-volume[87166]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Jul 14 16:23:09 devstack cinder-volume[87166]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Jul 14 16:23:09 devstack cinder-volume[87166]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 14 16:23:09 devstack cinder-volume[87166]: WARNING oslo.privsep.daemon [-] privsep log: 
Jul 14 16:23:09 devstack cinder-volume[87166]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Jul 14 16:23:09 devstack sudo[87885]: pam_unix(sudo:session): session closed for user root
Jul 14 16:23:09 devstack cinder-volume[87166]: INFO oslo.privsep.daemon [None req-50e04474-9015-477b-a099-9dfb3f554951 tempest-VolumesAdminNegativeTest-488819407 None] Spawned new privsep daemon via rootwrap
Jul 14 16:23:09 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [None req-50e04474-9015-477b-a099-9dfb3f554951 tempest-VolumesAdminNegativeTest-488819407 None] Accepted privsep connection to /tmp/tmpg2iixit_/privsep.sock {{(pid=87166) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}}
Jul 14 16:23:09 devstack cinder-volume[87166]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jul 14 16:23:09 devstack cinder-volume[87166]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jul 14 16:23:09 devstack cinder-volume[87166]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Jul 14 16:23:09 devstack cinder-volume[87166]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87911
Jul 14 16:23:09 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa42df4-0590-45d8-acbe-b565dd9e7aa6]: (2,) {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:23:09 devstack cinder-volume[87166]: WARNING oslo_privsep.priv_context [None req-fa22360b-654c-4d8f-a5f2-bec87684a280 tempest-VolumesTestJSON-1942998715 None] privsep daemon already running
Jul 14 16:23:09 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4f200e-961d-48df-946c-06c2f4a59f93]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:23:09 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[88de7ed0-6732-4ea4-8ff7-2584de549bf6]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:23:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fa22360b-654c-4d8f-a5f2-bec87684a280 tempest-VolumesTestJSON-1942998715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-da5430b2-8165-44d2-aa79-eef85d095883 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:23:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-50e04474-9015-477b-a099-9dfb3f554951 tempest-VolumesAdminNegativeTest-488819407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b0b6e876-90a2-418b-8462-8d60206e1c5b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:23:10 devstack sudo[87919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-da5430b2-8165-44d2-aa79-eef85d095883
Jul 14 16:23:10 devstack sudo[87919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:23:10 devstack sudo[87922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b0b6e876-90a2-418b-8462-8d60206e1c5b
Jul 14 16:23:10 devstack sudo[87922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:23:10 devstack sudo[87922]: pam_unix(sudo:session): session closed for user root
Jul 14 16:23:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-50e04474-9015-477b-a099-9dfb3f554951 tempest-VolumesAdminNegativeTest-488819407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b0b6e876-90a2-418b-8462-8d60206e1c5b" returned: 0 in 0.730s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:23:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-50e04474-9015-477b-a099-9dfb3f554951 tempest-VolumesAdminNegativeTest-488819407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b0b6e876-90a2-418b-8462-8d60206e1c5b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:23:10 devstack sudo[87943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b0b6e876-90a2-418b-8462-8d60206e1c5b
Jul 14 16:23:10 devstack sudo[87943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:23:10 devstack sudo[87919]: pam_unix(sudo:session): session closed for user root
Jul 14 16:23:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fa22360b-654c-4d8f-a5f2-bec87684a280 tempest-VolumesTestJSON-1942998715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-da5430b2-8165-44d2-aa79-eef85d095883" returned: 0 in 0.839s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:23:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fa22360b-654c-4d8f-a5f2-bec87684a280 tempest-VolumesTestJSON-1942998715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-da5430b2-8165-44d2-aa79-eef85d095883 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:23:10 devstack sudo[87946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-da5430b2-8165-44d2-aa79-eef85d095883
Jul 14 16:23:10 devstack sudo[87946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:23:11 devstack sudo[87946]: pam_unix(sudo:session): session closed for user root
Jul 14 16:23:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fa22360b-654c-4d8f-a5f2-bec87684a280 tempest-VolumesTestJSON-1942998715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-da5430b2-8165-44d2-aa79-eef85d095883" returned: 0 in 0.503s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:23:11 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-fa22360b-654c-4d8f-a5f2-bec87684a280 tempest-VolumesTestJSON-1942998715 None] Lock "cinder-quobyte-da5430b2-8165-44d2-aa79-eef85d095883" released by "delete_volume" :: held 2.711s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:23:11 devstack sudo[87943]: pam_unix(sudo:session): session closed for user root
Jul 14 16:23:11 devstack cinder-volume[87166]: WARNING cinder.quota [None req-fa22360b-654c-4d8f-a5f2-bec87684a280 tempest-VolumesTestJSON-1942998715 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jul 14 16:23:11 devstack cinder-volume[87166]: WARNING cinder.quota [None req-fa22360b-654c-4d8f-a5f2-bec87684a280 tempest-VolumesTestJSON-1942998715 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jul 14 16:23:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-50e04474-9015-477b-a099-9dfb3f554951 tempest-VolumesAdminNegativeTest-488819407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b0b6e876-90a2-418b-8462-8d60206e1c5b" returned: 0 in 0.859s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:23:11 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-50e04474-9015-477b-a099-9dfb3f554951 tempest-VolumesAdminNegativeTest-488819407 None] Lock "cinder-quobyte-b0b6e876-90a2-418b-8462-8d60206e1c5b" released by "delete_volume" :: held 3.883s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:23:11 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-fa22360b-654c-4d8f-a5f2-bec87684a280 tempest-VolumesTestJSON-1942998715 None] Created reservations ['8dcfcce7-be6b-48e8-832d-f34a064cde25', '735671f5-3f77-4d56-9d72-1fcab488e267', 'e6bb7873-98e4-40cf-9b81-7851524327e6', '4a45d341-cf04-49f0-afe3-78e1d48c07a7'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:23:11 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-50e04474-9015-477b-a099-9dfb3f554951 tempest-VolumesAdminNegativeTest-488819407 None] Created reservations ['1e37a235-bf09-4396-a768-aa1d560af451', '231c7fd0-0571-40b5-a9d5-790cb299a573', 'd960e849-c11d-4b8e-a694-7dfb78b62b4e', 'c9f0b04f-e321-4cdd-acdc-ea09ef56223f'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:23:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-fa22360b-654c-4d8f-a5f2-bec87684a280 tempest-VolumesTestJSON-1942998715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:23:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-fa22360b-654c-4d8f-a5f2-bec87684a280 tempest-VolumesTestJSON-1942998715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:23:11 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-fa22360b-654c-4d8f-a5f2-bec87684a280 tempest-VolumesTestJSON-1942998715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:23:11 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-fa22360b-654c-4d8f-a5f2-bec87684a280 tempest-VolumesTestJSON-1942998715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:23:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-fa22360b-654c-4d8f-a5f2-bec87684a280 tempest-VolumesTestJSON-1942998715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:23:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fa22360b-654c-4d8f-a5f2-bec87684a280 tempest-VolumesTestJSON-1942998715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:23:11 devstack sudo[87956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:23:11 devstack sudo[87956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:23:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-50e04474-9015-477b-a099-9dfb3f554951 tempest-VolumesAdminNegativeTest-488819407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:23:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-50e04474-9015-477b-a099-9dfb3f554951 tempest-VolumesAdminNegativeTest-488819407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:23:11 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-50e04474-9015-477b-a099-9dfb3f554951 tempest-VolumesAdminNegativeTest-488819407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:23:11 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-50e04474-9015-477b-a099-9dfb3f554951 tempest-VolumesAdminNegativeTest-488819407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:23:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-50e04474-9015-477b-a099-9dfb3f554951 tempest-VolumesAdminNegativeTest-488819407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:23:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-50e04474-9015-477b-a099-9dfb3f554951 tempest-VolumesAdminNegativeTest-488819407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:23:12 devstack sudo[87958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:23:12 devstack sudo[87958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:23:12 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-229ee18b-aeb3-4506-859a-812bee52d285 tempest-VolumesTestJSON-1942998715 None] Acquiring lock "cinder-4893a0cc-8ad0-4c90-a0f1-9f88742487d8-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:23:12 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-229ee18b-aeb3-4506-859a-812bee52d285 tempest-VolumesTestJSON-1942998715 None] Lock "cinder-4893a0cc-8ad0-4c90-a0f1-9f88742487d8-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:23:12 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-229ee18b-aeb3-4506-859a-812bee52d285 tempest-VolumesTestJSON-1942998715 None] Acquiring lock "cinder-quobyte-4893a0cc-8ad0-4c90-a0f1-9f88742487d8" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:23:12 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-229ee18b-aeb3-4506-859a-812bee52d285 tempest-VolumesTestJSON-1942998715 None] Lock "cinder-quobyte-4893a0cc-8ad0-4c90-a0f1-9f88742487d8" acquired by "delete_volume" :: waited 0.032s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:23:12 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8247946-f19b-467f-9b1e-4162d6f125e1]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:23:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-229ee18b-aeb3-4506-859a-812bee52d285 tempest-VolumesTestJSON-1942998715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4893a0cc-8ad0-4c90-a0f1-9f88742487d8 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:23:12 devstack sudo[87956]: pam_unix(sudo:session): session closed for user root
Jul 14 16:23:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fa22360b-654c-4d8f-a5f2-bec87684a280 tempest-VolumesTestJSON-1942998715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.555s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:23:12 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-fa22360b-654c-4d8f-a5f2-bec87684a280 tempest-VolumesTestJSON-1942998715 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:23:12 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-fa22360b-654c-4d8f-a5f2-bec87684a280 tempest-VolumesTestJSON-1942998715 None] Deleted volume successfully.
Jul 14 16:23:12 devstack sudo[87958]: pam_unix(sudo:session): session closed for user root
Jul 14 16:23:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-50e04474-9015-477b-a099-9dfb3f554951 tempest-VolumesAdminNegativeTest-488819407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.541s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:23:12 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-50e04474-9015-477b-a099-9dfb3f554951 tempest-VolumesAdminNegativeTest-488819407 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:23:12 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-50e04474-9015-477b-a099-9dfb3f554951 tempest-VolumesAdminNegativeTest-488819407 None] Deleted volume successfully.
Jul 14 16:23:12 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-fa22360b-654c-4d8f-a5f2-bec87684a280 tempest-VolumesTestJSON-1942998715 None] Lock "cinder-da5430b2-8165-44d2-aa79-eef85d095883-delete_volume" released by "delete_volume" :: held 4.003s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:23:12 devstack sudo[87960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4893a0cc-8ad0-4c90-a0f1-9f88742487d8
Jul 14 16:23:12 devstack sudo[87960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:23:12 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-50e04474-9015-477b-a099-9dfb3f554951 tempest-VolumesAdminNegativeTest-488819407 None] Lock "cinder-b0b6e876-90a2-418b-8462-8d60206e1c5b-delete_volume" released by "delete_volume" :: held 5.008s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:23:13 devstack sudo[87960]: pam_unix(sudo:session): session closed for user root
Jul 14 16:23:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-229ee18b-aeb3-4506-859a-812bee52d285 tempest-VolumesTestJSON-1942998715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4893a0cc-8ad0-4c90-a0f1-9f88742487d8" returned: 0 in 0.731s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:23:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-229ee18b-aeb3-4506-859a-812bee52d285 tempest-VolumesTestJSON-1942998715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4893a0cc-8ad0-4c90-a0f1-9f88742487d8 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:23:13 devstack sudo[87970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4893a0cc-8ad0-4c90-a0f1-9f88742487d8
Jul 14 16:23:13 devstack sudo[87970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:23:13 devstack sudo[87970]: pam_unix(sudo:session): session closed for user root
Jul 14 16:23:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-229ee18b-aeb3-4506-859a-812bee52d285 tempest-VolumesTestJSON-1942998715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4893a0cc-8ad0-4c90-a0f1-9f88742487d8" returned: 0 in 0.414s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:23:13 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-229ee18b-aeb3-4506-859a-812bee52d285 tempest-VolumesTestJSON-1942998715 None] Lock "cinder-quobyte-4893a0cc-8ad0-4c90-a0f1-9f88742487d8" released by "delete_volume" :: held 1.271s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:23:13 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-229ee18b-aeb3-4506-859a-812bee52d285 tempest-VolumesTestJSON-1942998715 None] Created reservations ['e928597b-c019-40ba-b713-9f60a684c85e', 'aa3fb3a3-8eff-4bd7-92d5-1020610ba8bd', 'fcade46f-a3fb-4a2e-8b15-54920aab47e9', '50d022e7-3aef-4a93-9992-8b16abac8479'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:23:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-229ee18b-aeb3-4506-859a-812bee52d285 tempest-VolumesTestJSON-1942998715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:23:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-229ee18b-aeb3-4506-859a-812bee52d285 tempest-VolumesTestJSON-1942998715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:23:13 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-229ee18b-aeb3-4506-859a-812bee52d285 tempest-VolumesTestJSON-1942998715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:23:13 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-229ee18b-aeb3-4506-859a-812bee52d285 tempest-VolumesTestJSON-1942998715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:23:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-229ee18b-aeb3-4506-859a-812bee52d285 tempest-VolumesTestJSON-1942998715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:23:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-229ee18b-aeb3-4506-859a-812bee52d285 tempest-VolumesTestJSON-1942998715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:23:13 devstack sudo[87996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:23:13 devstack sudo[87996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:23:14 devstack sudo[87996]: pam_unix(sudo:session): session closed for user root
Jul 14 16:23:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-229ee18b-aeb3-4506-859a-812bee52d285 tempest-VolumesTestJSON-1942998715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.297s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:23:14 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-229ee18b-aeb3-4506-859a-812bee52d285 tempest-VolumesTestJSON-1942998715 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:23:14 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-229ee18b-aeb3-4506-859a-812bee52d285 tempest-VolumesTestJSON-1942998715 None] Deleted volume successfully.
Jul 14 16:23:14 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-229ee18b-aeb3-4506-859a-812bee52d285 tempest-VolumesTestJSON-1942998715 None] Lock "cinder-4893a0cc-8ad0-4c90-a0f1-9f88742487d8-delete_volume" released by "delete_volume" :: held 2.051s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:23:14 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d62b51e0-a0ef-40a2-afe0-ca596a0d42dc tempest-VolumesTestJSON-1942998715 None] Acquiring lock "cinder-b1136b6b-5f5c-43d0-a0ef-dc22d58c69b2-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:23:14 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d62b51e0-a0ef-40a2-afe0-ca596a0d42dc tempest-VolumesTestJSON-1942998715 None] Lock "cinder-b1136b6b-5f5c-43d0-a0ef-dc22d58c69b2-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:23:14 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d62b51e0-a0ef-40a2-afe0-ca596a0d42dc tempest-VolumesTestJSON-1942998715 None] Acquiring lock "cinder-quobyte-b1136b6b-5f5c-43d0-a0ef-dc22d58c69b2" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:23:14 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d62b51e0-a0ef-40a2-afe0-ca596a0d42dc tempest-VolumesTestJSON-1942998715 None] Lock "cinder-quobyte-b1136b6b-5f5c-43d0-a0ef-dc22d58c69b2" acquired by "delete_volume" :: waited 0.039s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:23:14 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f8c7de-0d30-40f2-8e00-474dbed56c4f]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:23:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d62b51e0-a0ef-40a2-afe0-ca596a0d42dc tempest-VolumesTestJSON-1942998715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1136b6b-5f5c-43d0-a0ef-dc22d58c69b2 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:23:15 devstack sudo[88004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1136b6b-5f5c-43d0-a0ef-dc22d58c69b2
Jul 14 16:23:15 devstack sudo[88004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:23:15 devstack sudo[88004]: pam_unix(sudo:session): session closed for user root
Jul 14 16:23:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d62b51e0-a0ef-40a2-afe0-ca596a0d42dc tempest-VolumesTestJSON-1942998715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1136b6b-5f5c-43d0-a0ef-dc22d58c69b2" returned: 0 in 0.760s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:23:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d62b51e0-a0ef-40a2-afe0-ca596a0d42dc tempest-VolumesTestJSON-1942998715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1136b6b-5f5c-43d0-a0ef-dc22d58c69b2 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:23:15 devstack sudo[88018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1136b6b-5f5c-43d0-a0ef-dc22d58c69b2
Jul 14 16:23:15 devstack sudo[88018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:23:16 devstack sudo[88018]: pam_unix(sudo:session): session closed for user root
Jul 14 16:23:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d62b51e0-a0ef-40a2-afe0-ca596a0d42dc tempest-VolumesTestJSON-1942998715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1136b6b-5f5c-43d0-a0ef-dc22d58c69b2" returned: 0 in 0.442s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:23:16 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d62b51e0-a0ef-40a2-afe0-ca596a0d42dc tempest-VolumesTestJSON-1942998715 None] Lock "cinder-quobyte-b1136b6b-5f5c-43d0-a0ef-dc22d58c69b2" released by "delete_volume" :: held 1.287s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:23:16 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-d62b51e0-a0ef-40a2-afe0-ca596a0d42dc tempest-VolumesTestJSON-1942998715 None] Created reservations ['0e5df54c-c144-490c-898e-1bfb1d0a3f24', '2ceb210e-93e7-417a-82c3-1174f6526c0a', 'd64d0e9e-89c3-4f7d-918e-c3151474d796', 'e634819e-2d8d-46d2-be59-ead44706d285'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:23:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d62b51e0-a0ef-40a2-afe0-ca596a0d42dc tempest-VolumesTestJSON-1942998715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:23:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d62b51e0-a0ef-40a2-afe0-ca596a0d42dc tempest-VolumesTestJSON-1942998715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:23:16 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d62b51e0-a0ef-40a2-afe0-ca596a0d42dc tempest-VolumesTestJSON-1942998715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:23:16 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d62b51e0-a0ef-40a2-afe0-ca596a0d42dc tempest-VolumesTestJSON-1942998715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:23:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d62b51e0-a0ef-40a2-afe0-ca596a0d42dc tempest-VolumesTestJSON-1942998715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:23:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d62b51e0-a0ef-40a2-afe0-ca596a0d42dc tempest-VolumesTestJSON-1942998715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:23:16 devstack sudo[88057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:23:16 devstack sudo[88057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:23:16 devstack sudo[88057]: pam_unix(sudo:session): session closed for user root
Jul 14 16:23:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d62b51e0-a0ef-40a2-afe0-ca596a0d42dc tempest-VolumesTestJSON-1942998715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.393s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:23:16 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-d62b51e0-a0ef-40a2-afe0-ca596a0d42dc tempest-VolumesTestJSON-1942998715 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:23:16 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-d62b51e0-a0ef-40a2-afe0-ca596a0d42dc tempest-VolumesTestJSON-1942998715 None] Deleted volume successfully.
Jul 14 16:23:16 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d62b51e0-a0ef-40a2-afe0-ca596a0d42dc tempest-VolumesTestJSON-1942998715 None] Lock "cinder-b1136b6b-5f5c-43d0-a0ef-dc22d58c69b2-delete_volume" released by "delete_volume" :: held 2.154s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:23:24 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-c92ae6a8-fcbd-44d7-9744-c3d5ac1dfe36 tempest-GroupsV320Test-2147070005 None] Group tempest-GroupsV320Test-Group-1831061732: creating
Jul 14 16:23:24 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-c92ae6a8-fcbd-44d7-9744-c3d5ac1dfe36 tempest-GroupsV320Test-2147070005 None] Group tempest-GroupsV320Test-Group-1831061732: created successfully
Jul 14 16:23:24 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-c92ae6a8-fcbd-44d7-9744-c3d5ac1dfe36 tempest-GroupsV320Test-2147070005 None] Create group completed successfully.
Jul 14 16:23:26 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-eff4b45a-d3c1-4174-a896-65adfd8125e9 tempest-GroupsV320Test-2147070005 None] Created reservations ['422367a0-47a7-44bd-89f0-363c91a64641'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:23:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-eff4b45a-d3c1-4174-a896-65adfd8125e9 tempest-GroupsV320Test-2147070005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:23:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-eff4b45a-d3c1-4174-a896-65adfd8125e9 tempest-GroupsV320Test-2147070005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:23:26 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-eff4b45a-d3c1-4174-a896-65adfd8125e9 tempest-GroupsV320Test-2147070005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:23:26 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-eff4b45a-d3c1-4174-a896-65adfd8125e9 tempest-GroupsV320Test-2147070005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:23:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-eff4b45a-d3c1-4174-a896-65adfd8125e9 tempest-GroupsV320Test-2147070005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:23:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-eff4b45a-d3c1-4174-a896-65adfd8125e9 tempest-GroupsV320Test-2147070005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:23:26 devstack sudo[88104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:23:26 devstack sudo[88104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:23:26 devstack sudo[88104]: pam_unix(sudo:session): session closed for user root
Jul 14 16:23:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-eff4b45a-d3c1-4174-a896-65adfd8125e9 tempest-GroupsV320Test-2147070005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.366s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:23:26 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-eff4b45a-d3c1-4174-a896-65adfd8125e9 tempest-GroupsV320Test-2147070005 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:23:26 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-eff4b45a-d3c1-4174-a896-65adfd8125e9 tempest-GroupsV320Test-2147070005 None] Delete group completed successfully.
Jul 14 16:23:35 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 16:23:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:23:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:23:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:23:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:23:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:23:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:23:35 devstack sudo[88145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:23:35 devstack sudo[88145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:23:35 devstack sudo[88145]: pam_unix(sudo:session): session closed for user root
Jul 14 16:23:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.333s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:23:35 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:23:35 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Running periodic task VolumeManager._thread_info {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 16:23:35 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] thread count: 8 {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 14 16:23:35 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] thread info: [<_MainThread(MainThread, started 128606490927232)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128606415432960)>, <Thread(Thread-3 (stat_writer), started daemon 128606378859328)>, <Thread(Rabbit-heartbeat, started daemon 128606379646144)>, <Thread(Thread-5 (_runner), started daemon 128606377685824)>, <Thread(Thread-7 (_runner), started daemon 128606377701888)>, <Thread(fd_logger, started daemon 128606377091392)>, <Thread(privsep_reader, started daemon 128606375782080)>] {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 14 16:23:36 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:SELECT=46,cinder:INSERT=11,cinder:UPDATE=45,cinder:DELETE=3 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 16:23:36 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:SELECT=27,cinder:UPDATE=56,cinder:DELETE=6,cinder:INSERT=11 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 16:23:37 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ef60a4f-d277-434a-a13b-00141b3e224e tempest-VolumeRetypeWithoutMigrationTest-798819054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:23:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1ef60a4f-d277-434a-a13b-00141b3e224e tempest-VolumeRetypeWithoutMigrationTest-798819054 None] Flow 'volume_create_manager' (66715d5d-d2e4-43ed-ab0d-5cacfb439bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:23:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1ef60a4f-d277-434a-a13b-00141b3e224e tempest-VolumeRetypeWithoutMigrationTest-798819054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f25e5856-cb84-412c-ab1c-690453b7f8a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:23:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1ef60a4f-d277-434a-a13b-00141b3e224e tempest-VolumeRetypeWithoutMigrationTest-798819054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f25e5856-cb84-412c-ab1c-690453b7f8a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:23:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1117525520',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5bba097-6311-4b5a-a423-fd5e36253d1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cb19353992c4d8c998adcb877087217',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:23:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:23:37Z,use_quota=True,user_id='11bc4dd93e5c4d6989065f90fbd9c92a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5adba753-7e03-4040-86d0-8656063a3953),volume_type_id=5adba753-7e03-4040-86d0-8656063a3953)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:23:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1ef60a4f-d277-434a-a13b-00141b3e224e tempest-VolumeRetypeWithoutMigrationTest-798819054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8071ff56-dc4f-4d04-a2ef-de6a7c064ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:23:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1ef60a4f-d277-434a-a13b-00141b3e224e tempest-VolumeRetypeWithoutMigrationTest-798819054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8071ff56-dc4f-4d04-a2ef-de6a7c064ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:23:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1ef60a4f-d277-434a-a13b-00141b3e224e tempest-VolumeRetypeWithoutMigrationTest-798819054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27f762fa-5546-4944-99fc-09160613d462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:23:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1ef60a4f-d277-434a-a13b-00141b3e224e tempest-VolumeRetypeWithoutMigrationTest-798819054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27f762fa-5546-4944-99fc-09160613d462) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5bba097-6311-4b5a-a423-fd5e36253d1b', 'volume_name': 'volume-c5bba097-6311-4b5a-a423-fd5e36253d1b', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:23:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1ef60a4f-d277-434a-a13b-00141b3e224e tempest-VolumeRetypeWithoutMigrationTest-798819054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (788f7c6e-0e20-45db-8385-989f32e77c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:23:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1ef60a4f-d277-434a-a13b-00141b3e224e tempest-VolumeRetypeWithoutMigrationTest-798819054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (788f7c6e-0e20-45db-8385-989f32e77c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:23:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1ef60a4f-d277-434a-a13b-00141b3e224e tempest-VolumeRetypeWithoutMigrationTest-798819054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21a3e4ec-aef4-4747-ab17-b71582c141af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:23:37 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-1ef60a4f-d277-434a-a13b-00141b3e224e tempest-VolumeRetypeWithoutMigrationTest-798819054 None] Volume c5bba097-6311-4b5a-a423-fd5e36253d1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5bba097-6311-4b5a-a423-fd5e36253d1b', 'volume_size': 1}
Jul 14 16:23:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1ef60a4f-d277-434a-a13b-00141b3e224e tempest-VolumeRetypeWithoutMigrationTest-798819054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:23:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1ef60a4f-d277-434a-a13b-00141b3e224e tempest-VolumeRetypeWithoutMigrationTest-798819054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:23:37 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-1ef60a4f-d277-434a-a13b-00141b3e224e tempest-VolumeRetypeWithoutMigrationTest-798819054 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:23:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1117525520',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5bba097-6311-4b5a-a423-fd5e36253d1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cb19353992c4d8c998adcb877087217',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:23:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:23:37Z,use_quota=True,user_id='11bc4dd93e5c4d6989065f90fbd9c92a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5adba753-7e03-4040-86d0-8656063a3953),volume_type_id=5adba753-7e03-4040-86d0-8656063a3953)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:23:37 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-1ef60a4f-d277-434a-a13b-00141b3e224e tempest-VolumeRetypeWithoutMigrationTest-798819054 None] Creating volume c5bba097-6311-4b5a-a423-fd5e36253d1b {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:23:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1ef60a4f-d277-434a-a13b-00141b3e224e tempest-VolumeRetypeWithoutMigrationTest-798819054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:23:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1ef60a4f-d277-434a-a13b-00141b3e224e tempest-VolumeRetypeWithoutMigrationTest-798819054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:23:37 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-1ef60a4f-d277-434a-a13b-00141b3e224e tempest-VolumeRetypeWithoutMigrationTest-798819054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:23:37 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-1ef60a4f-d277-434a-a13b-00141b3e224e tempest-VolumeRetypeWithoutMigrationTest-798819054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:23:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1ef60a4f-d277-434a-a13b-00141b3e224e tempest-VolumeRetypeWithoutMigrationTest-798819054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:23:37 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-1ef60a4f-d277-434a-a13b-00141b3e224e tempest-VolumeRetypeWithoutMigrationTest-798819054 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:23:37 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-1ef60a4f-d277-434a-a13b-00141b3e224e tempest-VolumeRetypeWithoutMigrationTest-798819054 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:23:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1ef60a4f-d277-434a-a13b-00141b3e224e tempest-VolumeRetypeWithoutMigrationTest-798819054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c5bba097-6311-4b5a-a423-fd5e36253d1b 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:23:37 devstack sudo[88172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c5bba097-6311-4b5a-a423-fd5e36253d1b 1073741824
Jul 14 16:23:37 devstack sudo[88172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:23:38 devstack sudo[88172]: pam_unix(sudo:session): session closed for user root
Jul 14 16:23:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1ef60a4f-d277-434a-a13b-00141b3e224e tempest-VolumeRetypeWithoutMigrationTest-798819054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c5bba097-6311-4b5a-a423-fd5e36253d1b 1073741824" returned: 0 in 0.516s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:23:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1ef60a4f-d277-434a-a13b-00141b3e224e tempest-VolumeRetypeWithoutMigrationTest-798819054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c5bba097-6311-4b5a-a423-fd5e36253d1b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:23:38 devstack sudo[88178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c5bba097-6311-4b5a-a423-fd5e36253d1b
Jul 14 16:23:38 devstack sudo[88178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:23:38 devstack sudo[88178]: pam_unix(sudo:session): session closed for user root
Jul 14 16:23:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1ef60a4f-d277-434a-a13b-00141b3e224e tempest-VolumeRetypeWithoutMigrationTest-798819054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c5bba097-6311-4b5a-a423-fd5e36253d1b" returned: 0 in 0.388s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:23:38 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-1ef60a4f-d277-434a-a13b-00141b3e224e tempest-VolumeRetypeWithoutMigrationTest-798819054 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:23:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1ef60a4f-d277-434a-a13b-00141b3e224e tempest-VolumeRetypeWithoutMigrationTest-798819054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:23:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1ef60a4f-d277-434a-a13b-00141b3e224e tempest-VolumeRetypeWithoutMigrationTest-798819054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21a3e4ec-aef4-4747-ab17-b71582c141af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5bba097-6311-4b5a-a423-fd5e36253d1b', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:23:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1ef60a4f-d277-434a-a13b-00141b3e224e tempest-VolumeRetypeWithoutMigrationTest-798819054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e775532-cf52-4ab3-84f1-49cae35f3428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:23:38 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-1ef60a4f-d277-434a-a13b-00141b3e224e tempest-VolumeRetypeWithoutMigrationTest-798819054 None] Volume volume-c5bba097-6311-4b5a-a423-fd5e36253d1b (c5bba097-6311-4b5a-a423-fd5e36253d1b): created successfully
Jul 14 16:23:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1ef60a4f-d277-434a-a13b-00141b3e224e tempest-VolumeRetypeWithoutMigrationTest-798819054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e775532-cf52-4ab3-84f1-49cae35f3428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:23:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1ef60a4f-d277-434a-a13b-00141b3e224e tempest-VolumeRetypeWithoutMigrationTest-798819054 None] Flow 'volume_create_manager' (66715d5d-d2e4-43ed-ab0d-5cacfb439bf3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:23:38 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-1ef60a4f-d277-434a-a13b-00141b3e224e tempest-VolumeRetypeWithoutMigrationTest-798819054 None] Created volume successfully.
Jul 14 16:23:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ed2a1875-eae9-495d-aed5-44f10cd26f7c tempest-VolumeRetypeWithoutMigrationTest-798819054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:23:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ed2a1875-eae9-495d-aed5-44f10cd26f7c tempest-VolumeRetypeWithoutMigrationTest-798819054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:23:40 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ed2a1875-eae9-495d-aed5-44f10cd26f7c tempest-VolumeRetypeWithoutMigrationTest-798819054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:23:40 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ed2a1875-eae9-495d-aed5-44f10cd26f7c tempest-VolumeRetypeWithoutMigrationTest-798819054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:23:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ed2a1875-eae9-495d-aed5-44f10cd26f7c tempest-VolumeRetypeWithoutMigrationTest-798819054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:23:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ed2a1875-eae9-495d-aed5-44f10cd26f7c tempest-VolumeRetypeWithoutMigrationTest-798819054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:23:40 devstack sudo[88244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:23:40 devstack sudo[88244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:23:40 devstack sudo[88244]: pam_unix(sudo:session): session closed for user root
Jul 14 16:23:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ed2a1875-eae9-495d-aed5-44f10cd26f7c tempest-VolumeRetypeWithoutMigrationTest-798819054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.552s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:23:40 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-ed2a1875-eae9-495d-aed5-44f10cd26f7c tempest-VolumeRetypeWithoutMigrationTest-798819054 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:23:40 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-ed2a1875-eae9-495d-aed5-44f10cd26f7c tempest-VolumeRetypeWithoutMigrationTest-798819054 None] Retype volume completed successfully.
Jul 14 16:23:42 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e87f8268-d7fd-4d63-9ed6-5f5034c74d1b tempest-VolumeRetypeWithoutMigrationTest-798819054 None] Acquiring lock "cinder-c5bba097-6311-4b5a-a423-fd5e36253d1b-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:23:42 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e87f8268-d7fd-4d63-9ed6-5f5034c74d1b tempest-VolumeRetypeWithoutMigrationTest-798819054 None] Lock "cinder-c5bba097-6311-4b5a-a423-fd5e36253d1b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:23:42 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e87f8268-d7fd-4d63-9ed6-5f5034c74d1b tempest-VolumeRetypeWithoutMigrationTest-798819054 None] Acquiring lock "cinder-quobyte-c5bba097-6311-4b5a-a423-fd5e36253d1b" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:23:42 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e87f8268-d7fd-4d63-9ed6-5f5034c74d1b tempest-VolumeRetypeWithoutMigrationTest-798819054 None] Lock "cinder-quobyte-c5bba097-6311-4b5a-a423-fd5e36253d1b" acquired by "delete_volume" :: waited 0.015s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:23:42 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[675d8704-d576-4ba2-a97b-b48f59de936d]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:23:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e87f8268-d7fd-4d63-9ed6-5f5034c74d1b tempest-VolumeRetypeWithoutMigrationTest-798819054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c5bba097-6311-4b5a-a423-fd5e36253d1b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:23:42 devstack sudo[88262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c5bba097-6311-4b5a-a423-fd5e36253d1b
Jul 14 16:23:42 devstack sudo[88262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:23:42 devstack sudo[88262]: pam_unix(sudo:session): session closed for user root
Jul 14 16:23:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e87f8268-d7fd-4d63-9ed6-5f5034c74d1b tempest-VolumeRetypeWithoutMigrationTest-798819054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c5bba097-6311-4b5a-a423-fd5e36253d1b" returned: 0 in 0.548s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:23:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e87f8268-d7fd-4d63-9ed6-5f5034c74d1b tempest-VolumeRetypeWithoutMigrationTest-798819054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c5bba097-6311-4b5a-a423-fd5e36253d1b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:23:42 devstack sudo[88267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c5bba097-6311-4b5a-a423-fd5e36253d1b
Jul 14 16:23:42 devstack sudo[88267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:23:43 devstack sudo[88267]: pam_unix(sudo:session): session closed for user root
Jul 14 16:23:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e87f8268-d7fd-4d63-9ed6-5f5034c74d1b tempest-VolumeRetypeWithoutMigrationTest-798819054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c5bba097-6311-4b5a-a423-fd5e36253d1b" returned: 0 in 0.414s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:23:43 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e87f8268-d7fd-4d63-9ed6-5f5034c74d1b tempest-VolumeRetypeWithoutMigrationTest-798819054 None] Lock "cinder-quobyte-c5bba097-6311-4b5a-a423-fd5e36253d1b" released by "delete_volume" :: held 1.025s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:23:43 devstack cinder-volume[87166]: WARNING cinder.quota [None req-e87f8268-d7fd-4d63-9ed6-5f5034c74d1b tempest-VolumeRetypeWithoutMigrationTest-798819054 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Jul 14 16:23:43 devstack cinder-volume[87166]: WARNING cinder.quota [None req-e87f8268-d7fd-4d63-9ed6-5f5034c74d1b tempest-VolumeRetypeWithoutMigrationTest-798819054 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Jul 14 16:23:43 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-e87f8268-d7fd-4d63-9ed6-5f5034c74d1b tempest-VolumeRetypeWithoutMigrationTest-798819054 None] Created reservations ['bc0247ac-38fd-4c43-81d5-8125db5fd5f9', '94ad23fc-8ae3-4237-a9e9-144b33b9bd29', '93818631-9508-406f-bfe1-5a9ef74f9875', '3ed02c3b-07e0-4946-ac8f-80812a327b74'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:23:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e87f8268-d7fd-4d63-9ed6-5f5034c74d1b tempest-VolumeRetypeWithoutMigrationTest-798819054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:23:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e87f8268-d7fd-4d63-9ed6-5f5034c74d1b tempest-VolumeRetypeWithoutMigrationTest-798819054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:23:43 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-e87f8268-d7fd-4d63-9ed6-5f5034c74d1b tempest-VolumeRetypeWithoutMigrationTest-798819054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:23:43 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-e87f8268-d7fd-4d63-9ed6-5f5034c74d1b tempest-VolumeRetypeWithoutMigrationTest-798819054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:23:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e87f8268-d7fd-4d63-9ed6-5f5034c74d1b tempest-VolumeRetypeWithoutMigrationTest-798819054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:23:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e87f8268-d7fd-4d63-9ed6-5f5034c74d1b tempest-VolumeRetypeWithoutMigrationTest-798819054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:23:43 devstack sudo[88271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:23:43 devstack sudo[88271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:23:43 devstack sudo[88271]: pam_unix(sudo:session): session closed for user root
Jul 14 16:23:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e87f8268-d7fd-4d63-9ed6-5f5034c74d1b tempest-VolumeRetypeWithoutMigrationTest-798819054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.458s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:23:43 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-e87f8268-d7fd-4d63-9ed6-5f5034c74d1b tempest-VolumeRetypeWithoutMigrationTest-798819054 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:23:43 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-e87f8268-d7fd-4d63-9ed6-5f5034c74d1b tempest-VolumeRetypeWithoutMigrationTest-798819054 None] Deleted volume successfully.
Jul 14 16:23:43 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e87f8268-d7fd-4d63-9ed6-5f5034c74d1b tempest-VolumeRetypeWithoutMigrationTest-798819054 None] Lock "cinder-c5bba097-6311-4b5a-a423-fd5e36253d1b-delete_volume" released by "delete_volume" :: held 1.838s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:23:46 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f4bb421-0da2-4573-9091-add068bf7523 tempest-DeleteServersTestJSON-1109951607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:23:46 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0f4bb421-0da2-4573-9091-add068bf7523 tempest-DeleteServersTestJSON-1109951607 None] Flow 'volume_create_manager' (9ff34e04-0319-4ab5-9c01-504e73f8810d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:23:46 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0f4bb421-0da2-4573-9091-add068bf7523 tempest-DeleteServersTestJSON-1109951607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d84de02-3a56-4978-945a-3abd6e0d5bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:23:46 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0f4bb421-0da2-4573-9091-add068bf7523 tempest-DeleteServersTestJSON-1109951607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d84de02-3a56-4978-945a-3abd6e0d5bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:23:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-674415709',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=519444c8-0d04-4557-af28-f80d692011ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='014c64b54cf34e9a8f76af741f161c78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:23:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:23:46Z,use_quota=True,user_id='6c167098b6ee44a380aad41900a33005',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:23:46 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0f4bb421-0da2-4573-9091-add068bf7523 tempest-DeleteServersTestJSON-1109951607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (541eed83-c331-46a4-af89-03249793dae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:23:46 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0f4bb421-0da2-4573-9091-add068bf7523 tempest-DeleteServersTestJSON-1109951607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (541eed83-c331-46a4-af89-03249793dae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:23:46 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0f4bb421-0da2-4573-9091-add068bf7523 tempest-DeleteServersTestJSON-1109951607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c2f8ac5-c8d9-44e4-9860-52ad4cc3a776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:23:46 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0f4bb421-0da2-4573-9091-add068bf7523 tempest-DeleteServersTestJSON-1109951607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c2f8ac5-c8d9-44e4-9860-52ad4cc3a776) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '519444c8-0d04-4557-af28-f80d692011ae', 'volume_name': 'volume-519444c8-0d04-4557-af28-f80d692011ae', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:23:46 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0f4bb421-0da2-4573-9091-add068bf7523 tempest-DeleteServersTestJSON-1109951607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5be63cac-2961-48af-994c-3a0a5e47e7e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:23:46 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0f4bb421-0da2-4573-9091-add068bf7523 tempest-DeleteServersTestJSON-1109951607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5be63cac-2961-48af-994c-3a0a5e47e7e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:23:46 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0f4bb421-0da2-4573-9091-add068bf7523 tempest-DeleteServersTestJSON-1109951607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba77196c-b1f8-4b7f-9d3a-d46afa6ae0a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:23:46 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-0f4bb421-0da2-4573-9091-add068bf7523 tempest-DeleteServersTestJSON-1109951607 None] Volume 519444c8-0d04-4557-af28-f80d692011ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-519444c8-0d04-4557-af28-f80d692011ae', 'volume_size': 1}
Jul 14 16:23:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0f4bb421-0da2-4573-9091-add068bf7523 tempest-DeleteServersTestJSON-1109951607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:23:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0f4bb421-0da2-4573-9091-add068bf7523 tempest-DeleteServersTestJSON-1109951607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:23:46 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0f4bb421-0da2-4573-9091-add068bf7523 tempest-DeleteServersTestJSON-1109951607 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:23:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-674415709',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=519444c8-0d04-4557-af28-f80d692011ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='014c64b54cf34e9a8f76af741f161c78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:23:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:23:46Z,use_quota=True,user_id='6c167098b6ee44a380aad41900a33005',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:23:46 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-0f4bb421-0da2-4573-9091-add068bf7523 tempest-DeleteServersTestJSON-1109951607 None] Creating volume 519444c8-0d04-4557-af28-f80d692011ae {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:23:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0f4bb421-0da2-4573-9091-add068bf7523 tempest-DeleteServersTestJSON-1109951607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:23:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0f4bb421-0da2-4573-9091-add068bf7523 tempest-DeleteServersTestJSON-1109951607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:23:46 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0f4bb421-0da2-4573-9091-add068bf7523 tempest-DeleteServersTestJSON-1109951607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:23:46 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0f4bb421-0da2-4573-9091-add068bf7523 tempest-DeleteServersTestJSON-1109951607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:23:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0f4bb421-0da2-4573-9091-add068bf7523 tempest-DeleteServersTestJSON-1109951607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:23:46 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0f4bb421-0da2-4573-9091-add068bf7523 tempest-DeleteServersTestJSON-1109951607 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:23:46 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-0f4bb421-0da2-4573-9091-add068bf7523 tempest-DeleteServersTestJSON-1109951607 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:23:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0f4bb421-0da2-4573-9091-add068bf7523 tempest-DeleteServersTestJSON-1109951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-519444c8-0d04-4557-af28-f80d692011ae 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:23:46 devstack sudo[88276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-519444c8-0d04-4557-af28-f80d692011ae 1073741824
Jul 14 16:23:46 devstack sudo[88276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:23:47 devstack sudo[88276]: pam_unix(sudo:session): session closed for user root
Jul 14 16:23:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0f4bb421-0da2-4573-9091-add068bf7523 tempest-DeleteServersTestJSON-1109951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-519444c8-0d04-4557-af28-f80d692011ae 1073741824" returned: 0 in 0.691s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:23:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0f4bb421-0da2-4573-9091-add068bf7523 tempest-DeleteServersTestJSON-1109951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-519444c8-0d04-4557-af28-f80d692011ae {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:23:47 devstack sudo[88281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-519444c8-0d04-4557-af28-f80d692011ae
Jul 14 16:23:47 devstack sudo[88281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:23:47 devstack sudo[88281]: pam_unix(sudo:session): session closed for user root
Jul 14 16:23:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0f4bb421-0da2-4573-9091-add068bf7523 tempest-DeleteServersTestJSON-1109951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-519444c8-0d04-4557-af28-f80d692011ae" returned: 0 in 0.503s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:23:47 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0f4bb421-0da2-4573-9091-add068bf7523 tempest-DeleteServersTestJSON-1109951607 None] <== create_volume: return (1278ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:23:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0f4bb421-0da2-4573-9091-add068bf7523 tempest-DeleteServersTestJSON-1109951607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.281s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:23:47 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0f4bb421-0da2-4573-9091-add068bf7523 tempest-DeleteServersTestJSON-1109951607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba77196c-b1f8-4b7f-9d3a-d46afa6ae0a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-519444c8-0d04-4557-af28-f80d692011ae', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:23:47 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0f4bb421-0da2-4573-9091-add068bf7523 tempest-DeleteServersTestJSON-1109951607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c3b9558-f00a-4b9b-bed5-4baeaa60e1cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:23:47 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-0f4bb421-0da2-4573-9091-add068bf7523 tempest-DeleteServersTestJSON-1109951607 None] Volume volume-519444c8-0d04-4557-af28-f80d692011ae (519444c8-0d04-4557-af28-f80d692011ae): created successfully
Jul 14 16:23:47 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0f4bb421-0da2-4573-9091-add068bf7523 tempest-DeleteServersTestJSON-1109951607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c3b9558-f00a-4b9b-bed5-4baeaa60e1cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:23:47 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0f4bb421-0da2-4573-9091-add068bf7523 tempest-DeleteServersTestJSON-1109951607 None] Flow 'volume_create_manager' (9ff34e04-0319-4ab5-9c01-504e73f8810d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:23:47 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-0f4bb421-0da2-4573-9091-add068bf7523 tempest-DeleteServersTestJSON-1109951607 None] Created volume successfully.
Jul 14 16:23:55 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-922289bc-aaf4-4eaf-8e43-68bde5651a15 tempest-VolumesServicesTestJSON-1267524101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:23:55 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-922289bc-aaf4-4eaf-8e43-68bde5651a15 tempest-VolumesServicesTestJSON-1267524101 None] Flow 'volume_create_manager' (4eaecf29-4a93-40a5-982a-21b3688a1c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:23:55 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-922289bc-aaf4-4eaf-8e43-68bde5651a15 tempest-VolumesServicesTestJSON-1267524101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9af15293-8fa0-4c62-a776-bb13b74f0806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:23:55 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-922289bc-aaf4-4eaf-8e43-68bde5651a15 tempest-VolumesServicesTestJSON-1267524101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9af15293-8fa0-4c62-a776-bb13b74f0806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:23:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-102148318',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dd83515-3b35-4e64-9fce-334c5aa51973,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b618f899b5c34fddb295bfffd0632dc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:23:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:23:55Z,use_quota=True,user_id='7eb47c27cfd9458c828c42e4ce01cf38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:23:55 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-922289bc-aaf4-4eaf-8e43-68bde5651a15 tempest-VolumesServicesTestJSON-1267524101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da74aa84-da67-439d-8b8f-2962a5c17abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:23:55 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-922289bc-aaf4-4eaf-8e43-68bde5651a15 tempest-VolumesServicesTestJSON-1267524101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da74aa84-da67-439d-8b8f-2962a5c17abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:23:55 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-922289bc-aaf4-4eaf-8e43-68bde5651a15 tempest-VolumesServicesTestJSON-1267524101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ef0948b-1d6e-40ec-9f4c-5945a3b6c984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:23:55 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-922289bc-aaf4-4eaf-8e43-68bde5651a15 tempest-VolumesServicesTestJSON-1267524101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ef0948b-1d6e-40ec-9f4c-5945a3b6c984) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7dd83515-3b35-4e64-9fce-334c5aa51973', 'volume_name': 'volume-7dd83515-3b35-4e64-9fce-334c5aa51973', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:23:55 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-922289bc-aaf4-4eaf-8e43-68bde5651a15 tempest-VolumesServicesTestJSON-1267524101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0670ccb-3bed-43dc-ac98-b26c98e6297b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:23:55 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-922289bc-aaf4-4eaf-8e43-68bde5651a15 tempest-VolumesServicesTestJSON-1267524101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0670ccb-3bed-43dc-ac98-b26c98e6297b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:23:55 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-922289bc-aaf4-4eaf-8e43-68bde5651a15 tempest-VolumesServicesTestJSON-1267524101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3b7075c-e71f-4609-a474-526401e4b29a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:23:55 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-922289bc-aaf4-4eaf-8e43-68bde5651a15 tempest-VolumesServicesTestJSON-1267524101 None] Volume 7dd83515-3b35-4e64-9fce-334c5aa51973: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7dd83515-3b35-4e64-9fce-334c5aa51973', 'volume_size': 1}
Jul 14 16:23:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-922289bc-aaf4-4eaf-8e43-68bde5651a15 tempest-VolumesServicesTestJSON-1267524101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:23:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-922289bc-aaf4-4eaf-8e43-68bde5651a15 tempest-VolumesServicesTestJSON-1267524101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:23:55 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-922289bc-aaf4-4eaf-8e43-68bde5651a15 tempest-VolumesServicesTestJSON-1267524101 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:23:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-102148318',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dd83515-3b35-4e64-9fce-334c5aa51973,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b618f899b5c34fddb295bfffd0632dc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:23:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:23:55Z,use_quota=True,user_id='7eb47c27cfd9458c828c42e4ce01cf38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:23:55 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-922289bc-aaf4-4eaf-8e43-68bde5651a15 tempest-VolumesServicesTestJSON-1267524101 None] Creating volume 7dd83515-3b35-4e64-9fce-334c5aa51973 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:23:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-922289bc-aaf4-4eaf-8e43-68bde5651a15 tempest-VolumesServicesTestJSON-1267524101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:23:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-922289bc-aaf4-4eaf-8e43-68bde5651a15 tempest-VolumesServicesTestJSON-1267524101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:23:55 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-922289bc-aaf4-4eaf-8e43-68bde5651a15 tempest-VolumesServicesTestJSON-1267524101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:23:55 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-922289bc-aaf4-4eaf-8e43-68bde5651a15 tempest-VolumesServicesTestJSON-1267524101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:23:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-922289bc-aaf4-4eaf-8e43-68bde5651a15 tempest-VolumesServicesTestJSON-1267524101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:23:55 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-922289bc-aaf4-4eaf-8e43-68bde5651a15 tempest-VolumesServicesTestJSON-1267524101 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:23:55 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-922289bc-aaf4-4eaf-8e43-68bde5651a15 tempest-VolumesServicesTestJSON-1267524101 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:23:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-922289bc-aaf4-4eaf-8e43-68bde5651a15 tempest-VolumesServicesTestJSON-1267524101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-7dd83515-3b35-4e64-9fce-334c5aa51973 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:23:55 devstack sudo[88437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-7dd83515-3b35-4e64-9fce-334c5aa51973 1073741824
Jul 14 16:23:55 devstack sudo[88437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:23:55 devstack cinder-volume[87166]: WARNING py.warnings [req-be32f3b2-d1dd-40fb-a1aa-9a9ff90eb1c5 req-2cf95944-e0bf-4c61-ba6f-cebd5b8bd0a6 tempest-TaggedAttachmentsTest-77102883 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes".  Apply join condition(s) between each element to resolve.
Jul 14 16:23:55 devstack cinder-volume[87166]:   .first()
Jul 14 16:23:55 devstack cinder-volume[87166]: 
Jul 14 16:23:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-be32f3b2-d1dd-40fb-a1aa-9a9ff90eb1c5 req-2cf95944-e0bf-4c61-ba6f-cebd5b8bd0a6 tempest-TaggedAttachmentsTest-77102883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:23:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-d327e536-1312-4a31-8bc1-251dfb4fb15b req-56a0cf1b-4694-434e-a0cb-8c946284a0e6 tempest-DeleteServersTestJSON-1109951607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:23:55 devstack sudo[88437]: pam_unix(sudo:session): session closed for user root
Jul 14 16:23:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-922289bc-aaf4-4eaf-8e43-68bde5651a15 tempest-VolumesServicesTestJSON-1267524101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-7dd83515-3b35-4e64-9fce-334c5aa51973 1073741824" returned: 0 in 0.573s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:23:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-922289bc-aaf4-4eaf-8e43-68bde5651a15 tempest-VolumesServicesTestJSON-1267524101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-7dd83515-3b35-4e64-9fce-334c5aa51973 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:23:56 devstack sudo[88454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-7dd83515-3b35-4e64-9fce-334c5aa51973
Jul 14 16:23:56 devstack sudo[88454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:23:56 devstack sudo[88454]: pam_unix(sudo:session): session closed for user root
Jul 14 16:23:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-922289bc-aaf4-4eaf-8e43-68bde5651a15 tempest-VolumesServicesTestJSON-1267524101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-7dd83515-3b35-4e64-9fce-334c5aa51973" returned: 0 in 0.286s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:23:56 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-922289bc-aaf4-4eaf-8e43-68bde5651a15 tempest-VolumesServicesTestJSON-1267524101 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:23:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-922289bc-aaf4-4eaf-8e43-68bde5651a15 tempest-VolumesServicesTestJSON-1267524101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:23:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-be32f3b2-d1dd-40fb-a1aa-9a9ff90eb1c5 req-2cf95944-e0bf-4c61-ba6f-cebd5b8bd0a6 tempest-TaggedAttachmentsTest-77102883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.515s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:23:56 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-922289bc-aaf4-4eaf-8e43-68bde5651a15 tempest-VolumesServicesTestJSON-1267524101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3b7075c-e71f-4609-a474-526401e4b29a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7dd83515-3b35-4e64-9fce-334c5aa51973', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:23:56 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-922289bc-aaf4-4eaf-8e43-68bde5651a15 tempest-VolumesServicesTestJSON-1267524101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18f91f89-608c-4990-8922-63a96828a800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:23:56 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b22e49-1c6c-44d4-964f-4efaf01c8702]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:23:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-be32f3b2-d1dd-40fb-a1aa-9a9ff90eb1c5 req-2cf95944-e0bf-4c61-ba6f-cebd5b8bd0a6 tempest-TaggedAttachmentsTest-77102883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-035a2faf-7d96-4f01-b964-2db415638fbf {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:23:56 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-922289bc-aaf4-4eaf-8e43-68bde5651a15 tempest-VolumesServicesTestJSON-1267524101 None] Volume volume-7dd83515-3b35-4e64-9fce-334c5aa51973 (7dd83515-3b35-4e64-9fce-334c5aa51973): created successfully
Jul 14 16:23:56 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-922289bc-aaf4-4eaf-8e43-68bde5651a15 tempest-VolumesServicesTestJSON-1267524101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18f91f89-608c-4990-8922-63a96828a800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:23:56 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-922289bc-aaf4-4eaf-8e43-68bde5651a15 tempest-VolumesServicesTestJSON-1267524101 None] Flow 'volume_create_manager' (4eaecf29-4a93-40a5-982a-21b3688a1c16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:23:56 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-922289bc-aaf4-4eaf-8e43-68bde5651a15 tempest-VolumesServicesTestJSON-1267524101 None] Created volume successfully.
Jul 14 16:23:56 devstack sudo[88457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-035a2faf-7d96-4f01-b964-2db415638fbf
Jul 14 16:23:56 devstack sudo[88457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:23:56 devstack sudo[88457]: pam_unix(sudo:session): session closed for user root
Jul 14 16:23:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-be32f3b2-d1dd-40fb-a1aa-9a9ff90eb1c5 req-2cf95944-e0bf-4c61-ba6f-cebd5b8bd0a6 tempest-TaggedAttachmentsTest-77102883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-035a2faf-7d96-4f01-b964-2db415638fbf" returned: 0 in 0.387s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:23:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-be32f3b2-d1dd-40fb-a1aa-9a9ff90eb1c5 req-2cf95944-e0bf-4c61-ba6f-cebd5b8bd0a6 tempest-TaggedAttachmentsTest-77102883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.419s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:23:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-d327e536-1312-4a31-8bc1-251dfb4fb15b req-56a0cf1b-4694-434e-a0cb-8c946284a0e6 tempest-DeleteServersTestJSON-1109951607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.932s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:23:56 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab444abb-a021-4b95-9a37-af143fd99b87]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:23:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-d327e536-1312-4a31-8bc1-251dfb4fb15b req-56a0cf1b-4694-434e-a0cb-8c946284a0e6 tempest-DeleteServersTestJSON-1109951607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-519444c8-0d04-4557-af28-f80d692011ae {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:23:56 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-be32f3b2-d1dd-40fb-a1aa-9a9ff90eb1c5 req-2cf95944-e0bf-4c61-ba6f-cebd5b8bd0a6 tempest-TaggedAttachmentsTest-77102883 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052', 'name': 'volume-035a2faf-7d96-4f01-b964-2db415638fbf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bd9c516d-c0fa-42a6-b583-83cd541f33e1', 'enforce_multipath': True} {{(pid=87166) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 14 16:23:56 devstack sudo[88462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-519444c8-0d04-4557-af28-f80d692011ae
Jul 14 16:23:56 devstack sudo[88462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:23:56 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-be32f3b2-d1dd-40fb-a1aa-9a9ff90eb1c5 req-2cf95944-e0bf-4c61-ba6f-cebd5b8bd0a6 tempest-TaggedAttachmentsTest-77102883 None] attachment_update completed successfully.
Jul 14 16:23:57 devstack sudo[88462]: pam_unix(sudo:session): session closed for user root
Jul 14 16:23:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-d327e536-1312-4a31-8bc1-251dfb4fb15b req-56a0cf1b-4694-434e-a0cb-8c946284a0e6 tempest-DeleteServersTestJSON-1109951607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-519444c8-0d04-4557-af28-f80d692011ae" returned: 0 in 0.425s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:23:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-d327e536-1312-4a31-8bc1-251dfb4fb15b req-56a0cf1b-4694-434e-a0cb-8c946284a0e6 tempest-DeleteServersTestJSON-1109951607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.446s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:23:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-d327e536-1312-4a31-8bc1-251dfb4fb15b req-56a0cf1b-4694-434e-a0cb-8c946284a0e6 tempest-DeleteServersTestJSON-1109951607 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052', 'name': 'volume-519444c8-0d04-4557-af28-f80d692011ae', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0caaefc8-f5ca-440b-bdba-ea3732f4d58b', 'enforce_multipath': True} {{(pid=87166) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 14 16:23:57 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-d327e536-1312-4a31-8bc1-251dfb4fb15b req-56a0cf1b-4694-434e-a0cb-8c946284a0e6 tempest-DeleteServersTestJSON-1109951607 None] attachment_update completed successfully.
Jul 14 16:23:57 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4b38dad4-b8fb-4775-b183-767887292d7c tempest-VolumesServicesTestJSON-1267524101 None] Acquiring lock "cinder-7dd83515-3b35-4e64-9fce-334c5aa51973-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:23:57 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4b38dad4-b8fb-4775-b183-767887292d7c tempest-VolumesServicesTestJSON-1267524101 None] Lock "cinder-7dd83515-3b35-4e64-9fce-334c5aa51973-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:23:57 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4b38dad4-b8fb-4775-b183-767887292d7c tempest-VolumesServicesTestJSON-1267524101 None] Acquiring lock "cinder-quobyte-7dd83515-3b35-4e64-9fce-334c5aa51973" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:23:57 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4b38dad4-b8fb-4775-b183-767887292d7c tempest-VolumesServicesTestJSON-1267524101 None] Lock "cinder-quobyte-7dd83515-3b35-4e64-9fce-334c5aa51973" acquired by "delete_volume" :: waited 0.022s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:23:57 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[a151a7a6-4abd-47b0-b05c-f62d8db2b9a4]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:23:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4b38dad4-b8fb-4775-b183-767887292d7c tempest-VolumesServicesTestJSON-1267524101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-7dd83515-3b35-4e64-9fce-334c5aa51973 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:23:57 devstack sudo[88854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-7dd83515-3b35-4e64-9fce-334c5aa51973
Jul 14 16:23:57 devstack sudo[88854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:23:58 devstack sudo[88854]: pam_unix(sudo:session): session closed for user root
Jul 14 16:23:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4b38dad4-b8fb-4775-b183-767887292d7c tempest-VolumesServicesTestJSON-1267524101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-7dd83515-3b35-4e64-9fce-334c5aa51973" returned: 0 in 0.664s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:23:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4b38dad4-b8fb-4775-b183-767887292d7c tempest-VolumesServicesTestJSON-1267524101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-7dd83515-3b35-4e64-9fce-334c5aa51973 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:23:58 devstack sudo[88859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-7dd83515-3b35-4e64-9fce-334c5aa51973
Jul 14 16:23:58 devstack sudo[88859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:23:58 devstack sudo[88859]: pam_unix(sudo:session): session closed for user root
Jul 14 16:23:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4b38dad4-b8fb-4775-b183-767887292d7c tempest-VolumesServicesTestJSON-1267524101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-7dd83515-3b35-4e64-9fce-334c5aa51973" returned: 0 in 0.246s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:23:58 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4b38dad4-b8fb-4775-b183-767887292d7c tempest-VolumesServicesTestJSON-1267524101 None] Lock "cinder-quobyte-7dd83515-3b35-4e64-9fce-334c5aa51973" released by "delete_volume" :: held 0.970s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:23:58 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-4b38dad4-b8fb-4775-b183-767887292d7c tempest-VolumesServicesTestJSON-1267524101 None] Created reservations ['1f65e4da-7533-4aa2-b836-6af09410da2e', '5cc345bb-83f4-440a-a438-ab14232c19a8', 'cd6c0384-b3f5-4d7e-a71b-f2ace5d80a33', '53cee8c8-d840-4745-9b9d-a4854a47a12a'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:23:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-4b38dad4-b8fb-4775-b183-767887292d7c tempest-VolumesServicesTestJSON-1267524101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:23:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-4b38dad4-b8fb-4775-b183-767887292d7c tempest-VolumesServicesTestJSON-1267524101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:23:58 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-4b38dad4-b8fb-4775-b183-767887292d7c tempest-VolumesServicesTestJSON-1267524101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:23:58 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-4b38dad4-b8fb-4775-b183-767887292d7c tempest-VolumesServicesTestJSON-1267524101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:23:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-4b38dad4-b8fb-4775-b183-767887292d7c tempest-VolumesServicesTestJSON-1267524101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:23:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4b38dad4-b8fb-4775-b183-767887292d7c tempest-VolumesServicesTestJSON-1267524101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:23:58 devstack sudo[88863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:23:58 devstack sudo[88863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:23:59 devstack sudo[88863]: pam_unix(sudo:session): session closed for user root
Jul 14 16:23:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4b38dad4-b8fb-4775-b183-767887292d7c tempest-VolumesServicesTestJSON-1267524101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.243s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:23:59 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-4b38dad4-b8fb-4775-b183-767887292d7c tempest-VolumesServicesTestJSON-1267524101 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:23:59 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-4b38dad4-b8fb-4775-b183-767887292d7c tempest-VolumesServicesTestJSON-1267524101 None] Deleted volume successfully.
Jul 14 16:23:59 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4b38dad4-b8fb-4775-b183-767887292d7c tempest-VolumesServicesTestJSON-1267524101 None] Lock "cinder-7dd83515-3b35-4e64-9fce-334c5aa51973-delete_volume" released by "delete_volume" :: held 1.499s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:24:01 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-9a730536-164b-48cb-9829-247bfbd0f491 req-60f4bbde-eb3d-44b5-8820-50168c084252 tempest-DeleteServersTestJSON-1109951607 None] Terminate volume connection completed successfully.
Jul 14 16:24:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-9a730536-164b-48cb-9829-247bfbd0f491 req-60f4bbde-eb3d-44b5-8820-50168c084252 tempest-DeleteServersTestJSON-1109951607 None] Deleting attachment 0caaefc8-f5ca-440b-bdba-ea3732f4d58b. {{(pid=87166) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 14 16:24:03 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-8d9ce145-b6c2-4cd7-a309-f417916164a6 req-5cfc8ae2-2d5c-441a-8639-5c5d1fa7faf2 tempest-TaggedAttachmentsTest-77102883 None] Terminate volume connection completed successfully.
Jul 14 16:24:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-8d9ce145-b6c2-4cd7-a309-f417916164a6 req-5cfc8ae2-2d5c-441a-8639-5c5d1fa7faf2 tempest-TaggedAttachmentsTest-77102883 None] Deleting attachment bd9c516d-c0fa-42a6-b583-83cd541f33e1. {{(pid=87166) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 14 16:24:03 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-cce085a0-9159-432d-b7ab-589b7e0d7de1 tempest-DeleteServersTestJSON-1109951607 None] Acquiring lock "cinder-519444c8-0d04-4557-af28-f80d692011ae-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:24:03 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-cce085a0-9159-432d-b7ab-589b7e0d7de1 tempest-DeleteServersTestJSON-1109951607 None] Lock "cinder-519444c8-0d04-4557-af28-f80d692011ae-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:24:03 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-cce085a0-9159-432d-b7ab-589b7e0d7de1 tempest-DeleteServersTestJSON-1109951607 None] Acquiring lock "cinder-quobyte-519444c8-0d04-4557-af28-f80d692011ae" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:24:03 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-cce085a0-9159-432d-b7ab-589b7e0d7de1 tempest-DeleteServersTestJSON-1109951607 None] Lock "cinder-quobyte-519444c8-0d04-4557-af28-f80d692011ae" acquired by "delete_volume" :: waited 0.022s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:24:03 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[c611624f-4a59-44da-86d6-28dcd23ea40d]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:24:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cce085a0-9159-432d-b7ab-589b7e0d7de1 tempest-DeleteServersTestJSON-1109951607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-519444c8-0d04-4557-af28-f80d692011ae {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:24:04 devstack sudo[88952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-519444c8-0d04-4557-af28-f80d692011ae
Jul 14 16:24:04 devstack sudo[88952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:24:04 devstack sudo[88952]: pam_unix(sudo:session): session closed for user root
Jul 14 16:24:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cce085a0-9159-432d-b7ab-589b7e0d7de1 tempest-DeleteServersTestJSON-1109951607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-519444c8-0d04-4557-af28-f80d692011ae" returned: 0 in 0.691s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:24:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cce085a0-9159-432d-b7ab-589b7e0d7de1 tempest-DeleteServersTestJSON-1109951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-519444c8-0d04-4557-af28-f80d692011ae {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:24:04 devstack sudo[88966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-519444c8-0d04-4557-af28-f80d692011ae
Jul 14 16:24:04 devstack sudo[88966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:24:05 devstack sudo[88966]: pam_unix(sudo:session): session closed for user root
Jul 14 16:24:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cce085a0-9159-432d-b7ab-589b7e0d7de1 tempest-DeleteServersTestJSON-1109951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-519444c8-0d04-4557-af28-f80d692011ae" returned: 0 in 0.648s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:24:05 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-cce085a0-9159-432d-b7ab-589b7e0d7de1 tempest-DeleteServersTestJSON-1109951607 None] Lock "cinder-quobyte-519444c8-0d04-4557-af28-f80d692011ae" released by "delete_volume" :: held 1.423s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:24:05 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-cce085a0-9159-432d-b7ab-589b7e0d7de1 tempest-DeleteServersTestJSON-1109951607 None] Created reservations ['112e3bd9-a4ac-456b-85d7-648a5b443f89', '278f469b-f1ec-46ce-b355-7ce98bb1a776', 'c4e75de4-11ff-42f4-aa59-ed29a5c53260', 'ff34ad9d-3bfb-4ad7-a903-8b73a941da7c'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:24:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cce085a0-9159-432d-b7ab-589b7e0d7de1 tempest-DeleteServersTestJSON-1109951607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:24:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cce085a0-9159-432d-b7ab-589b7e0d7de1 tempest-DeleteServersTestJSON-1109951607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:24:05 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-cce085a0-9159-432d-b7ab-589b7e0d7de1 tempest-DeleteServersTestJSON-1109951607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:24:05 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-cce085a0-9159-432d-b7ab-589b7e0d7de1 tempest-DeleteServersTestJSON-1109951607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:24:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cce085a0-9159-432d-b7ab-589b7e0d7de1 tempest-DeleteServersTestJSON-1109951607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:24:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cce085a0-9159-432d-b7ab-589b7e0d7de1 tempest-DeleteServersTestJSON-1109951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:24:05 devstack sudo[88986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:24:05 devstack sudo[88986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:24:05 devstack sudo[88986]: pam_unix(sudo:session): session closed for user root
Jul 14 16:24:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cce085a0-9159-432d-b7ab-589b7e0d7de1 tempest-DeleteServersTestJSON-1109951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.448s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:24:05 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-cce085a0-9159-432d-b7ab-589b7e0d7de1 tempest-DeleteServersTestJSON-1109951607 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:24:05 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-cce085a0-9159-432d-b7ab-589b7e0d7de1 tempest-DeleteServersTestJSON-1109951607 None] Deleted volume successfully.
Jul 14 16:24:06 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-cce085a0-9159-432d-b7ab-589b7e0d7de1 tempest-DeleteServersTestJSON-1109951607 None] Lock "cinder-519444c8-0d04-4557-af28-f80d692011ae-delete_volume" released by "delete_volume" :: held 2.207s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:24:15 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:UPDATE=46,cinder:SELECT=38,cinder:INSERT=6,cinder:DELETE=4 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 16:24:16 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:SELECT=45,cinder:UPDATE=36,cinder:INSERT=9,cinder:DELETE=2 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 16:24:21 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca21c648-a731-4a3a-a6a2-24e2b227c765 tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:24:21 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ca21c648-a731-4a3a-a6a2-24e2b227c765 tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] Flow 'volume_create_manager' (d943f515-72d0-433a-ba29-110c87b7e9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:24:21 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ca21c648-a731-4a3a-a6a2-24e2b227c765 tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3240d7a6-ede3-4a27-97bc-2b7f272c8a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:24:21 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ca21c648-a731-4a3a-a6a2-24e2b227c765 tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3240d7a6-ede3-4a27-97bc-2b7f272c8a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:24:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1970542569',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=655027c5-5bb0-459c-8dee-7c294c2601aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a121e0273b74bf6aa57c23326b10d6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:24:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:24:21Z,use_quota=True,user_id='e046119cc7f745d39635de47795e0bdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:24:21 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ca21c648-a731-4a3a-a6a2-24e2b227c765 tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac605d2d-dcd5-4f4c-b599-89325f0c8134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:24:21 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ca21c648-a731-4a3a-a6a2-24e2b227c765 tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac605d2d-dcd5-4f4c-b599-89325f0c8134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:24:21 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ca21c648-a731-4a3a-a6a2-24e2b227c765 tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d01480ad-6d57-4c04-a715-27a2bacfef41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:24:21 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ca21c648-a731-4a3a-a6a2-24e2b227c765 tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d01480ad-6d57-4c04-a715-27a2bacfef41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '655027c5-5bb0-459c-8dee-7c294c2601aa', 'volume_name': 'volume-655027c5-5bb0-459c-8dee-7c294c2601aa', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:24:21 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ca21c648-a731-4a3a-a6a2-24e2b227c765 tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47d99334-2c84-44a7-96f2-776c6120bacb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:24:21 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ca21c648-a731-4a3a-a6a2-24e2b227c765 tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47d99334-2c84-44a7-96f2-776c6120bacb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:24:21 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ca21c648-a731-4a3a-a6a2-24e2b227c765 tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c52edfd9-452a-4ce6-a903-621ba7700ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:24:21 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-ca21c648-a731-4a3a-a6a2-24e2b227c765 tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] Volume 655027c5-5bb0-459c-8dee-7c294c2601aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-655027c5-5bb0-459c-8dee-7c294c2601aa', 'volume_size': 1}
Jul 14 16:24:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ca21c648-a731-4a3a-a6a2-24e2b227c765 tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:24:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ca21c648-a731-4a3a-a6a2-24e2b227c765 tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:24:21 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ca21c648-a731-4a3a-a6a2-24e2b227c765 tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:24:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1970542569',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=655027c5-5bb0-459c-8dee-7c294c2601aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a121e0273b74bf6aa57c23326b10d6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:24:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:24:21Z,use_quota=True,user_id='e046119cc7f745d39635de47795e0bdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:24:21 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-ca21c648-a731-4a3a-a6a2-24e2b227c765 tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] Creating volume 655027c5-5bb0-459c-8dee-7c294c2601aa {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:24:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ca21c648-a731-4a3a-a6a2-24e2b227c765 tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:24:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ca21c648-a731-4a3a-a6a2-24e2b227c765 tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:24:21 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ca21c648-a731-4a3a-a6a2-24e2b227c765 tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:24:21 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ca21c648-a731-4a3a-a6a2-24e2b227c765 tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:24:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ca21c648-a731-4a3a-a6a2-24e2b227c765 tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:24:21 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ca21c648-a731-4a3a-a6a2-24e2b227c765 tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:24:21 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-ca21c648-a731-4a3a-a6a2-24e2b227c765 tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:24:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ca21c648-a731-4a3a-a6a2-24e2b227c765 tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-655027c5-5bb0-459c-8dee-7c294c2601aa 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:24:21 devstack sudo[89173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-655027c5-5bb0-459c-8dee-7c294c2601aa 1073741824
Jul 14 16:24:21 devstack sudo[89173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:24:22 devstack sudo[89173]: pam_unix(sudo:session): session closed for user root
Jul 14 16:24:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ca21c648-a731-4a3a-a6a2-24e2b227c765 tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-655027c5-5bb0-459c-8dee-7c294c2601aa 1073741824" returned: 0 in 0.662s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:24:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ca21c648-a731-4a3a-a6a2-24e2b227c765 tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-655027c5-5bb0-459c-8dee-7c294c2601aa {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:24:22 devstack sudo[89190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-655027c5-5bb0-459c-8dee-7c294c2601aa
Jul 14 16:24:22 devstack sudo[89190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:24:22 devstack sudo[89190]: pam_unix(sudo:session): session closed for user root
Jul 14 16:24:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ca21c648-a731-4a3a-a6a2-24e2b227c765 tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-655027c5-5bb0-459c-8dee-7c294c2601aa" returned: 0 in 0.588s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:24:22 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ca21c648-a731-4a3a-a6a2-24e2b227c765 tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] <== create_volume: return (1337ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:24:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ca21c648-a731-4a3a-a6a2-24e2b227c765 tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.340s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:24:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ca21c648-a731-4a3a-a6a2-24e2b227c765 tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c52edfd9-452a-4ce6-a903-621ba7700ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-655027c5-5bb0-459c-8dee-7c294c2601aa', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:24:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ca21c648-a731-4a3a-a6a2-24e2b227c765 tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bee33d9-377e-4cfd-836d-1cf0a4561b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:24:22 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-ca21c648-a731-4a3a-a6a2-24e2b227c765 tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] Volume volume-655027c5-5bb0-459c-8dee-7c294c2601aa (655027c5-5bb0-459c-8dee-7c294c2601aa): created successfully
Jul 14 16:24:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ca21c648-a731-4a3a-a6a2-24e2b227c765 tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bee33d9-377e-4cfd-836d-1cf0a4561b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:24:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ca21c648-a731-4a3a-a6a2-24e2b227c765 tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] Flow 'volume_create_manager' (d943f515-72d0-433a-ba29-110c87b7e9bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:24:22 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-ca21c648-a731-4a3a-a6a2-24e2b227c765 tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] Created volume successfully.
Jul 14 16:24:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e043542c-4ff4-471f-a3b7-faf4cee2a7c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:24:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e043542c-4ff4-471f-a3b7-faf4cee2a7c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:24:23 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-e043542c-4ff4-471f-a3b7-faf4cee2a7c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] Creating offline snapshot e963392d-8225-4f41-9558-8ce0e98cfe1c of volume 655027c5-5bb0-459c-8dee-7c294c2601aa {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 16:24:23 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7bf830-1379-44f9-b66b-9e3df25f23c3]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:24:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e043542c-4ff4-471f-a3b7-faf4cee2a7c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-655027c5-5bb0-459c-8dee-7c294c2601aa {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:24:23 devstack sudo[89214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-655027c5-5bb0-459c-8dee-7c294c2601aa
Jul 14 16:24:23 devstack sudo[89214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:24:24 devstack sudo[89214]: pam_unix(sudo:session): session closed for user root
Jul 14 16:24:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e043542c-4ff4-471f-a3b7-faf4cee2a7c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-655027c5-5bb0-459c-8dee-7c294c2601aa" returned: 0 in 0.790s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:24:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e043542c-4ff4-471f-a3b7-faf4cee2a7c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-655027c5-5bb0-459c-8dee-7c294c2601aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-655027c5-5bb0-459c-8dee-7c294c2601aa.e963392d-8225-4f41-9558-8ce0e98cfe1c 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:24:24 devstack sudo[89220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-655027c5-5bb0-459c-8dee-7c294c2601aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-655027c5-5bb0-459c-8dee-7c294c2601aa.e963392d-8225-4f41-9558-8ce0e98cfe1c 1G
Jul 14 16:24:24 devstack sudo[89220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:24:25 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d766bacc-b7c2-4926-976a-1715503c4f5b tempest-TaggedAttachmentsTest-77102883 None] Acquiring lock "cinder-035a2faf-7d96-4f01-b964-2db415638fbf-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:24:25 devstack sudo[89220]: pam_unix(sudo:session): session closed for user root
Jul 14 16:24:25 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d766bacc-b7c2-4926-976a-1715503c4f5b tempest-TaggedAttachmentsTest-77102883 None] Lock "cinder-035a2faf-7d96-4f01-b964-2db415638fbf-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:24:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e043542c-4ff4-471f-a3b7-faf4cee2a7c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-655027c5-5bb0-459c-8dee-7c294c2601aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-655027c5-5bb0-459c-8dee-7c294c2601aa.e963392d-8225-4f41-9558-8ce0e98cfe1c 1G" returned: 0 in 0.749s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:24:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e043542c-4ff4-471f-a3b7-faf4cee2a7c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-655027c5-5bb0-459c-8dee-7c294c2601aa -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-655027c5-5bb0-459c-8dee-7c294c2601aa.e963392d-8225-4f41-9558-8ce0e98cfe1c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:24:25 devstack sudo[89227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-655027c5-5bb0-459c-8dee-7c294c2601aa -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-655027c5-5bb0-459c-8dee-7c294c2601aa.e963392d-8225-4f41-9558-8ce0e98cfe1c
Jul 14 16:24:25 devstack sudo[89227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:24:25 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d766bacc-b7c2-4926-976a-1715503c4f5b tempest-TaggedAttachmentsTest-77102883 None] Acquiring lock "cinder-quobyte-035a2faf-7d96-4f01-b964-2db415638fbf" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:24:25 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d766bacc-b7c2-4926-976a-1715503c4f5b tempest-TaggedAttachmentsTest-77102883 None] Lock "cinder-quobyte-035a2faf-7d96-4f01-b964-2db415638fbf" acquired by "delete_volume" :: waited 0.039s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:24:25 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[637d3b44-fa06-4c06-b2b3-425404576aef]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:24:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d766bacc-b7c2-4926-976a-1715503c4f5b tempest-TaggedAttachmentsTest-77102883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-035a2faf-7d96-4f01-b964-2db415638fbf {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:24:25 devstack sudo[89231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-035a2faf-7d96-4f01-b964-2db415638fbf
Jul 14 16:24:25 devstack sudo[89231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:24:25 devstack sudo[89227]: pam_unix(sudo:session): session closed for user root
Jul 14 16:24:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e043542c-4ff4-471f-a3b7-faf4cee2a7c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-655027c5-5bb0-459c-8dee-7c294c2601aa -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-655027c5-5bb0-459c-8dee-7c294c2601aa.e963392d-8225-4f41-9558-8ce0e98cfe1c" returned: 0 in 0.467s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:24:25 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-e043542c-4ff4-471f-a3b7-faf4cee2a7c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-655027c5-5bb0-459c-8dee-7c294c2601aa.e963392d-8225-4f41-9558-8ce0e98cfe1c is being set with open permissions: ugo+rw
Jul 14 16:24:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e043542c-4ff4-471f-a3b7-faf4cee2a7c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-655027c5-5bb0-459c-8dee-7c294c2601aa.e963392d-8225-4f41-9558-8ce0e98cfe1c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:24:25 devstack sudo[89234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-655027c5-5bb0-459c-8dee-7c294c2601aa.e963392d-8225-4f41-9558-8ce0e98cfe1c
Jul 14 16:24:25 devstack sudo[89234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:24:26 devstack sudo[89231]: pam_unix(sudo:session): session closed for user root
Jul 14 16:24:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d766bacc-b7c2-4926-976a-1715503c4f5b tempest-TaggedAttachmentsTest-77102883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-035a2faf-7d96-4f01-b964-2db415638fbf" returned: 0 in 0.496s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:24:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d766bacc-b7c2-4926-976a-1715503c4f5b tempest-TaggedAttachmentsTest-77102883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-035a2faf-7d96-4f01-b964-2db415638fbf {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:24:26 devstack sudo[89239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-035a2faf-7d96-4f01-b964-2db415638fbf
Jul 14 16:24:26 devstack sudo[89239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:24:26 devstack sudo[89234]: pam_unix(sudo:session): session closed for user root
Jul 14 16:24:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e043542c-4ff4-471f-a3b7-faf4cee2a7c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-655027c5-5bb0-459c-8dee-7c294c2601aa.e963392d-8225-4f41-9558-8ce0e98cfe1c" returned: 0 in 0.643s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:24:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e043542c-4ff4-471f-a3b7-faf4cee2a7c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-655027c5-5bb0-459c-8dee-7c294c2601aa.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:24:26 devstack sudo[89265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-655027c5-5bb0-459c-8dee-7c294c2601aa.info
Jul 14 16:24:26 devstack sudo[89265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:24:26 devstack sudo[89239]: pam_unix(sudo:session): session closed for user root
Jul 14 16:24:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d766bacc-b7c2-4926-976a-1715503c4f5b tempest-TaggedAttachmentsTest-77102883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-035a2faf-7d96-4f01-b964-2db415638fbf" returned: 0 in 0.520s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:24:26 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d766bacc-b7c2-4926-976a-1715503c4f5b tempest-TaggedAttachmentsTest-77102883 None] Lock "cinder-quobyte-035a2faf-7d96-4f01-b964-2db415638fbf" released by "delete_volume" :: held 1.097s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:24:26 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-d766bacc-b7c2-4926-976a-1715503c4f5b tempest-TaggedAttachmentsTest-77102883 None] Created reservations ['86146ac4-3673-4ea4-a446-f1d942d1a50e', '59b753ed-ab18-4446-92c6-83509c3f1785', 'cfb348ec-540b-4ee1-8dcd-3a28d4daa766', 'b248a3f2-2e85-49ed-a9cb-57fb46beaed9'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:24:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d766bacc-b7c2-4926-976a-1715503c4f5b tempest-TaggedAttachmentsTest-77102883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:24:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d766bacc-b7c2-4926-976a-1715503c4f5b tempest-TaggedAttachmentsTest-77102883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:24:26 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d766bacc-b7c2-4926-976a-1715503c4f5b tempest-TaggedAttachmentsTest-77102883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:24:26 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d766bacc-b7c2-4926-976a-1715503c4f5b tempest-TaggedAttachmentsTest-77102883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:24:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d766bacc-b7c2-4926-976a-1715503c4f5b tempest-TaggedAttachmentsTest-77102883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:24:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d766bacc-b7c2-4926-976a-1715503c4f5b tempest-TaggedAttachmentsTest-77102883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:24:26 devstack sudo[89267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:24:26 devstack sudo[89267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:24:27 devstack sudo[89265]: pam_unix(sudo:session): session closed for user root
Jul 14 16:24:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e043542c-4ff4-471f-a3b7-faf4cee2a7c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-655027c5-5bb0-459c-8dee-7c294c2601aa.info" returned: 0 in 0.558s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:24:27 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-e043542c-4ff4-471f-a3b7-faf4cee2a7c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-655027c5-5bb0-459c-8dee-7c294c2601aa.info is being set with open permissions: ugo+rw
Jul 14 16:24:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e043542c-4ff4-471f-a3b7-faf4cee2a7c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-655027c5-5bb0-459c-8dee-7c294c2601aa.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:24:27 devstack sudo[89270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-655027c5-5bb0-459c-8dee-7c294c2601aa.info
Jul 14 16:24:27 devstack sudo[89270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:24:27 devstack sudo[89267]: pam_unix(sudo:session): session closed for user root
Jul 14 16:24:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d766bacc-b7c2-4926-976a-1715503c4f5b tempest-TaggedAttachmentsTest-77102883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.444s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:24:27 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-d766bacc-b7c2-4926-976a-1715503c4f5b tempest-TaggedAttachmentsTest-77102883 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:24:27 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-d766bacc-b7c2-4926-976a-1715503c4f5b tempest-TaggedAttachmentsTest-77102883 None] Deleted volume successfully.
Jul 14 16:24:27 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d766bacc-b7c2-4926-976a-1715503c4f5b tempest-TaggedAttachmentsTest-77102883 None] Lock "cinder-035a2faf-7d96-4f01-b964-2db415638fbf-delete_volume" released by "delete_volume" :: held 2.130s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:24:27 devstack sudo[89270]: pam_unix(sudo:session): session closed for user root
Jul 14 16:24:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e043542c-4ff4-471f-a3b7-faf4cee2a7c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-655027c5-5bb0-459c-8dee-7c294c2601aa.info" returned: 0 in 0.541s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:24:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e043542c-4ff4-471f-a3b7-faf4cee2a7c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.947s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:24:27 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-e043542c-4ff4-471f-a3b7-faf4cee2a7c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] Create snapshot completed successfully
Jul 14 16:24:27 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-ced36251-5a52-4726-aea5-5ee8d90cdcff tempest-ServerRescueNegativeTestJSON-1623986740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:24:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ced36251-5a52-4726-aea5-5ee8d90cdcff tempest-ServerRescueNegativeTestJSON-1623986740 None] Flow 'volume_create_manager' (07c05742-26ef-4821-8aa7-462949af99ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:24:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ced36251-5a52-4726-aea5-5ee8d90cdcff tempest-ServerRescueNegativeTestJSON-1623986740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (852860ab-a8d8-49f4-86ab-57e81d879ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:24:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ced36251-5a52-4726-aea5-5ee8d90cdcff tempest-ServerRescueNegativeTestJSON-1623986740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (852860ab-a8d8-49f4-86ab-57e81d879ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:24:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-969730715',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1095a92d-ef10-4a92-9605-8d1bfd318b2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7254048b2f2d40ad83d0f98d5678c773',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:24:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:24:28Z,use_quota=True,user_id='28f4b6fcb578420b8e947b4687a558e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:24:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ced36251-5a52-4726-aea5-5ee8d90cdcff tempest-ServerRescueNegativeTestJSON-1623986740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2a4a45d-2830-4b6c-9c72-a713b6c6628e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:24:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ced36251-5a52-4726-aea5-5ee8d90cdcff tempest-ServerRescueNegativeTestJSON-1623986740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2a4a45d-2830-4b6c-9c72-a713b6c6628e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:24:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ced36251-5a52-4726-aea5-5ee8d90cdcff tempest-ServerRescueNegativeTestJSON-1623986740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2efac064-4317-4d2e-9663-b316dc71ebeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:24:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ced36251-5a52-4726-aea5-5ee8d90cdcff tempest-ServerRescueNegativeTestJSON-1623986740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2efac064-4317-4d2e-9663-b316dc71ebeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1095a92d-ef10-4a92-9605-8d1bfd318b2e', 'volume_name': 'volume-1095a92d-ef10-4a92-9605-8d1bfd318b2e', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:24:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ced36251-5a52-4726-aea5-5ee8d90cdcff tempest-ServerRescueNegativeTestJSON-1623986740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (085e113d-350f-4f21-a702-b44e0b82ed28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:24:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ced36251-5a52-4726-aea5-5ee8d90cdcff tempest-ServerRescueNegativeTestJSON-1623986740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (085e113d-350f-4f21-a702-b44e0b82ed28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:24:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ced36251-5a52-4726-aea5-5ee8d90cdcff tempest-ServerRescueNegativeTestJSON-1623986740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (960eeb59-fec3-464e-aa2e-36b823269571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:24:27 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-ced36251-5a52-4726-aea5-5ee8d90cdcff tempest-ServerRescueNegativeTestJSON-1623986740 None] Volume 1095a92d-ef10-4a92-9605-8d1bfd318b2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1095a92d-ef10-4a92-9605-8d1bfd318b2e', 'volume_size': 1}
Jul 14 16:24:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ced36251-5a52-4726-aea5-5ee8d90cdcff tempest-ServerRescueNegativeTestJSON-1623986740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:24:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ced36251-5a52-4726-aea5-5ee8d90cdcff tempest-ServerRescueNegativeTestJSON-1623986740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:24:27 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ced36251-5a52-4726-aea5-5ee8d90cdcff tempest-ServerRescueNegativeTestJSON-1623986740 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:24:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-969730715',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1095a92d-ef10-4a92-9605-8d1bfd318b2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7254048b2f2d40ad83d0f98d5678c773',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:24:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:24:28Z,use_quota=True,user_id='28f4b6fcb578420b8e947b4687a558e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:24:27 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-ced36251-5a52-4726-aea5-5ee8d90cdcff tempest-ServerRescueNegativeTestJSON-1623986740 None] Creating volume 1095a92d-ef10-4a92-9605-8d1bfd318b2e {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:24:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ced36251-5a52-4726-aea5-5ee8d90cdcff tempest-ServerRescueNegativeTestJSON-1623986740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:24:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ced36251-5a52-4726-aea5-5ee8d90cdcff tempest-ServerRescueNegativeTestJSON-1623986740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:24:27 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ced36251-5a52-4726-aea5-5ee8d90cdcff tempest-ServerRescueNegativeTestJSON-1623986740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:24:27 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ced36251-5a52-4726-aea5-5ee8d90cdcff tempest-ServerRescueNegativeTestJSON-1623986740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:24:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ced36251-5a52-4726-aea5-5ee8d90cdcff tempest-ServerRescueNegativeTestJSON-1623986740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:24:27 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ced36251-5a52-4726-aea5-5ee8d90cdcff tempest-ServerRescueNegativeTestJSON-1623986740 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:24:27 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-ced36251-5a52-4726-aea5-5ee8d90cdcff tempest-ServerRescueNegativeTestJSON-1623986740 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:24:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ced36251-5a52-4726-aea5-5ee8d90cdcff tempest-ServerRescueNegativeTestJSON-1623986740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1095a92d-ef10-4a92-9605-8d1bfd318b2e 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:24:27 devstack sudo[89274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1095a92d-ef10-4a92-9605-8d1bfd318b2e 1073741824
Jul 14 16:24:27 devstack sudo[89274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:24:28 devstack sudo[89274]: pam_unix(sudo:session): session closed for user root
Jul 14 16:24:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ced36251-5a52-4726-aea5-5ee8d90cdcff tempest-ServerRescueNegativeTestJSON-1623986740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1095a92d-ef10-4a92-9605-8d1bfd318b2e 1073741824" returned: 0 in 0.786s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:24:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ced36251-5a52-4726-aea5-5ee8d90cdcff tempest-ServerRescueNegativeTestJSON-1623986740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1095a92d-ef10-4a92-9605-8d1bfd318b2e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:24:28 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-1e55f520-4f73-4314-b6ae-cd6af8da795c tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] Acquiring lock "cinder-e963392d-8225-4f41-9558-8ce0e98cfe1c-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:24:28 devstack sudo[89282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1095a92d-ef10-4a92-9605-8d1bfd318b2e
Jul 14 16:24:28 devstack sudo[89282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:24:28 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-1e55f520-4f73-4314-b6ae-cd6af8da795c tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] Lock "cinder-e963392d-8225-4f41-9558-8ce0e98cfe1c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:24:28 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-1e55f520-4f73-4314-b6ae-cd6af8da795c tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] Acquiring lock "cinder-quobyte-655027c5-5bb0-459c-8dee-7c294c2601aa" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:24:28 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-1e55f520-4f73-4314-b6ae-cd6af8da795c tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] Lock "cinder-quobyte-655027c5-5bb0-459c-8dee-7c294c2601aa" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:24:28 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-1e55f520-4f73-4314-b6ae-cd6af8da795c tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] Acquiring lock "cinder-quobyte-e963392d-8225-4f41-9558-8ce0e98cfe1c" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:24:28 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-1e55f520-4f73-4314-b6ae-cd6af8da795c tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] Lock "cinder-quobyte-e963392d-8225-4f41-9558-8ce0e98cfe1c" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:24:28 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-1e55f520-4f73-4314-b6ae-cd6af8da795c tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] Deleting offline snapshot e963392d-8225-4f41-9558-8ce0e98cfe1c of volume 655027c5-5bb0-459c-8dee-7c294c2601aa {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 16:24:28 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-1e55f520-4f73-4314-b6ae-cd6af8da795c tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] snapshot_file for this snap is: volume-655027c5-5bb0-459c-8dee-7c294c2601aa.e963392d-8225-4f41-9558-8ce0e98cfe1c {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 16:24:28 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[283854aa-b192-41c0-af04-4de1bcf668fc]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:24:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1e55f520-4f73-4314-b6ae-cd6af8da795c tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-655027c5-5bb0-459c-8dee-7c294c2601aa.e963392d-8225-4f41-9558-8ce0e98cfe1c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:24:29 devstack sudo[89282]: pam_unix(sudo:session): session closed for user root
Jul 14 16:24:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ced36251-5a52-4726-aea5-5ee8d90cdcff tempest-ServerRescueNegativeTestJSON-1623986740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1095a92d-ef10-4a92-9605-8d1bfd318b2e" returned: 0 in 0.418s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:24:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ced36251-5a52-4726-aea5-5ee8d90cdcff tempest-ServerRescueNegativeTestJSON-1623986740 None] <== create_volume: return (1297ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:24:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ced36251-5a52-4726-aea5-5ee8d90cdcff tempest-ServerRescueNegativeTestJSON-1623986740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.302s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:24:29 devstack sudo[89284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-655027c5-5bb0-459c-8dee-7c294c2601aa.e963392d-8225-4f41-9558-8ce0e98cfe1c
Jul 14 16:24:29 devstack sudo[89284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:24:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ced36251-5a52-4726-aea5-5ee8d90cdcff tempest-ServerRescueNegativeTestJSON-1623986740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (960eeb59-fec3-464e-aa2e-36b823269571) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1095a92d-ef10-4a92-9605-8d1bfd318b2e', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:24:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ced36251-5a52-4726-aea5-5ee8d90cdcff tempest-ServerRescueNegativeTestJSON-1623986740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1ae8337-390d-4443-b67c-ce06cb5855ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:24:29 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-ced36251-5a52-4726-aea5-5ee8d90cdcff tempest-ServerRescueNegativeTestJSON-1623986740 None] Volume volume-1095a92d-ef10-4a92-9605-8d1bfd318b2e (1095a92d-ef10-4a92-9605-8d1bfd318b2e): created successfully
Jul 14 16:24:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ced36251-5a52-4726-aea5-5ee8d90cdcff tempest-ServerRescueNegativeTestJSON-1623986740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1ae8337-390d-4443-b67c-ce06cb5855ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:24:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ced36251-5a52-4726-aea5-5ee8d90cdcff tempest-ServerRescueNegativeTestJSON-1623986740 None] Flow 'volume_create_manager' (07c05742-26ef-4821-8aa7-462949af99ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:24:29 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-ced36251-5a52-4726-aea5-5ee8d90cdcff tempest-ServerRescueNegativeTestJSON-1623986740 None] Created volume successfully.
Jul 14 16:24:29 devstack sudo[89284]: pam_unix(sudo:session): session closed for user root
Jul 14 16:24:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1e55f520-4f73-4314-b6ae-cd6af8da795c tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-655027c5-5bb0-459c-8dee-7c294c2601aa.e963392d-8225-4f41-9558-8ce0e98cfe1c" returned: 0 in 0.597s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:24:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-1e55f520-4f73-4314-b6ae-cd6af8da795c tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-655027c5-5bb0-459c-8dee-7c294c2601aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 16:24:29 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[12815b58-598a-4947-9d03-e752071cb721]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:24:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1e55f520-4f73-4314-b6ae-cd6af8da795c tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-655027c5-5bb0-459c-8dee-7c294c2601aa {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:24:29 devstack sudo[89291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-655027c5-5bb0-459c-8dee-7c294c2601aa
Jul 14 16:24:29 devstack sudo[89291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:24:30 devstack sudo[89291]: pam_unix(sudo:session): session closed for user root
Jul 14 16:24:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1e55f520-4f73-4314-b6ae-cd6af8da795c tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-655027c5-5bb0-459c-8dee-7c294c2601aa" returned: 0 in 0.668s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:24:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1e55f520-4f73-4314-b6ae-cd6af8da795c tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-655027c5-5bb0-459c-8dee-7c294c2601aa.e963392d-8225-4f41-9558-8ce0e98cfe1c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:24:30 devstack sudo[89297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-655027c5-5bb0-459c-8dee-7c294c2601aa.e963392d-8225-4f41-9558-8ce0e98cfe1c
Jul 14 16:24:30 devstack sudo[89297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:24:30 devstack sudo[89297]: pam_unix(sudo:session): session closed for user root
Jul 14 16:24:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1e55f520-4f73-4314-b6ae-cd6af8da795c tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-655027c5-5bb0-459c-8dee-7c294c2601aa.e963392d-8225-4f41-9558-8ce0e98cfe1c" returned: 0 in 0.490s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:24:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1e55f520-4f73-4314-b6ae-cd6af8da795c tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-655027c5-5bb0-459c-8dee-7c294c2601aa.e963392d-8225-4f41-9558-8ce0e98cfe1c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:24:30 devstack sudo[89303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-655027c5-5bb0-459c-8dee-7c294c2601aa.e963392d-8225-4f41-9558-8ce0e98cfe1c
Jul 14 16:24:30 devstack sudo[89303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:24:31 devstack sudo[89303]: pam_unix(sudo:session): session closed for user root
Jul 14 16:24:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1e55f520-4f73-4314-b6ae-cd6af8da795c tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-655027c5-5bb0-459c-8dee-7c294c2601aa.e963392d-8225-4f41-9558-8ce0e98cfe1c" returned: 0 in 0.325s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:24:31 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-1e55f520-4f73-4314-b6ae-cd6af8da795c tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] Lock "cinder-quobyte-e963392d-8225-4f41-9558-8ce0e98cfe1c" released by "_delete_snapshot" :: held 2.323s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:24:31 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-1e55f520-4f73-4314-b6ae-cd6af8da795c tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] Lock "cinder-quobyte-655027c5-5bb0-459c-8dee-7c294c2601aa" released by "delete_snapshot" :: held 2.361s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:24:31 devstack cinder-volume[87166]: WARNING cinder.quota [None req-1e55f520-4f73-4314-b6ae-cd6af8da795c tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jul 14 16:24:31 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-1e55f520-4f73-4314-b6ae-cd6af8da795c tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] Created reservations ['e4d4c819-e075-4d6e-8302-6b771dc87c63', 'cb6f9b22-0eb0-47a7-b525-6224e0d0ecc6', '294ca92f-3ad3-4430-b742-71c0a21038cb', 'd9b89626-be58-4b46-a3ab-b1b4ae5604fc'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:24:31 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-1e55f520-4f73-4314-b6ae-cd6af8da795c tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] Delete snapshot completed successfully.
Jul 14 16:24:31 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-1e55f520-4f73-4314-b6ae-cd6af8da795c tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] Lock "cinder-e963392d-8225-4f41-9558-8ce0e98cfe1c-delete_snapshot" released by "delete_snapshot" :: held 2.642s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:24:32 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b9640c7d-785d-4eae-a93a-b179a7548955 tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] Acquiring lock "cinder-655027c5-5bb0-459c-8dee-7c294c2601aa-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:24:32 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b9640c7d-785d-4eae-a93a-b179a7548955 tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] Lock "cinder-655027c5-5bb0-459c-8dee-7c294c2601aa-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:24:32 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b9640c7d-785d-4eae-a93a-b179a7548955 tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] Acquiring lock "cinder-quobyte-655027c5-5bb0-459c-8dee-7c294c2601aa" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:24:32 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b9640c7d-785d-4eae-a93a-b179a7548955 tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] Lock "cinder-quobyte-655027c5-5bb0-459c-8dee-7c294c2601aa" acquired by "delete_volume" :: waited 0.019s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:24:32 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b204241-c1a9-4141-b8ae-4aaa5a8b8979]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:24:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b9640c7d-785d-4eae-a93a-b179a7548955 tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-655027c5-5bb0-459c-8dee-7c294c2601aa {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:24:32 devstack sudo[89307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-655027c5-5bb0-459c-8dee-7c294c2601aa
Jul 14 16:24:32 devstack sudo[89307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:24:33 devstack sudo[89307]: pam_unix(sudo:session): session closed for user root
Jul 14 16:24:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b9640c7d-785d-4eae-a93a-b179a7548955 tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-655027c5-5bb0-459c-8dee-7c294c2601aa" returned: 0 in 0.696s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:24:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b9640c7d-785d-4eae-a93a-b179a7548955 tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-655027c5-5bb0-459c-8dee-7c294c2601aa {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:24:33 devstack sudo[89312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-655027c5-5bb0-459c-8dee-7c294c2601aa
Jul 14 16:24:33 devstack sudo[89312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:24:33 devstack sudo[89312]: pam_unix(sudo:session): session closed for user root
Jul 14 16:24:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b9640c7d-785d-4eae-a93a-b179a7548955 tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-655027c5-5bb0-459c-8dee-7c294c2601aa" returned: 0 in 0.534s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:24:33 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b9640c7d-785d-4eae-a93a-b179a7548955 tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] Lock "cinder-quobyte-655027c5-5bb0-459c-8dee-7c294c2601aa" released by "delete_volume" :: held 1.321s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:24:33 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-b9640c7d-785d-4eae-a93a-b179a7548955 tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] Created reservations ['c3995a93-6a43-4493-9bf8-2cefceeaf33f', 'cad68cd5-8e57-4a47-aad4-1f675ec9e23f', '769a9826-5645-4c76-b044-130d9a0af2bf', '3a69c080-6cf5-4ee5-a464-e4fe025bb59c'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:24:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b9640c7d-785d-4eae-a93a-b179a7548955 tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:24:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b9640c7d-785d-4eae-a93a-b179a7548955 tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:24:34 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-b9640c7d-785d-4eae-a93a-b179a7548955 tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:24:34 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-b9640c7d-785d-4eae-a93a-b179a7548955 tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:24:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b9640c7d-785d-4eae-a93a-b179a7548955 tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:24:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b9640c7d-785d-4eae-a93a-b179a7548955 tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:24:34 devstack sudo[89316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:24:34 devstack sudo[89316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:24:34 devstack sudo[89316]: pam_unix(sudo:session): session closed for user root
Jul 14 16:24:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b9640c7d-785d-4eae-a93a-b179a7548955 tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.515s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:24:34 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-b9640c7d-785d-4eae-a93a-b179a7548955 tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:24:34 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-b9640c7d-785d-4eae-a93a-b179a7548955 tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] Deleted volume successfully.
Jul 14 16:24:34 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b9640c7d-785d-4eae-a93a-b179a7548955 tempest-VolumeSnapshotQuotasNegativeTestJSON-183385275 None] Lock "cinder-655027c5-5bb0-459c-8dee-7c294c2601aa-delete_volume" released by "delete_volume" :: held 2.450s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:24:35 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 16:24:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:24:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:24:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:24:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:24:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:24:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:24:35 devstack sudo[89319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:24:35 devstack sudo[89319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:24:36 devstack sudo[89319]: pam_unix(sudo:session): session closed for user root
Jul 14 16:24:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.752s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:24:36 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:24:44 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:SELECT=25,cinder:UPDATE=23,cinder:DELETE=3,cinder:INSERT=7 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 16:24:44 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:UPDATE=35,cinder:SELECT=21,cinder:INSERT=8,cinder:DELETE=2 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 16:24:48 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2becf155-3a49-4ca9-8fe2-3d7801919ca0 tempest-ServerRescueNegativeTestJSON-1623986740 None] Acquiring lock "cinder-1095a92d-ef10-4a92-9605-8d1bfd318b2e-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:24:48 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2becf155-3a49-4ca9-8fe2-3d7801919ca0 tempest-ServerRescueNegativeTestJSON-1623986740 None] Lock "cinder-1095a92d-ef10-4a92-9605-8d1bfd318b2e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:24:48 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2becf155-3a49-4ca9-8fe2-3d7801919ca0 tempest-ServerRescueNegativeTestJSON-1623986740 None] Acquiring lock "cinder-quobyte-1095a92d-ef10-4a92-9605-8d1bfd318b2e" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:24:48 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2becf155-3a49-4ca9-8fe2-3d7801919ca0 tempest-ServerRescueNegativeTestJSON-1623986740 None] Lock "cinder-quobyte-1095a92d-ef10-4a92-9605-8d1bfd318b2e" acquired by "delete_volume" :: waited 0.030s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:24:48 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[db758e5a-9540-4e8f-ae34-895765c3dae8]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:24:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2becf155-3a49-4ca9-8fe2-3d7801919ca0 tempest-ServerRescueNegativeTestJSON-1623986740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1095a92d-ef10-4a92-9605-8d1bfd318b2e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:24:48 devstack sudo[89453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1095a92d-ef10-4a92-9605-8d1bfd318b2e
Jul 14 16:24:48 devstack sudo[89453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:24:48 devstack sudo[89453]: pam_unix(sudo:session): session closed for user root
Jul 14 16:24:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2becf155-3a49-4ca9-8fe2-3d7801919ca0 tempest-ServerRescueNegativeTestJSON-1623986740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1095a92d-ef10-4a92-9605-8d1bfd318b2e" returned: 0 in 0.473s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:24:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2becf155-3a49-4ca9-8fe2-3d7801919ca0 tempest-ServerRescueNegativeTestJSON-1623986740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1095a92d-ef10-4a92-9605-8d1bfd318b2e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:24:48 devstack sudo[89459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1095a92d-ef10-4a92-9605-8d1bfd318b2e
Jul 14 16:24:48 devstack sudo[89459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:24:49 devstack sudo[89459]: pam_unix(sudo:session): session closed for user root
Jul 14 16:24:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2becf155-3a49-4ca9-8fe2-3d7801919ca0 tempest-ServerRescueNegativeTestJSON-1623986740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1095a92d-ef10-4a92-9605-8d1bfd318b2e" returned: 0 in 0.314s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:24:49 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2becf155-3a49-4ca9-8fe2-3d7801919ca0 tempest-ServerRescueNegativeTestJSON-1623986740 None] Lock "cinder-quobyte-1095a92d-ef10-4a92-9605-8d1bfd318b2e" released by "delete_volume" :: held 0.868s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:24:49 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-2becf155-3a49-4ca9-8fe2-3d7801919ca0 tempest-ServerRescueNegativeTestJSON-1623986740 None] Created reservations ['e7e1ed04-ccec-44bf-ad11-cb24a02a592b', 'cac8415c-fe9f-4ea3-958d-b9dac35ba5b3', '7325dcb9-9d4a-4b43-ae94-7d895828d44e', 'ad8b6d05-1e47-4dbc-b8c9-0029c5b7ada3'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:24:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2becf155-3a49-4ca9-8fe2-3d7801919ca0 tempest-ServerRescueNegativeTestJSON-1623986740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:24:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2becf155-3a49-4ca9-8fe2-3d7801919ca0 tempest-ServerRescueNegativeTestJSON-1623986740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:24:49 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2becf155-3a49-4ca9-8fe2-3d7801919ca0 tempest-ServerRescueNegativeTestJSON-1623986740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:24:49 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2becf155-3a49-4ca9-8fe2-3d7801919ca0 tempest-ServerRescueNegativeTestJSON-1623986740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:24:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2becf155-3a49-4ca9-8fe2-3d7801919ca0 tempest-ServerRescueNegativeTestJSON-1623986740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:24:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2becf155-3a49-4ca9-8fe2-3d7801919ca0 tempest-ServerRescueNegativeTestJSON-1623986740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:24:49 devstack sudo[89462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:24:49 devstack sudo[89462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:24:49 devstack sudo[89462]: pam_unix(sudo:session): session closed for user root
Jul 14 16:24:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2becf155-3a49-4ca9-8fe2-3d7801919ca0 tempest-ServerRescueNegativeTestJSON-1623986740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.376s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:24:49 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-2becf155-3a49-4ca9-8fe2-3d7801919ca0 tempest-ServerRescueNegativeTestJSON-1623986740 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:24:49 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-2becf155-3a49-4ca9-8fe2-3d7801919ca0 tempest-ServerRescueNegativeTestJSON-1623986740 None] Deleted volume successfully.
Jul 14 16:24:49 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2becf155-3a49-4ca9-8fe2-3d7801919ca0 tempest-ServerRescueNegativeTestJSON-1623986740 None] Lock "cinder-1095a92d-ef10-4a92-9605-8d1bfd318b2e-delete_volume" released by "delete_volume" :: held 1.698s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:24:59 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:UPDATE=10,cinder:SELECT=5,cinder:INSERT=2 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 16:24:59 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:SELECT=5,cinder:INSERT=2,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 16:25:25 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-73bbe5cd-7b65-4914-8a57-65b3ddeed5dd tempest-ServerActionsTestOtherA-221655283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:25:25 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-73bbe5cd-7b65-4914-8a57-65b3ddeed5dd tempest-ServerActionsTestOtherA-221655283 None] Flow 'volume_create_manager' (389f009b-f195-441b-ad9b-2b692ceae084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:25:25 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-73bbe5cd-7b65-4914-8a57-65b3ddeed5dd tempest-ServerActionsTestOtherA-221655283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b089e07-fec3-41ba-8717-8ce3e5133e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:25:25 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-73bbe5cd-7b65-4914-8a57-65b3ddeed5dd tempest-ServerActionsTestOtherA-221655283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b089e07-fec3-41ba-8717-8ce3e5133e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:25:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-766454429',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6761b33a-8d29-4ba0-8cd4-1532082a0ac9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cdb8cde8f904cb987d221dcdc998037',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:25:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:25:26Z,use_quota=True,user_id='c299fe0adfea4fdaaf1cf5bf75891f23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:25:25 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-73bbe5cd-7b65-4914-8a57-65b3ddeed5dd tempest-ServerActionsTestOtherA-221655283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b35dd6c8-a342-44e1-a6fb-6f021cb3f15a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:25:25 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-73bbe5cd-7b65-4914-8a57-65b3ddeed5dd tempest-ServerActionsTestOtherA-221655283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b35dd6c8-a342-44e1-a6fb-6f021cb3f15a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:25:26 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-73bbe5cd-7b65-4914-8a57-65b3ddeed5dd tempest-ServerActionsTestOtherA-221655283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (249a40e1-22b2-44d4-b334-d925a50302a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:25:26 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-73bbe5cd-7b65-4914-8a57-65b3ddeed5dd tempest-ServerActionsTestOtherA-221655283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (249a40e1-22b2-44d4-b334-d925a50302a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6761b33a-8d29-4ba0-8cd4-1532082a0ac9', 'volume_name': 'volume-6761b33a-8d29-4ba0-8cd4-1532082a0ac9', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:25:26 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-73bbe5cd-7b65-4914-8a57-65b3ddeed5dd tempest-ServerActionsTestOtherA-221655283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2fabd3b-9be7-4253-98d6-979129bd7f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:25:26 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-73bbe5cd-7b65-4914-8a57-65b3ddeed5dd tempest-ServerActionsTestOtherA-221655283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2fabd3b-9be7-4253-98d6-979129bd7f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:25:26 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-73bbe5cd-7b65-4914-8a57-65b3ddeed5dd tempest-ServerActionsTestOtherA-221655283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73141b4d-f56d-4f27-9293-3d9d85022f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:25:26 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-73bbe5cd-7b65-4914-8a57-65b3ddeed5dd tempest-ServerActionsTestOtherA-221655283 None] Volume 6761b33a-8d29-4ba0-8cd4-1532082a0ac9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6761b33a-8d29-4ba0-8cd4-1532082a0ac9', 'volume_size': 1}
Jul 14 16:25:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-73bbe5cd-7b65-4914-8a57-65b3ddeed5dd tempest-ServerActionsTestOtherA-221655283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:25:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-73bbe5cd-7b65-4914-8a57-65b3ddeed5dd tempest-ServerActionsTestOtherA-221655283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:25:26 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-73bbe5cd-7b65-4914-8a57-65b3ddeed5dd tempest-ServerActionsTestOtherA-221655283 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:25:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-766454429',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6761b33a-8d29-4ba0-8cd4-1532082a0ac9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cdb8cde8f904cb987d221dcdc998037',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:25:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:25:26Z,use_quota=True,user_id='c299fe0adfea4fdaaf1cf5bf75891f23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:25:26 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-73bbe5cd-7b65-4914-8a57-65b3ddeed5dd tempest-ServerActionsTestOtherA-221655283 None] Creating volume 6761b33a-8d29-4ba0-8cd4-1532082a0ac9 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:25:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-73bbe5cd-7b65-4914-8a57-65b3ddeed5dd tempest-ServerActionsTestOtherA-221655283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:25:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-73bbe5cd-7b65-4914-8a57-65b3ddeed5dd tempest-ServerActionsTestOtherA-221655283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:25:26 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-73bbe5cd-7b65-4914-8a57-65b3ddeed5dd tempest-ServerActionsTestOtherA-221655283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:25:26 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-73bbe5cd-7b65-4914-8a57-65b3ddeed5dd tempest-ServerActionsTestOtherA-221655283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:25:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-73bbe5cd-7b65-4914-8a57-65b3ddeed5dd tempest-ServerActionsTestOtherA-221655283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:25:26 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-73bbe5cd-7b65-4914-8a57-65b3ddeed5dd tempest-ServerActionsTestOtherA-221655283 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:25:26 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-73bbe5cd-7b65-4914-8a57-65b3ddeed5dd tempest-ServerActionsTestOtherA-221655283 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:25:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-73bbe5cd-7b65-4914-8a57-65b3ddeed5dd tempest-ServerActionsTestOtherA-221655283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6761b33a-8d29-4ba0-8cd4-1532082a0ac9 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:25:26 devstack sudo[90026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6761b33a-8d29-4ba0-8cd4-1532082a0ac9 1073741824
Jul 14 16:25:26 devstack sudo[90026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:25:27 devstack sudo[90026]: pam_unix(sudo:session): session closed for user root
Jul 14 16:25:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-73bbe5cd-7b65-4914-8a57-65b3ddeed5dd tempest-ServerActionsTestOtherA-221655283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6761b33a-8d29-4ba0-8cd4-1532082a0ac9 1073741824" returned: 0 in 0.990s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:25:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-73bbe5cd-7b65-4914-8a57-65b3ddeed5dd tempest-ServerActionsTestOtherA-221655283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6761b33a-8d29-4ba0-8cd4-1532082a0ac9 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:25:27 devstack sudo[90205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6761b33a-8d29-4ba0-8cd4-1532082a0ac9
Jul 14 16:25:27 devstack sudo[90205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:25:27 devstack sudo[90205]: pam_unix(sudo:session): session closed for user root
Jul 14 16:25:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-73bbe5cd-7b65-4914-8a57-65b3ddeed5dd tempest-ServerActionsTestOtherA-221655283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6761b33a-8d29-4ba0-8cd4-1532082a0ac9" returned: 0 in 0.663s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:25:27 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-73bbe5cd-7b65-4914-8a57-65b3ddeed5dd tempest-ServerActionsTestOtherA-221655283 None] <== create_volume: return (1759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:25:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-73bbe5cd-7b65-4914-8a57-65b3ddeed5dd tempest-ServerActionsTestOtherA-221655283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.764s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:25:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-73bbe5cd-7b65-4914-8a57-65b3ddeed5dd tempest-ServerActionsTestOtherA-221655283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73141b4d-f56d-4f27-9293-3d9d85022f4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6761b33a-8d29-4ba0-8cd4-1532082a0ac9', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:25:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-73bbe5cd-7b65-4914-8a57-65b3ddeed5dd tempest-ServerActionsTestOtherA-221655283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32fb514b-6ea2-48e5-8b61-0db428f3514d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:25:27 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-73bbe5cd-7b65-4914-8a57-65b3ddeed5dd tempest-ServerActionsTestOtherA-221655283 None] Volume volume-6761b33a-8d29-4ba0-8cd4-1532082a0ac9 (6761b33a-8d29-4ba0-8cd4-1532082a0ac9): created successfully
Jul 14 16:25:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-73bbe5cd-7b65-4914-8a57-65b3ddeed5dd tempest-ServerActionsTestOtherA-221655283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32fb514b-6ea2-48e5-8b61-0db428f3514d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:25:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-73bbe5cd-7b65-4914-8a57-65b3ddeed5dd tempest-ServerActionsTestOtherA-221655283 None] Flow 'volume_create_manager' (389f009b-f195-441b-ad9b-2b692ceae084) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:25:27 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-73bbe5cd-7b65-4914-8a57-65b3ddeed5dd tempest-ServerActionsTestOtherA-221655283 None] Created volume successfully.
Jul 14 16:25:35 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 16:25:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:25:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:25:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:25:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:25:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:25:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:25:35 devstack sudo[90223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:25:35 devstack sudo[90223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:25:36 devstack sudo[90223]: pam_unix(sudo:session): session closed for user root
Jul 14 16:25:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.759s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:25:36 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:25:36 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Running periodic task VolumeManager._thread_info {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 16:25:36 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] thread count: 8 {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 14 16:25:36 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] thread info: [<_MainThread(MainThread, started 128606490927232)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128606415432960)>, <Thread(Thread-3 (stat_writer), started daemon 128606378859328)>, <Thread(Rabbit-heartbeat, started daemon 128606379646144)>, <Thread(Thread-5 (_runner), started daemon 128606377685824)>, <Thread(Thread-7 (_runner), started daemon 128606377701888)>, <Thread(fd_logger, started daemon 128606377091392)>, <Thread(privsep_reader, started daemon 128606375782080)>] {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 14 16:25:37 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:UPDATE=3 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 16:25:37 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:SELECT=4,cinder:INSERT=1,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 16:25:45 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-de60dee7-e29e-4f39-b332-b4a50831f7a2 tempest-VolumesActionsTest-288059650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:25:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-de60dee7-e29e-4f39-b332-b4a50831f7a2 tempest-VolumesActionsTest-288059650 None] Flow 'volume_create_manager' (ffa0546f-4853-450a-a4d3-d960391ee1e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:25:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-de60dee7-e29e-4f39-b332-b4a50831f7a2 tempest-VolumesActionsTest-288059650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0b60a16-8a0f-471a-b51d-cf3235e6de90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:25:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-de60dee7-e29e-4f39-b332-b4a50831f7a2 tempest-VolumesActionsTest-288059650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0b60a16-8a0f-471a-b51d-cf3235e6de90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:25:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1512492275',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03a2076b-6f25-488f-b496-4b0223de6936,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85b645b9e13e486e95e95114ec41db50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:25:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:25:46Z,use_quota=True,user_id='70463b999b824ea89265f51945ae7195',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:25:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-de60dee7-e29e-4f39-b332-b4a50831f7a2 tempest-VolumesActionsTest-288059650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (423f0d9d-3617-4812-9084-4b8de225e0bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:25:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-de60dee7-e29e-4f39-b332-b4a50831f7a2 tempest-VolumesActionsTest-288059650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (423f0d9d-3617-4812-9084-4b8de225e0bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:25:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-de60dee7-e29e-4f39-b332-b4a50831f7a2 tempest-VolumesActionsTest-288059650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15d0b3d7-4a84-4cd7-aa59-9e9daf230ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:25:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-de60dee7-e29e-4f39-b332-b4a50831f7a2 tempest-VolumesActionsTest-288059650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15d0b3d7-4a84-4cd7-aa59-9e9daf230ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03a2076b-6f25-488f-b496-4b0223de6936', 'volume_name': 'volume-03a2076b-6f25-488f-b496-4b0223de6936', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:25:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-de60dee7-e29e-4f39-b332-b4a50831f7a2 tempest-VolumesActionsTest-288059650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec9f03d4-49ec-4ec0-a64a-da9f54060082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:25:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-de60dee7-e29e-4f39-b332-b4a50831f7a2 tempest-VolumesActionsTest-288059650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec9f03d4-49ec-4ec0-a64a-da9f54060082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:25:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-de60dee7-e29e-4f39-b332-b4a50831f7a2 tempest-VolumesActionsTest-288059650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f595850d-517f-411d-86bf-9791210797aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:25:45 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-de60dee7-e29e-4f39-b332-b4a50831f7a2 tempest-VolumesActionsTest-288059650 None] Volume 03a2076b-6f25-488f-b496-4b0223de6936: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03a2076b-6f25-488f-b496-4b0223de6936', 'volume_size': 1}
Jul 14 16:25:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-de60dee7-e29e-4f39-b332-b4a50831f7a2 tempest-VolumesActionsTest-288059650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:25:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-de60dee7-e29e-4f39-b332-b4a50831f7a2 tempest-VolumesActionsTest-288059650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:25:45 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-de60dee7-e29e-4f39-b332-b4a50831f7a2 tempest-VolumesActionsTest-288059650 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:25:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1512492275',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03a2076b-6f25-488f-b496-4b0223de6936,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85b645b9e13e486e95e95114ec41db50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:25:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:25:46Z,use_quota=True,user_id='70463b999b824ea89265f51945ae7195',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:25:45 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-de60dee7-e29e-4f39-b332-b4a50831f7a2 tempest-VolumesActionsTest-288059650 None] Creating volume 03a2076b-6f25-488f-b496-4b0223de6936 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:25:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-de60dee7-e29e-4f39-b332-b4a50831f7a2 tempest-VolumesActionsTest-288059650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:25:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-de60dee7-e29e-4f39-b332-b4a50831f7a2 tempest-VolumesActionsTest-288059650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:25:45 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-de60dee7-e29e-4f39-b332-b4a50831f7a2 tempest-VolumesActionsTest-288059650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:25:45 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-de60dee7-e29e-4f39-b332-b4a50831f7a2 tempest-VolumesActionsTest-288059650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:25:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-de60dee7-e29e-4f39-b332-b4a50831f7a2 tempest-VolumesActionsTest-288059650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:25:45 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-de60dee7-e29e-4f39-b332-b4a50831f7a2 tempest-VolumesActionsTest-288059650 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:25:45 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-de60dee7-e29e-4f39-b332-b4a50831f7a2 tempest-VolumesActionsTest-288059650 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:25:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-de60dee7-e29e-4f39-b332-b4a50831f7a2 tempest-VolumesActionsTest-288059650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-03a2076b-6f25-488f-b496-4b0223de6936 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:25:46 devstack sudo[90412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-03a2076b-6f25-488f-b496-4b0223de6936 1073741824
Jul 14 16:25:46 devstack sudo[90412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:25:47 devstack sudo[90412]: pam_unix(sudo:session): session closed for user root
Jul 14 16:25:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-de60dee7-e29e-4f39-b332-b4a50831f7a2 tempest-VolumesActionsTest-288059650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-03a2076b-6f25-488f-b496-4b0223de6936 1073741824" returned: 0 in 1.275s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:25:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-de60dee7-e29e-4f39-b332-b4a50831f7a2 tempest-VolumesActionsTest-288059650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-03a2076b-6f25-488f-b496-4b0223de6936 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:25:47 devstack sudo[90437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-03a2076b-6f25-488f-b496-4b0223de6936
Jul 14 16:25:47 devstack sudo[90437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:25:48 devstack sudo[90437]: pam_unix(sudo:session): session closed for user root
Jul 14 16:25:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-de60dee7-e29e-4f39-b332-b4a50831f7a2 tempest-VolumesActionsTest-288059650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-03a2076b-6f25-488f-b496-4b0223de6936" returned: 0 in 0.939s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:25:48 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-de60dee7-e29e-4f39-b332-b4a50831f7a2 tempest-VolumesActionsTest-288059650 None] <== create_volume: return (2394ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:25:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-de60dee7-e29e-4f39-b332-b4a50831f7a2 tempest-VolumesActionsTest-288059650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.399s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:25:48 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-de60dee7-e29e-4f39-b332-b4a50831f7a2 tempest-VolumesActionsTest-288059650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f595850d-517f-411d-86bf-9791210797aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03a2076b-6f25-488f-b496-4b0223de6936', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:25:48 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-de60dee7-e29e-4f39-b332-b4a50831f7a2 tempest-VolumesActionsTest-288059650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98f0f497-d6bb-440b-864b-95531688107e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:25:48 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-de60dee7-e29e-4f39-b332-b4a50831f7a2 tempest-VolumesActionsTest-288059650 None] Volume volume-03a2076b-6f25-488f-b496-4b0223de6936 (03a2076b-6f25-488f-b496-4b0223de6936): created successfully
Jul 14 16:25:48 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-de60dee7-e29e-4f39-b332-b4a50831f7a2 tempest-VolumesActionsTest-288059650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98f0f497-d6bb-440b-864b-95531688107e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:25:48 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-de60dee7-e29e-4f39-b332-b4a50831f7a2 tempest-VolumesActionsTest-288059650 None] Flow 'volume_create_manager' (ffa0546f-4853-450a-a4d3-d960391ee1e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:25:48 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-de60dee7-e29e-4f39-b332-b4a50831f7a2 tempest-VolumesActionsTest-288059650 None] Created volume successfully.
Jul 14 16:25:49 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-14018a27-3342-49f1-a623-e46731ac5977 tempest-VolumesActionsTest-288059650 None] Acquiring lock "cinder-03a2076b-6f25-488f-b496-4b0223de6936" by "attach_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:25:49 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-14018a27-3342-49f1-a623-e46731ac5977 tempest-VolumesActionsTest-288059650 None] Lock "cinder-03a2076b-6f25-488f-b496-4b0223de6936" acquired by "attach_volume" :: waited 0.073s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:25:50 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-14018a27-3342-49f1-a623-e46731ac5977 tempest-VolumesActionsTest-288059650 None] Attaching volume 03a2076b-6f25-488f-b496-4b0223de6936 to instance 1edd06f1-c596-460f-a28d-b8b6e61c8b5d at mountpoint /dev/vdb on host None.
Jul 14 16:25:50 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-14018a27-3342-49f1-a623-e46731ac5977 tempest-VolumesActionsTest-288059650 None] Attach volume completed successfully.
Jul 14 16:25:50 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-14018a27-3342-49f1-a623-e46731ac5977 tempest-VolumesActionsTest-288059650 None] Lock "cinder-03a2076b-6f25-488f-b496-4b0223de6936" released by "attach_volume" :: held 0.361s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:25:52 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-7434a157-6d29-4705-851f-0df972198098 tempest-VolumesActionsTest-1748201626 None] Terminate volume connection completed successfully.
Jul 14 16:25:52 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7434a157-6d29-4705-851f-0df972198098 tempest-VolumesActionsTest-1748201626 None] Acquiring lock "cinder-03a2076b-6f25-488f-b496-4b0223de6936-detach_volume" by "detach_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:25:53 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7434a157-6d29-4705-851f-0df972198098 tempest-VolumesActionsTest-1748201626 None] Lock "cinder-03a2076b-6f25-488f-b496-4b0223de6936-detach_volume" acquired by "detach_volume" :: waited 0.073s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:25:53 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-7434a157-6d29-4705-851f-0df972198098 tempest-VolumesActionsTest-1748201626 None] Detaching volume 03a2076b-6f25-488f-b496-4b0223de6936 from instance 1edd06f1-c596-460f-a28d-b8b6e61c8b5d.
Jul 14 16:25:53 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-7434a157-6d29-4705-851f-0df972198098 tempest-VolumesActionsTest-1748201626 None] Detach volume completed successfully.
Jul 14 16:25:53 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7434a157-6d29-4705-851f-0df972198098 tempest-VolumesActionsTest-1748201626 None] Lock "cinder-03a2076b-6f25-488f-b496-4b0223de6936-detach_volume" released by "detach_volume" :: held 0.286s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:25:53 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a7291ccd-0804-4609-83fe-9f3991b41c4a tempest-VolumesActionsTest-288059650 None] Acquiring lock "cinder-03a2076b-6f25-488f-b496-4b0223de6936-detach_volume" by "detach_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:25:53 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a7291ccd-0804-4609-83fe-9f3991b41c4a tempest-VolumesActionsTest-288059650 None] Lock "cinder-03a2076b-6f25-488f-b496-4b0223de6936-detach_volume" acquired by "detach_volume" :: waited 0.048s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:25:53 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-a7291ccd-0804-4609-83fe-9f3991b41c4a tempest-VolumesActionsTest-288059650 None] Volume detach called, but volume not attached.
Jul 14 16:25:53 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a7291ccd-0804-4609-83fe-9f3991b41c4a tempest-VolumesActionsTest-288059650 None] Lock "cinder-03a2076b-6f25-488f-b496-4b0223de6936-detach_volume" released by "detach_volume" :: held 0.051s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:25:54 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e14bab55-ed5c-4d97-815a-a33a20efb199 tempest-VolumesActionsTest-288059650 None] Acquiring lock "cinder-03a2076b-6f25-488f-b496-4b0223de6936-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:25:54 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e14bab55-ed5c-4d97-815a-a33a20efb199 tempest-VolumesActionsTest-288059650 None] Lock "cinder-03a2076b-6f25-488f-b496-4b0223de6936-delete_volume" acquired by "delete_volume" :: waited 0.099s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:25:54 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e14bab55-ed5c-4d97-815a-a33a20efb199 tempest-VolumesActionsTest-288059650 None] Acquiring lock "cinder-quobyte-03a2076b-6f25-488f-b496-4b0223de6936" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:25:54 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e14bab55-ed5c-4d97-815a-a33a20efb199 tempest-VolumesActionsTest-288059650 None] Lock "cinder-quobyte-03a2076b-6f25-488f-b496-4b0223de6936" acquired by "delete_volume" :: waited 0.046s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:25:54 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e639bd6-e6d7-4211-a267-bdfb338d8dc9]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:25:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e14bab55-ed5c-4d97-815a-a33a20efb199 tempest-VolumesActionsTest-288059650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-03a2076b-6f25-488f-b496-4b0223de6936 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:25:55 devstack sudo[90558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-03a2076b-6f25-488f-b496-4b0223de6936
Jul 14 16:25:55 devstack sudo[90558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:25:55 devstack sudo[90558]: pam_unix(sudo:session): session closed for user root
Jul 14 16:25:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e14bab55-ed5c-4d97-815a-a33a20efb199 tempest-VolumesActionsTest-288059650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-03a2076b-6f25-488f-b496-4b0223de6936" returned: 0 in 1.121s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:25:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e14bab55-ed5c-4d97-815a-a33a20efb199 tempest-VolumesActionsTest-288059650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-03a2076b-6f25-488f-b496-4b0223de6936 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:25:55 devstack sudo[90579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-03a2076b-6f25-488f-b496-4b0223de6936
Jul 14 16:25:55 devstack sudo[90579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:25:56 devstack sudo[90579]: pam_unix(sudo:session): session closed for user root
Jul 14 16:25:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e14bab55-ed5c-4d97-815a-a33a20efb199 tempest-VolumesActionsTest-288059650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-03a2076b-6f25-488f-b496-4b0223de6936" returned: 0 in 0.794s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:25:56 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e14bab55-ed5c-4d97-815a-a33a20efb199 tempest-VolumesActionsTest-288059650 None] Lock "cinder-quobyte-03a2076b-6f25-488f-b496-4b0223de6936" released by "delete_volume" :: held 2.018s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:25:56 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-e14bab55-ed5c-4d97-815a-a33a20efb199 tempest-VolumesActionsTest-288059650 None] Created reservations ['d7bf3c21-095c-4ba4-b5b6-d26792681936', 'a59707f2-7ac0-461a-93c7-2c15ace02e85', 'af5c109e-17ff-4ca5-991b-6993d1a373f9', '85f2682a-7de9-4117-a590-51bb1f67f071'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:25:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e14bab55-ed5c-4d97-815a-a33a20efb199 tempest-VolumesActionsTest-288059650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:25:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e14bab55-ed5c-4d97-815a-a33a20efb199 tempest-VolumesActionsTest-288059650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:25:57 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-e14bab55-ed5c-4d97-815a-a33a20efb199 tempest-VolumesActionsTest-288059650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:25:57 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-e14bab55-ed5c-4d97-815a-a33a20efb199 tempest-VolumesActionsTest-288059650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:25:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e14bab55-ed5c-4d97-815a-a33a20efb199 tempest-VolumesActionsTest-288059650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:25:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e14bab55-ed5c-4d97-815a-a33a20efb199 tempest-VolumesActionsTest-288059650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:25:57 devstack sudo[90590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:25:57 devstack sudo[90590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:25:57 devstack sudo[90590]: pam_unix(sudo:session): session closed for user root
Jul 14 16:25:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e14bab55-ed5c-4d97-815a-a33a20efb199 tempest-VolumesActionsTest-288059650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.462s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:25:57 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-e14bab55-ed5c-4d97-815a-a33a20efb199 tempest-VolumesActionsTest-288059650 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:25:57 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-e14bab55-ed5c-4d97-815a-a33a20efb199 tempest-VolumesActionsTest-288059650 None] Deleted volume successfully.
Jul 14 16:25:57 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e14bab55-ed5c-4d97-815a-a33a20efb199 tempest-VolumesActionsTest-288059650 None] Lock "cinder-03a2076b-6f25-488f-b496-4b0223de6936-delete_volume" released by "delete_volume" :: held 3.098s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:26:02 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-5742309f-dd37-4e2f-bad5-655d007c5f6f tempest-ServersNegativeTestJSON-1132622876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:26:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5742309f-dd37-4e2f-bad5-655d007c5f6f tempest-ServersNegativeTestJSON-1132622876 None] Flow 'volume_create_manager' (31672512-6b82-4762-93e2-03fce81f1469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:26:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5742309f-dd37-4e2f-bad5-655d007c5f6f tempest-ServersNegativeTestJSON-1132622876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (800b1320-fcd8-4da3-9321-607b2bad9d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:26:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5742309f-dd37-4e2f-bad5-655d007c5f6f tempest-ServersNegativeTestJSON-1132622876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (800b1320-fcd8-4da3-9321-607b2bad9d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:26:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1022911437',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c75963b-69e4-4961-b764-5d5a96674bd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a37f41116bb418cb07431b337613d02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:26:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:26:03Z,use_quota=True,user_id='0d7fb5d6401e401289eb744e39b7c2f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:26:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5742309f-dd37-4e2f-bad5-655d007c5f6f tempest-ServersNegativeTestJSON-1132622876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ffd4514-aceb-44b4-af79-5001694e54d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:26:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5742309f-dd37-4e2f-bad5-655d007c5f6f tempest-ServersNegativeTestJSON-1132622876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ffd4514-aceb-44b4-af79-5001694e54d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:26:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5742309f-dd37-4e2f-bad5-655d007c5f6f tempest-ServersNegativeTestJSON-1132622876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d261152c-212e-4e5e-a3ce-aa9be7c543c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:26:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5742309f-dd37-4e2f-bad5-655d007c5f6f tempest-ServersNegativeTestJSON-1132622876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d261152c-212e-4e5e-a3ce-aa9be7c543c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c75963b-69e4-4961-b764-5d5a96674bd3', 'volume_name': 'volume-3c75963b-69e4-4961-b764-5d5a96674bd3', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:26:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5742309f-dd37-4e2f-bad5-655d007c5f6f tempest-ServersNegativeTestJSON-1132622876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99e3ce36-3e1e-417f-966a-6d9974e61ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:26:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5742309f-dd37-4e2f-bad5-655d007c5f6f tempest-ServersNegativeTestJSON-1132622876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99e3ce36-3e1e-417f-966a-6d9974e61ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:26:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5742309f-dd37-4e2f-bad5-655d007c5f6f tempest-ServersNegativeTestJSON-1132622876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (394b51b9-e06d-496b-82a7-218d87112e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:26:03 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-5742309f-dd37-4e2f-bad5-655d007c5f6f tempest-ServersNegativeTestJSON-1132622876 None] Volume 3c75963b-69e4-4961-b764-5d5a96674bd3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c75963b-69e4-4961-b764-5d5a96674bd3', 'volume_size': 1}
Jul 14 16:26:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5742309f-dd37-4e2f-bad5-655d007c5f6f tempest-ServersNegativeTestJSON-1132622876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:26:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5742309f-dd37-4e2f-bad5-655d007c5f6f tempest-ServersNegativeTestJSON-1132622876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:26:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5742309f-dd37-4e2f-bad5-655d007c5f6f tempest-ServersNegativeTestJSON-1132622876 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:26:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1022911437',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c75963b-69e4-4961-b764-5d5a96674bd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a37f41116bb418cb07431b337613d02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:26:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:26:03Z,use_quota=True,user_id='0d7fb5d6401e401289eb744e39b7c2f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:26:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-5742309f-dd37-4e2f-bad5-655d007c5f6f tempest-ServersNegativeTestJSON-1132622876 None] Creating volume 3c75963b-69e4-4961-b764-5d5a96674bd3 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:26:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5742309f-dd37-4e2f-bad5-655d007c5f6f tempest-ServersNegativeTestJSON-1132622876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:26:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5742309f-dd37-4e2f-bad5-655d007c5f6f tempest-ServersNegativeTestJSON-1132622876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:26:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5742309f-dd37-4e2f-bad5-655d007c5f6f tempest-ServersNegativeTestJSON-1132622876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:26:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5742309f-dd37-4e2f-bad5-655d007c5f6f tempest-ServersNegativeTestJSON-1132622876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:26:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5742309f-dd37-4e2f-bad5-655d007c5f6f tempest-ServersNegativeTestJSON-1132622876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:26:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5742309f-dd37-4e2f-bad5-655d007c5f6f tempest-ServersNegativeTestJSON-1132622876 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:26:03 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-5742309f-dd37-4e2f-bad5-655d007c5f6f tempest-ServersNegativeTestJSON-1132622876 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:26:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5742309f-dd37-4e2f-bad5-655d007c5f6f tempest-ServersNegativeTestJSON-1132622876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-3c75963b-69e4-4961-b764-5d5a96674bd3 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:26:03 devstack sudo[90694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-3c75963b-69e4-4961-b764-5d5a96674bd3 1073741824
Jul 14 16:26:03 devstack sudo[90694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:26:03 devstack sudo[90694]: pam_unix(sudo:session): session closed for user root
Jul 14 16:26:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5742309f-dd37-4e2f-bad5-655d007c5f6f tempest-ServersNegativeTestJSON-1132622876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-3c75963b-69e4-4961-b764-5d5a96674bd3 1073741824" returned: 0 in 0.491s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:26:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5742309f-dd37-4e2f-bad5-655d007c5f6f tempest-ServersNegativeTestJSON-1132622876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-3c75963b-69e4-4961-b764-5d5a96674bd3 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:26:03 devstack sudo[90701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-3c75963b-69e4-4961-b764-5d5a96674bd3
Jul 14 16:26:03 devstack sudo[90701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:26:03 devstack sudo[90701]: pam_unix(sudo:session): session closed for user root
Jul 14 16:26:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5742309f-dd37-4e2f-bad5-655d007c5f6f tempest-ServersNegativeTestJSON-1132622876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-3c75963b-69e4-4961-b764-5d5a96674bd3" returned: 0 in 0.362s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:26:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5742309f-dd37-4e2f-bad5-655d007c5f6f tempest-ServersNegativeTestJSON-1132622876 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:26:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5742309f-dd37-4e2f-bad5-655d007c5f6f tempest-ServersNegativeTestJSON-1132622876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:26:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5742309f-dd37-4e2f-bad5-655d007c5f6f tempest-ServersNegativeTestJSON-1132622876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (394b51b9-e06d-496b-82a7-218d87112e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c75963b-69e4-4961-b764-5d5a96674bd3', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:26:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5742309f-dd37-4e2f-bad5-655d007c5f6f tempest-ServersNegativeTestJSON-1132622876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2c7f7c0-646d-40d6-8b96-bbdb75ca32a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:26:03 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-5742309f-dd37-4e2f-bad5-655d007c5f6f tempest-ServersNegativeTestJSON-1132622876 None] Volume volume-3c75963b-69e4-4961-b764-5d5a96674bd3 (3c75963b-69e4-4961-b764-5d5a96674bd3): created successfully
Jul 14 16:26:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5742309f-dd37-4e2f-bad5-655d007c5f6f tempest-ServersNegativeTestJSON-1132622876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2c7f7c0-646d-40d6-8b96-bbdb75ca32a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:26:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5742309f-dd37-4e2f-bad5-655d007c5f6f tempest-ServersNegativeTestJSON-1132622876 None] Flow 'volume_create_manager' (31672512-6b82-4762-93e2-03fce81f1469) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:26:04 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-5742309f-dd37-4e2f-bad5-655d007c5f6f tempest-ServersNegativeTestJSON-1132622876 None] Created volume successfully.
Jul 14 16:26:04 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-01a8e969-c429-4149-8e9e-901b04c1a09e tempest-VolumesActionsTest-288059650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:26:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-01a8e969-c429-4149-8e9e-901b04c1a09e tempest-VolumesActionsTest-288059650 None] Flow 'volume_create_manager' (5cec5df0-b8e1-4317-b328-e526dd08b09a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:26:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-01a8e969-c429-4149-8e9e-901b04c1a09e tempest-VolumesActionsTest-288059650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3956dd06-ec05-49b5-8b7b-a938294b22e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:26:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-01a8e969-c429-4149-8e9e-901b04c1a09e tempest-VolumesActionsTest-288059650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3956dd06-ec05-49b5-8b7b-a938294b22e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:26:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1217116623',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30ec8c6c-a847-4e5d-aec0-3bf051c7f24f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85b645b9e13e486e95e95114ec41db50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:26:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:26:04Z,use_quota=True,user_id='70463b999b824ea89265f51945ae7195',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:26:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-01a8e969-c429-4149-8e9e-901b04c1a09e tempest-VolumesActionsTest-288059650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1ad128e-b399-4dcf-b094-074baddbea6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:26:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-01a8e969-c429-4149-8e9e-901b04c1a09e tempest-VolumesActionsTest-288059650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1ad128e-b399-4dcf-b094-074baddbea6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:26:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-01a8e969-c429-4149-8e9e-901b04c1a09e tempest-VolumesActionsTest-288059650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e644810-80e4-471b-8e52-2fc826cb16e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:26:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-01a8e969-c429-4149-8e9e-901b04c1a09e tempest-VolumesActionsTest-288059650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e644810-80e4-471b-8e52-2fc826cb16e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30ec8c6c-a847-4e5d-aec0-3bf051c7f24f', 'volume_name': 'volume-30ec8c6c-a847-4e5d-aec0-3bf051c7f24f', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:26:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-01a8e969-c429-4149-8e9e-901b04c1a09e tempest-VolumesActionsTest-288059650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02102aeb-92aa-4ca7-82d6-2472ad558fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:26:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-01a8e969-c429-4149-8e9e-901b04c1a09e tempest-VolumesActionsTest-288059650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02102aeb-92aa-4ca7-82d6-2472ad558fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:26:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-01a8e969-c429-4149-8e9e-901b04c1a09e tempest-VolumesActionsTest-288059650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e124ea14-643a-4abb-a583-640101aa164f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:26:04 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-01a8e969-c429-4149-8e9e-901b04c1a09e tempest-VolumesActionsTest-288059650 None] Volume 30ec8c6c-a847-4e5d-aec0-3bf051c7f24f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30ec8c6c-a847-4e5d-aec0-3bf051c7f24f', 'volume_size': 1}
Jul 14 16:26:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-01a8e969-c429-4149-8e9e-901b04c1a09e tempest-VolumesActionsTest-288059650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:26:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-01a8e969-c429-4149-8e9e-901b04c1a09e tempest-VolumesActionsTest-288059650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:26:04 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-01a8e969-c429-4149-8e9e-901b04c1a09e tempest-VolumesActionsTest-288059650 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:26:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1217116623',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30ec8c6c-a847-4e5d-aec0-3bf051c7f24f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85b645b9e13e486e95e95114ec41db50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:26:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:26:04Z,use_quota=True,user_id='70463b999b824ea89265f51945ae7195',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:26:04 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-01a8e969-c429-4149-8e9e-901b04c1a09e tempest-VolumesActionsTest-288059650 None] Creating volume 30ec8c6c-a847-4e5d-aec0-3bf051c7f24f {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:26:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-01a8e969-c429-4149-8e9e-901b04c1a09e tempest-VolumesActionsTest-288059650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:26:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-01a8e969-c429-4149-8e9e-901b04c1a09e tempest-VolumesActionsTest-288059650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:26:04 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-01a8e969-c429-4149-8e9e-901b04c1a09e tempest-VolumesActionsTest-288059650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:26:04 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-01a8e969-c429-4149-8e9e-901b04c1a09e tempest-VolumesActionsTest-288059650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:26:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-01a8e969-c429-4149-8e9e-901b04c1a09e tempest-VolumesActionsTest-288059650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:26:04 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-01a8e969-c429-4149-8e9e-901b04c1a09e tempest-VolumesActionsTest-288059650 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:26:04 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-01a8e969-c429-4149-8e9e-901b04c1a09e tempest-VolumesActionsTest-288059650 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:26:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-01a8e969-c429-4149-8e9e-901b04c1a09e tempest-VolumesActionsTest-288059650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-30ec8c6c-a847-4e5d-aec0-3bf051c7f24f 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:26:04 devstack sudo[90704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-30ec8c6c-a847-4e5d-aec0-3bf051c7f24f 1073741824
Jul 14 16:26:04 devstack sudo[90704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:26:05 devstack sudo[90704]: pam_unix(sudo:session): session closed for user root
Jul 14 16:26:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-01a8e969-c429-4149-8e9e-901b04c1a09e tempest-VolumesActionsTest-288059650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-30ec8c6c-a847-4e5d-aec0-3bf051c7f24f 1073741824" returned: 0 in 0.664s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:26:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-01a8e969-c429-4149-8e9e-901b04c1a09e tempest-VolumesActionsTest-288059650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-30ec8c6c-a847-4e5d-aec0-3bf051c7f24f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:26:05 devstack sudo[90710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-30ec8c6c-a847-4e5d-aec0-3bf051c7f24f
Jul 14 16:26:05 devstack sudo[90710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:26:05 devstack sudo[90710]: pam_unix(sudo:session): session closed for user root
Jul 14 16:26:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-01a8e969-c429-4149-8e9e-901b04c1a09e tempest-VolumesActionsTest-288059650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-30ec8c6c-a847-4e5d-aec0-3bf051c7f24f" returned: 0 in 0.407s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:26:05 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-01a8e969-c429-4149-8e9e-901b04c1a09e tempest-VolumesActionsTest-288059650 None] <== create_volume: return (1196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:26:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-01a8e969-c429-4149-8e9e-901b04c1a09e tempest-VolumesActionsTest-288059650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.199s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:26:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-01a8e969-c429-4149-8e9e-901b04c1a09e tempest-VolumesActionsTest-288059650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e124ea14-643a-4abb-a583-640101aa164f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30ec8c6c-a847-4e5d-aec0-3bf051c7f24f', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:26:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-01a8e969-c429-4149-8e9e-901b04c1a09e tempest-VolumesActionsTest-288059650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66e6cb6e-9a39-4841-bc89-6a9b63636759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:26:05 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-01a8e969-c429-4149-8e9e-901b04c1a09e tempest-VolumesActionsTest-288059650 None] Volume volume-30ec8c6c-a847-4e5d-aec0-3bf051c7f24f (30ec8c6c-a847-4e5d-aec0-3bf051c7f24f): created successfully
Jul 14 16:26:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-01a8e969-c429-4149-8e9e-901b04c1a09e tempest-VolumesActionsTest-288059650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66e6cb6e-9a39-4841-bc89-6a9b63636759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:26:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-01a8e969-c429-4149-8e9e-901b04c1a09e tempest-VolumesActionsTest-288059650 None] Flow 'volume_create_manager' (5cec5df0-b8e1-4317-b328-e526dd08b09a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:26:05 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-01a8e969-c429-4149-8e9e-901b04c1a09e tempest-VolumesActionsTest-288059650 None] Created volume successfully.
Jul 14 16:26:06 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d6a7bbf5-f378-4608-ada8-9e1a92db11c2 tempest-VolumesActionsTest-1748201626 None] Acquiring lock "cinder-30ec8c6c-a847-4e5d-aec0-3bf051c7f24f-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:26:07 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d6a7bbf5-f378-4608-ada8-9e1a92db11c2 tempest-VolumesActionsTest-1748201626 None] Lock "cinder-30ec8c6c-a847-4e5d-aec0-3bf051c7f24f-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:26:07 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d6a7bbf5-f378-4608-ada8-9e1a92db11c2 tempest-VolumesActionsTest-1748201626 None] Acquiring lock "cinder-quobyte-30ec8c6c-a847-4e5d-aec0-3bf051c7f24f" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:26:07 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d6a7bbf5-f378-4608-ada8-9e1a92db11c2 tempest-VolumesActionsTest-1748201626 None] Lock "cinder-quobyte-30ec8c6c-a847-4e5d-aec0-3bf051c7f24f" acquired by "delete_volume" :: waited 0.023s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:26:07 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[96aa1a02-6d90-4c08-9cb8-e0bab63c9436]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:26:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d6a7bbf5-f378-4608-ada8-9e1a92db11c2 tempest-VolumesActionsTest-1748201626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-30ec8c6c-a847-4e5d-aec0-3bf051c7f24f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:26:07 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b4af612-acd1-4bc7-9ae7-f857ce40d44a tempest-ServersNegativeTestJSON-1132622876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:26:07 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5b4af612-acd1-4bc7-9ae7-f857ce40d44a tempest-ServersNegativeTestJSON-1132622876 None] Flow 'volume_create_manager' (ef65a380-1e3b-4c6a-a72f-69299484e11f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:26:07 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5b4af612-acd1-4bc7-9ae7-f857ce40d44a tempest-ServersNegativeTestJSON-1132622876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a803df3-7a73-453b-8dab-ac38b3859757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:26:07 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5b4af612-acd1-4bc7-9ae7-f857ce40d44a tempest-ServersNegativeTestJSON-1132622876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a803df3-7a73-453b-8dab-ac38b3859757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:26:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-834722463',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb26af24-db5c-4ea4-bcf6-fec79ae32672,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a37f41116bb418cb07431b337613d02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:26:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:26:07Z,use_quota=True,user_id='0d7fb5d6401e401289eb744e39b7c2f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:26:07 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5b4af612-acd1-4bc7-9ae7-f857ce40d44a tempest-ServersNegativeTestJSON-1132622876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4a3dd03-ee84-4d59-905f-6b389acf16b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:26:07 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5b4af612-acd1-4bc7-9ae7-f857ce40d44a tempest-ServersNegativeTestJSON-1132622876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4a3dd03-ee84-4d59-905f-6b389acf16b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:26:07 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5b4af612-acd1-4bc7-9ae7-f857ce40d44a tempest-ServersNegativeTestJSON-1132622876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db9cf8d4-33a2-4a5d-b365-3eb0997e5e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:26:07 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5b4af612-acd1-4bc7-9ae7-f857ce40d44a tempest-ServersNegativeTestJSON-1132622876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db9cf8d4-33a2-4a5d-b365-3eb0997e5e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb26af24-db5c-4ea4-bcf6-fec79ae32672', 'volume_name': 'volume-fb26af24-db5c-4ea4-bcf6-fec79ae32672', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:26:07 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5b4af612-acd1-4bc7-9ae7-f857ce40d44a tempest-ServersNegativeTestJSON-1132622876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e73ee67-2154-4576-8efd-7dd073a18c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:26:07 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5b4af612-acd1-4bc7-9ae7-f857ce40d44a tempest-ServersNegativeTestJSON-1132622876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e73ee67-2154-4576-8efd-7dd073a18c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:26:07 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5b4af612-acd1-4bc7-9ae7-f857ce40d44a tempest-ServersNegativeTestJSON-1132622876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9306f6e8-7258-4641-b023-edac02043c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:26:07 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-5b4af612-acd1-4bc7-9ae7-f857ce40d44a tempest-ServersNegativeTestJSON-1132622876 None] Volume fb26af24-db5c-4ea4-bcf6-fec79ae32672: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb26af24-db5c-4ea4-bcf6-fec79ae32672', 'volume_size': 1}
Jul 14 16:26:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5b4af612-acd1-4bc7-9ae7-f857ce40d44a tempest-ServersNegativeTestJSON-1132622876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:26:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5b4af612-acd1-4bc7-9ae7-f857ce40d44a tempest-ServersNegativeTestJSON-1132622876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:26:07 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5b4af612-acd1-4bc7-9ae7-f857ce40d44a tempest-ServersNegativeTestJSON-1132622876 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:26:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-834722463',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb26af24-db5c-4ea4-bcf6-fec79ae32672,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a37f41116bb418cb07431b337613d02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:26:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:26:07Z,use_quota=True,user_id='0d7fb5d6401e401289eb744e39b7c2f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:26:07 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-5b4af612-acd1-4bc7-9ae7-f857ce40d44a tempest-ServersNegativeTestJSON-1132622876 None] Creating volume fb26af24-db5c-4ea4-bcf6-fec79ae32672 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:26:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5b4af612-acd1-4bc7-9ae7-f857ce40d44a tempest-ServersNegativeTestJSON-1132622876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:26:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5b4af612-acd1-4bc7-9ae7-f857ce40d44a tempest-ServersNegativeTestJSON-1132622876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:26:07 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5b4af612-acd1-4bc7-9ae7-f857ce40d44a tempest-ServersNegativeTestJSON-1132622876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:26:07 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5b4af612-acd1-4bc7-9ae7-f857ce40d44a tempest-ServersNegativeTestJSON-1132622876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:26:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5b4af612-acd1-4bc7-9ae7-f857ce40d44a tempest-ServersNegativeTestJSON-1132622876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:26:07 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5b4af612-acd1-4bc7-9ae7-f857ce40d44a tempest-ServersNegativeTestJSON-1132622876 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:26:07 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-5b4af612-acd1-4bc7-9ae7-f857ce40d44a tempest-ServersNegativeTestJSON-1132622876 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:26:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5b4af612-acd1-4bc7-9ae7-f857ce40d44a tempest-ServersNegativeTestJSON-1132622876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fb26af24-db5c-4ea4-bcf6-fec79ae32672 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:26:07 devstack sudo[90756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-30ec8c6c-a847-4e5d-aec0-3bf051c7f24f
Jul 14 16:26:07 devstack sudo[90756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:26:07 devstack sudo[90758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fb26af24-db5c-4ea4-bcf6-fec79ae32672 1073741824
Jul 14 16:26:07 devstack sudo[90758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:26:07 devstack sudo[90756]: pam_unix(sudo:session): session closed for user root
Jul 14 16:26:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d6a7bbf5-f378-4608-ada8-9e1a92db11c2 tempest-VolumesActionsTest-1748201626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-30ec8c6c-a847-4e5d-aec0-3bf051c7f24f" returned: 0 in 0.413s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:26:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d6a7bbf5-f378-4608-ada8-9e1a92db11c2 tempest-VolumesActionsTest-1748201626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-30ec8c6c-a847-4e5d-aec0-3bf051c7f24f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:26:07 devstack sudo[90767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-30ec8c6c-a847-4e5d-aec0-3bf051c7f24f
Jul 14 16:26:07 devstack sudo[90767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:26:07 devstack sudo[90758]: pam_unix(sudo:session): session closed for user root
Jul 14 16:26:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5b4af612-acd1-4bc7-9ae7-f857ce40d44a tempest-ServersNegativeTestJSON-1132622876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fb26af24-db5c-4ea4-bcf6-fec79ae32672 1073741824" returned: 0 in 0.458s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:26:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5b4af612-acd1-4bc7-9ae7-f857ce40d44a tempest-ServersNegativeTestJSON-1132622876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fb26af24-db5c-4ea4-bcf6-fec79ae32672 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:26:07 devstack sudo[90770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fb26af24-db5c-4ea4-bcf6-fec79ae32672
Jul 14 16:26:07 devstack sudo[90770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:26:07 devstack sudo[90767]: pam_unix(sudo:session): session closed for user root
Jul 14 16:26:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d6a7bbf5-f378-4608-ada8-9e1a92db11c2 tempest-VolumesActionsTest-1748201626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-30ec8c6c-a847-4e5d-aec0-3bf051c7f24f" returned: 0 in 0.279s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:26:07 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d6a7bbf5-f378-4608-ada8-9e1a92db11c2 tempest-VolumesActionsTest-1748201626 None] Lock "cinder-quobyte-30ec8c6c-a847-4e5d-aec0-3bf051c7f24f" released by "delete_volume" :: held 0.760s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:26:07 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-d6a7bbf5-f378-4608-ada8-9e1a92db11c2 tempest-VolumesActionsTest-1748201626 None] Created reservations ['00842bac-dfb4-4d1c-b3f9-1747132ed7c2', '1e3c61ee-4882-468c-971e-28bed811668d', 'a5a9a72f-c0a7-453d-aabe-bbca15115564', '5f62f2b4-cc5d-41cc-94b5-a9d830752ba8'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:26:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d6a7bbf5-f378-4608-ada8-9e1a92db11c2 tempest-VolumesActionsTest-1748201626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:26:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d6a7bbf5-f378-4608-ada8-9e1a92db11c2 tempest-VolumesActionsTest-1748201626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:26:07 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d6a7bbf5-f378-4608-ada8-9e1a92db11c2 tempest-VolumesActionsTest-1748201626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:26:08 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d6a7bbf5-f378-4608-ada8-9e1a92db11c2 tempest-VolumesActionsTest-1748201626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:26:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d6a7bbf5-f378-4608-ada8-9e1a92db11c2 tempest-VolumesActionsTest-1748201626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:26:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d6a7bbf5-f378-4608-ada8-9e1a92db11c2 tempest-VolumesActionsTest-1748201626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:26:08 devstack sudo[90773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:26:08 devstack sudo[90773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:26:08 devstack sudo[90770]: pam_unix(sudo:session): session closed for user root
Jul 14 16:26:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5b4af612-acd1-4bc7-9ae7-f857ce40d44a tempest-ServersNegativeTestJSON-1132622876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fb26af24-db5c-4ea4-bcf6-fec79ae32672" returned: 0 in 0.277s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:26:08 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5b4af612-acd1-4bc7-9ae7-f857ce40d44a tempest-ServersNegativeTestJSON-1132622876 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:26:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5b4af612-acd1-4bc7-9ae7-f857ce40d44a tempest-ServersNegativeTestJSON-1132622876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:26:08 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5b4af612-acd1-4bc7-9ae7-f857ce40d44a tempest-ServersNegativeTestJSON-1132622876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9306f6e8-7258-4641-b023-edac02043c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb26af24-db5c-4ea4-bcf6-fec79ae32672', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:26:08 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5b4af612-acd1-4bc7-9ae7-f857ce40d44a tempest-ServersNegativeTestJSON-1132622876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b3edb10-2be9-4a97-8a8c-08efe785aeb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:26:08 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-5b4af612-acd1-4bc7-9ae7-f857ce40d44a tempest-ServersNegativeTestJSON-1132622876 None] Volume volume-fb26af24-db5c-4ea4-bcf6-fec79ae32672 (fb26af24-db5c-4ea4-bcf6-fec79ae32672): created successfully
Jul 14 16:26:08 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5b4af612-acd1-4bc7-9ae7-f857ce40d44a tempest-ServersNegativeTestJSON-1132622876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b3edb10-2be9-4a97-8a8c-08efe785aeb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:26:08 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5b4af612-acd1-4bc7-9ae7-f857ce40d44a tempest-ServersNegativeTestJSON-1132622876 None] Flow 'volume_create_manager' (ef65a380-1e3b-4c6a-a72f-69299484e11f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:26:08 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-5b4af612-acd1-4bc7-9ae7-f857ce40d44a tempest-ServersNegativeTestJSON-1132622876 None] Created volume successfully.
Jul 14 16:26:08 devstack sudo[90773]: pam_unix(sudo:session): session closed for user root
Jul 14 16:26:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d6a7bbf5-f378-4608-ada8-9e1a92db11c2 tempest-VolumesActionsTest-1748201626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.272s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:26:08 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-d6a7bbf5-f378-4608-ada8-9e1a92db11c2 tempest-VolumesActionsTest-1748201626 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:26:08 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-d6a7bbf5-f378-4608-ada8-9e1a92db11c2 tempest-VolumesActionsTest-1748201626 None] Deleted volume successfully.
Jul 14 16:26:08 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d6a7bbf5-f378-4608-ada8-9e1a92db11c2 tempest-VolumesActionsTest-1748201626 None] Lock "cinder-30ec8c6c-a847-4e5d-aec0-3bf051c7f24f-delete_volume" released by "delete_volume" :: held 1.285s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:26:08 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-32cbfbce-504f-4c5a-a9aa-ee1539ae2458 tempest-VolumesActionsTest-288059650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:26:08 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-32cbfbce-504f-4c5a-a9aa-ee1539ae2458 tempest-VolumesActionsTest-288059650 None] Flow 'volume_create_manager' (653d6199-b99c-4a19-b84a-b30fd8ddc5e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:26:08 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-32cbfbce-504f-4c5a-a9aa-ee1539ae2458 tempest-VolumesActionsTest-288059650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (959120ba-88ab-4817-9466-a1f7c40f9ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:26:08 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-32cbfbce-504f-4c5a-a9aa-ee1539ae2458 tempest-VolumesActionsTest-288059650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (959120ba-88ab-4817-9466-a1f7c40f9ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:26:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1107102817',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6577102-cd6f-4a67-b3e2-aa508625d46e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85b645b9e13e486e95e95114ec41db50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:26:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:26:09Z,use_quota=True,user_id='70463b999b824ea89265f51945ae7195',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:26:08 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-32cbfbce-504f-4c5a-a9aa-ee1539ae2458 tempest-VolumesActionsTest-288059650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a63947e-2af9-4dbc-9997-890461a97ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:26:08 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-32cbfbce-504f-4c5a-a9aa-ee1539ae2458 tempest-VolumesActionsTest-288059650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a63947e-2af9-4dbc-9997-890461a97ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:26:08 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-32cbfbce-504f-4c5a-a9aa-ee1539ae2458 tempest-VolumesActionsTest-288059650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9706695c-cc8f-4094-87ed-bfd64fbb3723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:26:08 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-32cbfbce-504f-4c5a-a9aa-ee1539ae2458 tempest-VolumesActionsTest-288059650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9706695c-cc8f-4094-87ed-bfd64fbb3723) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6577102-cd6f-4a67-b3e2-aa508625d46e', 'volume_name': 'volume-f6577102-cd6f-4a67-b3e2-aa508625d46e', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:26:08 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-32cbfbce-504f-4c5a-a9aa-ee1539ae2458 tempest-VolumesActionsTest-288059650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca32ecaf-b703-4ebd-b748-a47e6dd32668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:26:08 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-32cbfbce-504f-4c5a-a9aa-ee1539ae2458 tempest-VolumesActionsTest-288059650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca32ecaf-b703-4ebd-b748-a47e6dd32668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:26:08 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-32cbfbce-504f-4c5a-a9aa-ee1539ae2458 tempest-VolumesActionsTest-288059650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16430387-79b3-4768-b75b-d651e347edb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:26:08 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-32cbfbce-504f-4c5a-a9aa-ee1539ae2458 tempest-VolumesActionsTest-288059650 None] Volume f6577102-cd6f-4a67-b3e2-aa508625d46e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6577102-cd6f-4a67-b3e2-aa508625d46e', 'volume_size': 1}
Jul 14 16:26:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-32cbfbce-504f-4c5a-a9aa-ee1539ae2458 tempest-VolumesActionsTest-288059650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:26:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-32cbfbce-504f-4c5a-a9aa-ee1539ae2458 tempest-VolumesActionsTest-288059650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:26:08 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-32cbfbce-504f-4c5a-a9aa-ee1539ae2458 tempest-VolumesActionsTest-288059650 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:26:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1107102817',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6577102-cd6f-4a67-b3e2-aa508625d46e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85b645b9e13e486e95e95114ec41db50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:26:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:26:09Z,use_quota=True,user_id='70463b999b824ea89265f51945ae7195',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:26:08 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-32cbfbce-504f-4c5a-a9aa-ee1539ae2458 tempest-VolumesActionsTest-288059650 None] Creating volume f6577102-cd6f-4a67-b3e2-aa508625d46e {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:26:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-32cbfbce-504f-4c5a-a9aa-ee1539ae2458 tempest-VolumesActionsTest-288059650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:26:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-32cbfbce-504f-4c5a-a9aa-ee1539ae2458 tempest-VolumesActionsTest-288059650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:26:08 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-32cbfbce-504f-4c5a-a9aa-ee1539ae2458 tempest-VolumesActionsTest-288059650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:26:08 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-32cbfbce-504f-4c5a-a9aa-ee1539ae2458 tempest-VolumesActionsTest-288059650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:26:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-32cbfbce-504f-4c5a-a9aa-ee1539ae2458 tempest-VolumesActionsTest-288059650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:26:08 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-32cbfbce-504f-4c5a-a9aa-ee1539ae2458 tempest-VolumesActionsTest-288059650 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:26:08 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-32cbfbce-504f-4c5a-a9aa-ee1539ae2458 tempest-VolumesActionsTest-288059650 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:26:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-32cbfbce-504f-4c5a-a9aa-ee1539ae2458 tempest-VolumesActionsTest-288059650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f6577102-cd6f-4a67-b3e2-aa508625d46e 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:26:08 devstack sudo[90778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f6577102-cd6f-4a67-b3e2-aa508625d46e 1073741824
Jul 14 16:26:08 devstack sudo[90778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:26:09 devstack sudo[90778]: pam_unix(sudo:session): session closed for user root
Jul 14 16:26:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-32cbfbce-504f-4c5a-a9aa-ee1539ae2458 tempest-VolumesActionsTest-288059650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f6577102-cd6f-4a67-b3e2-aa508625d46e 1073741824" returned: 0 in 0.466s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:26:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-32cbfbce-504f-4c5a-a9aa-ee1539ae2458 tempest-VolumesActionsTest-288059650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f6577102-cd6f-4a67-b3e2-aa508625d46e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:26:09 devstack sudo[90784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f6577102-cd6f-4a67-b3e2-aa508625d46e
Jul 14 16:26:09 devstack sudo[90784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:26:09 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f72a571d-b109-45a4-8845-5ab1ca439e77 tempest-ServersNegativeTestJSON-1132622876 None] Acquiring lock "cinder-fb26af24-db5c-4ea4-bcf6-fec79ae32672-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:26:09 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f72a571d-b109-45a4-8845-5ab1ca439e77 tempest-ServersNegativeTestJSON-1132622876 None] Lock "cinder-fb26af24-db5c-4ea4-bcf6-fec79ae32672-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:26:09 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f72a571d-b109-45a4-8845-5ab1ca439e77 tempest-ServersNegativeTestJSON-1132622876 None] Acquiring lock "cinder-quobyte-fb26af24-db5c-4ea4-bcf6-fec79ae32672" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:26:09 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f72a571d-b109-45a4-8845-5ab1ca439e77 tempest-ServersNegativeTestJSON-1132622876 None] Lock "cinder-quobyte-fb26af24-db5c-4ea4-bcf6-fec79ae32672" acquired by "delete_volume" :: waited 0.028s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:26:09 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0bd465-8ce2-41d7-a47b-aa58d39aa5ab]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:26:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f72a571d-b109-45a4-8845-5ab1ca439e77 tempest-ServersNegativeTestJSON-1132622876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fb26af24-db5c-4ea4-bcf6-fec79ae32672 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:26:09 devstack sudo[90784]: pam_unix(sudo:session): session closed for user root
Jul 14 16:26:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-32cbfbce-504f-4c5a-a9aa-ee1539ae2458 tempest-VolumesActionsTest-288059650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f6577102-cd6f-4a67-b3e2-aa508625d46e" returned: 0 in 0.328s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:26:09 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-32cbfbce-504f-4c5a-a9aa-ee1539ae2458 tempest-VolumesActionsTest-288059650 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:26:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-32cbfbce-504f-4c5a-a9aa-ee1539ae2458 tempest-VolumesActionsTest-288059650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:26:09 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-32cbfbce-504f-4c5a-a9aa-ee1539ae2458 tempest-VolumesActionsTest-288059650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16430387-79b3-4768-b75b-d651e347edb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6577102-cd6f-4a67-b3e2-aa508625d46e', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:26:09 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-32cbfbce-504f-4c5a-a9aa-ee1539ae2458 tempest-VolumesActionsTest-288059650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3da99665-d00b-4bef-a41d-a3c36312f8d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:26:09 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-32cbfbce-504f-4c5a-a9aa-ee1539ae2458 tempest-VolumesActionsTest-288059650 None] Volume volume-f6577102-cd6f-4a67-b3e2-aa508625d46e (f6577102-cd6f-4a67-b3e2-aa508625d46e): created successfully
Jul 14 16:26:09 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-32cbfbce-504f-4c5a-a9aa-ee1539ae2458 tempest-VolumesActionsTest-288059650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3da99665-d00b-4bef-a41d-a3c36312f8d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:26:09 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-32cbfbce-504f-4c5a-a9aa-ee1539ae2458 tempest-VolumesActionsTest-288059650 None] Flow 'volume_create_manager' (653d6199-b99c-4a19-b84a-b30fd8ddc5e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:26:09 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-32cbfbce-504f-4c5a-a9aa-ee1539ae2458 tempest-VolumesActionsTest-288059650 None] Created volume successfully.
Jul 14 16:26:09 devstack sudo[90787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fb26af24-db5c-4ea4-bcf6-fec79ae32672
Jul 14 16:26:09 devstack sudo[90787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:26:10 devstack sudo[90787]: pam_unix(sudo:session): session closed for user root
Jul 14 16:26:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f72a571d-b109-45a4-8845-5ab1ca439e77 tempest-ServersNegativeTestJSON-1132622876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fb26af24-db5c-4ea4-bcf6-fec79ae32672" returned: 0 in 0.387s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:26:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f72a571d-b109-45a4-8845-5ab1ca439e77 tempest-ServersNegativeTestJSON-1132622876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fb26af24-db5c-4ea4-bcf6-fec79ae32672 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:26:10 devstack sudo[90793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fb26af24-db5c-4ea4-bcf6-fec79ae32672
Jul 14 16:26:10 devstack sudo[90793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:26:10 devstack sudo[90793]: pam_unix(sudo:session): session closed for user root
Jul 14 16:26:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f72a571d-b109-45a4-8845-5ab1ca439e77 tempest-ServersNegativeTestJSON-1132622876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fb26af24-db5c-4ea4-bcf6-fec79ae32672" returned: 0 in 0.259s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:26:10 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f72a571d-b109-45a4-8845-5ab1ca439e77 tempest-ServersNegativeTestJSON-1132622876 None] Lock "cinder-quobyte-fb26af24-db5c-4ea4-bcf6-fec79ae32672" released by "delete_volume" :: held 0.698s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:26:10 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-f72a571d-b109-45a4-8845-5ab1ca439e77 tempest-ServersNegativeTestJSON-1132622876 None] Created reservations ['2bdee68d-3b59-42df-8892-5e6bbf332b9f', 'e0aa1f51-799a-4804-9cbc-935277b46cc3', 'faef1fb8-672d-43ef-8881-8a63ed11eb00', '8d1050fe-deee-4dde-bb61-269853fa2d63'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:26:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f72a571d-b109-45a4-8845-5ab1ca439e77 tempest-ServersNegativeTestJSON-1132622876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:26:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f72a571d-b109-45a4-8845-5ab1ca439e77 tempest-ServersNegativeTestJSON-1132622876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:26:10 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f72a571d-b109-45a4-8845-5ab1ca439e77 tempest-ServersNegativeTestJSON-1132622876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:26:10 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f72a571d-b109-45a4-8845-5ab1ca439e77 tempest-ServersNegativeTestJSON-1132622876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:26:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f72a571d-b109-45a4-8845-5ab1ca439e77 tempest-ServersNegativeTestJSON-1132622876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:26:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f72a571d-b109-45a4-8845-5ab1ca439e77 tempest-ServersNegativeTestJSON-1132622876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:26:10 devstack sudo[90796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:26:10 devstack sudo[90796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:26:10 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-96b8f80e-d75f-4c80-a3f8-7c3ede8fdaa7 tempest-ServersNegativeTestJSON-1132622876 None] Acquiring lock "cinder-3c75963b-69e4-4961-b764-5d5a96674bd3-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:26:10 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-96b8f80e-d75f-4c80-a3f8-7c3ede8fdaa7 tempest-ServersNegativeTestJSON-1132622876 None] Lock "cinder-3c75963b-69e4-4961-b764-5d5a96674bd3-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:26:10 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-96b8f80e-d75f-4c80-a3f8-7c3ede8fdaa7 tempest-ServersNegativeTestJSON-1132622876 None] Acquiring lock "cinder-quobyte-3c75963b-69e4-4961-b764-5d5a96674bd3" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:26:10 devstack sudo[90796]: pam_unix(sudo:session): session closed for user root
Jul 14 16:26:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f72a571d-b109-45a4-8845-5ab1ca439e77 tempest-ServersNegativeTestJSON-1132622876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.323s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:26:10 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-f72a571d-b109-45a4-8845-5ab1ca439e77 tempest-ServersNegativeTestJSON-1132622876 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:26:10 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-96b8f80e-d75f-4c80-a3f8-7c3ede8fdaa7 tempest-ServersNegativeTestJSON-1132622876 None] Lock "cinder-quobyte-3c75963b-69e4-4961-b764-5d5a96674bd3" acquired by "delete_volume" :: waited 0.037s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:26:10 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-f72a571d-b109-45a4-8845-5ab1ca439e77 tempest-ServersNegativeTestJSON-1132622876 None] Deleted volume successfully.
Jul 14 16:26:10 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a0b1cd-b33f-4110-8b1b-5cdb62745ef5]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:26:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-96b8f80e-d75f-4c80-a3f8-7c3ede8fdaa7 tempest-ServersNegativeTestJSON-1132622876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-3c75963b-69e4-4961-b764-5d5a96674bd3 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:26:10 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f72a571d-b109-45a4-8845-5ab1ca439e77 tempest-ServersNegativeTestJSON-1132622876 None] Lock "cinder-fb26af24-db5c-4ea4-bcf6-fec79ae32672-delete_volume" released by "delete_volume" :: held 1.372s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:26:11 devstack sudo[90805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-3c75963b-69e4-4961-b764-5d5a96674bd3
Jul 14 16:26:11 devstack sudo[90805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:26:11 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-391b926e-f3e6-47ba-9f2c-2e741da20272 tempest-VolumesActionsTest-1748201626 None] Acquiring lock "cinder-f6577102-cd6f-4a67-b3e2-aa508625d46e-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:26:11 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-391b926e-f3e6-47ba-9f2c-2e741da20272 tempest-VolumesActionsTest-1748201626 None] Lock "cinder-f6577102-cd6f-4a67-b3e2-aa508625d46e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:26:11 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-391b926e-f3e6-47ba-9f2c-2e741da20272 tempest-VolumesActionsTest-1748201626 None] Acquiring lock "cinder-quobyte-f6577102-cd6f-4a67-b3e2-aa508625d46e" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:26:11 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-391b926e-f3e6-47ba-9f2c-2e741da20272 tempest-VolumesActionsTest-1748201626 None] Lock "cinder-quobyte-f6577102-cd6f-4a67-b3e2-aa508625d46e" acquired by "delete_volume" :: waited 0.022s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:26:11 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[5218a7aa-a4dc-4321-abd5-d520a4be99a8]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:26:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-391b926e-f3e6-47ba-9f2c-2e741da20272 tempest-VolumesActionsTest-1748201626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f6577102-cd6f-4a67-b3e2-aa508625d46e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:26:11 devstack sudo[90805]: pam_unix(sudo:session): session closed for user root
Jul 14 16:26:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-96b8f80e-d75f-4c80-a3f8-7c3ede8fdaa7 tempest-ServersNegativeTestJSON-1132622876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-3c75963b-69e4-4961-b764-5d5a96674bd3" returned: 0 in 0.403s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:26:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-96b8f80e-d75f-4c80-a3f8-7c3ede8fdaa7 tempest-ServersNegativeTestJSON-1132622876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-3c75963b-69e4-4961-b764-5d5a96674bd3 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:26:11 devstack sudo[90811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-3c75963b-69e4-4961-b764-5d5a96674bd3
Jul 14 16:26:11 devstack sudo[90811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:26:11 devstack sudo[90808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f6577102-cd6f-4a67-b3e2-aa508625d46e
Jul 14 16:26:11 devstack sudo[90808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:26:11 devstack sudo[90811]: pam_unix(sudo:session): session closed for user root
Jul 14 16:26:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-96b8f80e-d75f-4c80-a3f8-7c3ede8fdaa7 tempest-ServersNegativeTestJSON-1132622876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-3c75963b-69e4-4961-b764-5d5a96674bd3" returned: 0 in 0.282s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:26:11 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-96b8f80e-d75f-4c80-a3f8-7c3ede8fdaa7 tempest-ServersNegativeTestJSON-1132622876 None] Lock "cinder-quobyte-3c75963b-69e4-4961-b764-5d5a96674bd3" released by "delete_volume" :: held 0.729s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:26:11 devstack sudo[90808]: pam_unix(sudo:session): session closed for user root
Jul 14 16:26:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-391b926e-f3e6-47ba-9f2c-2e741da20272 tempest-VolumesActionsTest-1748201626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f6577102-cd6f-4a67-b3e2-aa508625d46e" returned: 0 in 0.408s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:26:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-391b926e-f3e6-47ba-9f2c-2e741da20272 tempest-VolumesActionsTest-1748201626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f6577102-cd6f-4a67-b3e2-aa508625d46e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:26:11 devstack sudo[90818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f6577102-cd6f-4a67-b3e2-aa508625d46e
Jul 14 16:26:11 devstack sudo[90818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:26:11 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-96b8f80e-d75f-4c80-a3f8-7c3ede8fdaa7 tempest-ServersNegativeTestJSON-1132622876 None] Created reservations ['825a726f-ca97-4a5f-b038-e718dcfa2232', '62a4fd3f-d0f4-4e4d-b984-89574f2dbfdf', '2baedd4b-0941-45af-a95c-120bb7db74bb', '9a4d0fe1-4e27-46a0-82fc-c26b0abfb66f'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:26:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-96b8f80e-d75f-4c80-a3f8-7c3ede8fdaa7 tempest-ServersNegativeTestJSON-1132622876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:26:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-96b8f80e-d75f-4c80-a3f8-7c3ede8fdaa7 tempest-ServersNegativeTestJSON-1132622876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:26:11 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-96b8f80e-d75f-4c80-a3f8-7c3ede8fdaa7 tempest-ServersNegativeTestJSON-1132622876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:26:11 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-96b8f80e-d75f-4c80-a3f8-7c3ede8fdaa7 tempest-ServersNegativeTestJSON-1132622876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:26:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-96b8f80e-d75f-4c80-a3f8-7c3ede8fdaa7 tempest-ServersNegativeTestJSON-1132622876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:26:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-96b8f80e-d75f-4c80-a3f8-7c3ede8fdaa7 tempest-ServersNegativeTestJSON-1132622876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:26:11 devstack sudo[90820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:26:11 devstack sudo[90820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:26:11 devstack sudo[90818]: pam_unix(sudo:session): session closed for user root
Jul 14 16:26:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-391b926e-f3e6-47ba-9f2c-2e741da20272 tempest-VolumesActionsTest-1748201626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f6577102-cd6f-4a67-b3e2-aa508625d46e" returned: 0 in 0.299s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:26:11 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-391b926e-f3e6-47ba-9f2c-2e741da20272 tempest-VolumesActionsTest-1748201626 None] Lock "cinder-quobyte-f6577102-cd6f-4a67-b3e2-aa508625d46e" released by "delete_volume" :: held 0.763s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:26:12 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-391b926e-f3e6-47ba-9f2c-2e741da20272 tempest-VolumesActionsTest-1748201626 None] Created reservations ['bd38df9b-5f3c-4c6d-b9ea-6a2cd22597b2', '5190034c-837e-4532-a63e-245e2a1feae3', '48dbaa91-a9db-432d-a68d-4d252e644b65', '2fc2b309-2896-4695-9a80-5c3960bb31cc'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:26:12 devstack sudo[90820]: pam_unix(sudo:session): session closed for user root
Jul 14 16:26:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-96b8f80e-d75f-4c80-a3f8-7c3ede8fdaa7 tempest-ServersNegativeTestJSON-1132622876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.375s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:26:12 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-96b8f80e-d75f-4c80-a3f8-7c3ede8fdaa7 tempest-ServersNegativeTestJSON-1132622876 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:26:12 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-96b8f80e-d75f-4c80-a3f8-7c3ede8fdaa7 tempest-ServersNegativeTestJSON-1132622876 None] Deleted volume successfully.
Jul 14 16:26:12 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-96b8f80e-d75f-4c80-a3f8-7c3ede8fdaa7 tempest-ServersNegativeTestJSON-1132622876 None] Lock "cinder-3c75963b-69e4-4961-b764-5d5a96674bd3-delete_volume" released by "delete_volume" :: held 1.435s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:26:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-391b926e-f3e6-47ba-9f2c-2e741da20272 tempest-VolumesActionsTest-1748201626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:26:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-391b926e-f3e6-47ba-9f2c-2e741da20272 tempest-VolumesActionsTest-1748201626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:26:12 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-391b926e-f3e6-47ba-9f2c-2e741da20272 tempest-VolumesActionsTest-1748201626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:26:12 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-391b926e-f3e6-47ba-9f2c-2e741da20272 tempest-VolumesActionsTest-1748201626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:26:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-391b926e-f3e6-47ba-9f2c-2e741da20272 tempest-VolumesActionsTest-1748201626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:26:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-391b926e-f3e6-47ba-9f2c-2e741da20272 tempest-VolumesActionsTest-1748201626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:26:12 devstack sudo[90824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:26:12 devstack sudo[90824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:26:12 devstack sudo[90824]: pam_unix(sudo:session): session closed for user root
Jul 14 16:26:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-391b926e-f3e6-47ba-9f2c-2e741da20272 tempest-VolumesActionsTest-1748201626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.387s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:26:12 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-391b926e-f3e6-47ba-9f2c-2e741da20272 tempest-VolumesActionsTest-1748201626 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:26:12 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-391b926e-f3e6-47ba-9f2c-2e741da20272 tempest-VolumesActionsTest-1748201626 None] Deleted volume successfully.
Jul 14 16:26:12 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-391b926e-f3e6-47ba-9f2c-2e741da20272 tempest-VolumesActionsTest-1748201626 None] Lock "cinder-f6577102-cd6f-4a67-b3e2-aa508625d46e-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:26:13 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0b036da-0446-41f4-829c-dad9972c507d tempest-VolumesActionsTest-288059650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:26:13 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e0b036da-0446-41f4-829c-dad9972c507d tempest-VolumesActionsTest-288059650 None] Flow 'volume_create_manager' (0ed7c3a5-4160-48a8-af01-fb1bb77ad83b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:26:13 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e0b036da-0446-41f4-829c-dad9972c507d tempest-VolumesActionsTest-288059650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fb5fb55-e5c2-4d2e-92aa-42289a0e1fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:26:13 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e0b036da-0446-41f4-829c-dad9972c507d tempest-VolumesActionsTest-288059650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fb5fb55-e5c2-4d2e-92aa-42289a0e1fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:26:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-701274717',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9548657-4939-4acc-9ce2-4c9c2aff380e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85b645b9e13e486e95e95114ec41db50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:26:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:26:13Z,use_quota=True,user_id='70463b999b824ea89265f51945ae7195',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:26:13 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e0b036da-0446-41f4-829c-dad9972c507d tempest-VolumesActionsTest-288059650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (711b5635-b7bd-4285-bfca-580cd30d36da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:26:13 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e0b036da-0446-41f4-829c-dad9972c507d tempest-VolumesActionsTest-288059650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (711b5635-b7bd-4285-bfca-580cd30d36da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:26:13 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e0b036da-0446-41f4-829c-dad9972c507d tempest-VolumesActionsTest-288059650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40332697-dee3-4d85-abf9-e946cdef6f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:26:13 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e0b036da-0446-41f4-829c-dad9972c507d tempest-VolumesActionsTest-288059650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40332697-dee3-4d85-abf9-e946cdef6f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9548657-4939-4acc-9ce2-4c9c2aff380e', 'volume_name': 'volume-f9548657-4939-4acc-9ce2-4c9c2aff380e', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:26:13 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e0b036da-0446-41f4-829c-dad9972c507d tempest-VolumesActionsTest-288059650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9185ef78-b43c-4c9a-827a-9ae8d67c9993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:26:13 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e0b036da-0446-41f4-829c-dad9972c507d tempest-VolumesActionsTest-288059650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9185ef78-b43c-4c9a-827a-9ae8d67c9993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:26:13 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e0b036da-0446-41f4-829c-dad9972c507d tempest-VolumesActionsTest-288059650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2f0f84f-b3fd-4aa1-9e32-8c874a93c473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:26:13 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-e0b036da-0446-41f4-829c-dad9972c507d tempest-VolumesActionsTest-288059650 None] Volume f9548657-4939-4acc-9ce2-4c9c2aff380e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9548657-4939-4acc-9ce2-4c9c2aff380e', 'volume_size': 1}
Jul 14 16:26:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e0b036da-0446-41f4-829c-dad9972c507d tempest-VolumesActionsTest-288059650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:26:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e0b036da-0446-41f4-829c-dad9972c507d tempest-VolumesActionsTest-288059650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:26:13 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-e0b036da-0446-41f4-829c-dad9972c507d tempest-VolumesActionsTest-288059650 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:26:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-701274717',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9548657-4939-4acc-9ce2-4c9c2aff380e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85b645b9e13e486e95e95114ec41db50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:26:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:26:13Z,use_quota=True,user_id='70463b999b824ea89265f51945ae7195',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:26:13 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-e0b036da-0446-41f4-829c-dad9972c507d tempest-VolumesActionsTest-288059650 None] Creating volume f9548657-4939-4acc-9ce2-4c9c2aff380e {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:26:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e0b036da-0446-41f4-829c-dad9972c507d tempest-VolumesActionsTest-288059650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:26:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e0b036da-0446-41f4-829c-dad9972c507d tempest-VolumesActionsTest-288059650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:26:13 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-e0b036da-0446-41f4-829c-dad9972c507d tempest-VolumesActionsTest-288059650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:26:13 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-e0b036da-0446-41f4-829c-dad9972c507d tempest-VolumesActionsTest-288059650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:26:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e0b036da-0446-41f4-829c-dad9972c507d tempest-VolumesActionsTest-288059650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:26:13 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-e0b036da-0446-41f4-829c-dad9972c507d tempest-VolumesActionsTest-288059650 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:26:13 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-e0b036da-0446-41f4-829c-dad9972c507d tempest-VolumesActionsTest-288059650 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:26:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e0b036da-0446-41f4-829c-dad9972c507d tempest-VolumesActionsTest-288059650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f9548657-4939-4acc-9ce2-4c9c2aff380e 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:26:13 devstack sudo[90850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f9548657-4939-4acc-9ce2-4c9c2aff380e 1073741824
Jul 14 16:26:13 devstack sudo[90850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:26:14 devstack sudo[90850]: pam_unix(sudo:session): session closed for user root
Jul 14 16:26:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e0b036da-0446-41f4-829c-dad9972c507d tempest-VolumesActionsTest-288059650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f9548657-4939-4acc-9ce2-4c9c2aff380e 1073741824" returned: 0 in 0.583s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:26:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e0b036da-0446-41f4-829c-dad9972c507d tempest-VolumesActionsTest-288059650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f9548657-4939-4acc-9ce2-4c9c2aff380e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:26:14 devstack sudo[90858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f9548657-4939-4acc-9ce2-4c9c2aff380e
Jul 14 16:26:14 devstack sudo[90858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:26:14 devstack sudo[90858]: pam_unix(sudo:session): session closed for user root
Jul 14 16:26:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e0b036da-0446-41f4-829c-dad9972c507d tempest-VolumesActionsTest-288059650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f9548657-4939-4acc-9ce2-4c9c2aff380e" returned: 0 in 0.380s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:26:14 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-e0b036da-0446-41f4-829c-dad9972c507d tempest-VolumesActionsTest-288059650 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:26:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e0b036da-0446-41f4-829c-dad9972c507d tempest-VolumesActionsTest-288059650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:26:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e0b036da-0446-41f4-829c-dad9972c507d tempest-VolumesActionsTest-288059650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2f0f84f-b3fd-4aa1-9e32-8c874a93c473) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9548657-4939-4acc-9ce2-4c9c2aff380e', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:26:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e0b036da-0446-41f4-829c-dad9972c507d tempest-VolumesActionsTest-288059650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03aeb1e4-29ef-47e6-9497-1fd73d685b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:26:14 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-e0b036da-0446-41f4-829c-dad9972c507d tempest-VolumesActionsTest-288059650 None] Volume volume-f9548657-4939-4acc-9ce2-4c9c2aff380e (f9548657-4939-4acc-9ce2-4c9c2aff380e): created successfully
Jul 14 16:26:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e0b036da-0446-41f4-829c-dad9972c507d tempest-VolumesActionsTest-288059650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03aeb1e4-29ef-47e6-9497-1fd73d685b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:26:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e0b036da-0446-41f4-829c-dad9972c507d tempest-VolumesActionsTest-288059650 None] Flow 'volume_create_manager' (0ed7c3a5-4160-48a8-af01-fb1bb77ad83b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:26:14 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-e0b036da-0446-41f4-829c-dad9972c507d tempest-VolumesActionsTest-288059650 None] Created volume successfully.
Jul 14 16:26:15 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-25d5be59-b3c6-4084-9226-6b412d680d79 tempest-VolumesActionsTest-1748201626 None] Acquiring lock "cinder-f9548657-4939-4acc-9ce2-4c9c2aff380e-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:26:15 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-25d5be59-b3c6-4084-9226-6b412d680d79 tempest-VolumesActionsTest-1748201626 None] Lock "cinder-f9548657-4939-4acc-9ce2-4c9c2aff380e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:26:15 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-25d5be59-b3c6-4084-9226-6b412d680d79 tempest-VolumesActionsTest-1748201626 None] Acquiring lock "cinder-quobyte-f9548657-4939-4acc-9ce2-4c9c2aff380e" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:26:15 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-25d5be59-b3c6-4084-9226-6b412d680d79 tempest-VolumesActionsTest-1748201626 None] Lock "cinder-quobyte-f9548657-4939-4acc-9ce2-4c9c2aff380e" acquired by "delete_volume" :: waited 0.015s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:26:15 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ebeebf-549c-429c-801e-6cc848691a84]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:26:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-25d5be59-b3c6-4084-9226-6b412d680d79 tempest-VolumesActionsTest-1748201626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f9548657-4939-4acc-9ce2-4c9c2aff380e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:26:15 devstack sudo[90893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f9548657-4939-4acc-9ce2-4c9c2aff380e
Jul 14 16:26:15 devstack sudo[90893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:26:16 devstack sudo[90893]: pam_unix(sudo:session): session closed for user root
Jul 14 16:26:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-25d5be59-b3c6-4084-9226-6b412d680d79 tempest-VolumesActionsTest-1748201626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f9548657-4939-4acc-9ce2-4c9c2aff380e" returned: 0 in 0.473s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:26:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-25d5be59-b3c6-4084-9226-6b412d680d79 tempest-VolumesActionsTest-1748201626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f9548657-4939-4acc-9ce2-4c9c2aff380e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:26:16 devstack sudo[90898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f9548657-4939-4acc-9ce2-4c9c2aff380e
Jul 14 16:26:16 devstack sudo[90898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:26:16 devstack sudo[90898]: pam_unix(sudo:session): session closed for user root
Jul 14 16:26:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-25d5be59-b3c6-4084-9226-6b412d680d79 tempest-VolumesActionsTest-1748201626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f9548657-4939-4acc-9ce2-4c9c2aff380e" returned: 0 in 0.288s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:26:16 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-25d5be59-b3c6-4084-9226-6b412d680d79 tempest-VolumesActionsTest-1748201626 None] Lock "cinder-quobyte-f9548657-4939-4acc-9ce2-4c9c2aff380e" released by "delete_volume" :: held 0.805s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:26:16 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-25d5be59-b3c6-4084-9226-6b412d680d79 tempest-VolumesActionsTest-1748201626 None] Created reservations ['04fe8081-d4dc-41d4-be4d-2636776349b5', '3b4822b0-4dc0-4557-a9df-aef04e736e75', '434e0b7e-e0e6-4ad9-9df2-6b20526252b8', '0f35f4cc-92f8-4faa-a68b-b87658d7a768'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:26:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-25d5be59-b3c6-4084-9226-6b412d680d79 tempest-VolumesActionsTest-1748201626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:26:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-25d5be59-b3c6-4084-9226-6b412d680d79 tempest-VolumesActionsTest-1748201626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:26:16 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-25d5be59-b3c6-4084-9226-6b412d680d79 tempest-VolumesActionsTest-1748201626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:26:16 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-25d5be59-b3c6-4084-9226-6b412d680d79 tempest-VolumesActionsTest-1748201626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:26:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-25d5be59-b3c6-4084-9226-6b412d680d79 tempest-VolumesActionsTest-1748201626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:26:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-25d5be59-b3c6-4084-9226-6b412d680d79 tempest-VolumesActionsTest-1748201626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:26:16 devstack sudo[90904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:26:16 devstack sudo[90904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:26:17 devstack sudo[90904]: pam_unix(sudo:session): session closed for user root
Jul 14 16:26:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-25d5be59-b3c6-4084-9226-6b412d680d79 tempest-VolumesActionsTest-1748201626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.362s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:26:17 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-25d5be59-b3c6-4084-9226-6b412d680d79 tempest-VolumesActionsTest-1748201626 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:26:17 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-25d5be59-b3c6-4084-9226-6b412d680d79 tempest-VolumesActionsTest-1748201626 None] Deleted volume successfully.
Jul 14 16:26:17 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-25d5be59-b3c6-4084-9226-6b412d680d79 tempest-VolumesActionsTest-1748201626 None] Lock "cinder-f9548657-4939-4acc-9ce2-4c9c2aff380e-delete_volume" released by "delete_volume" :: held 1.403s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:26:17 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb41b6b9-529d-4158-933d-589b84ea1e50 tempest-VolumesActionsTest-288059650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:26:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-eb41b6b9-529d-4158-933d-589b84ea1e50 tempest-VolumesActionsTest-288059650 None] Flow 'volume_create_manager' (aa95f007-d005-41ab-8f6c-2646771b000d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:26:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-eb41b6b9-529d-4158-933d-589b84ea1e50 tempest-VolumesActionsTest-288059650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eec8366a-d998-4c55-b29c-13fbff58f2eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:26:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-eb41b6b9-529d-4158-933d-589b84ea1e50 tempest-VolumesActionsTest-288059650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eec8366a-d998-4c55-b29c-13fbff58f2eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:26:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1043922732',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8672315-88de-4232-87b7-67d9cdc0c642,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85b645b9e13e486e95e95114ec41db50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:26:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:26:17Z,use_quota=True,user_id='70463b999b824ea89265f51945ae7195',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:26:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-eb41b6b9-529d-4158-933d-589b84ea1e50 tempest-VolumesActionsTest-288059650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a9702fd-7463-4d1a-8a21-904b58a1b70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:26:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-eb41b6b9-529d-4158-933d-589b84ea1e50 tempest-VolumesActionsTest-288059650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a9702fd-7463-4d1a-8a21-904b58a1b70b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:26:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-eb41b6b9-529d-4158-933d-589b84ea1e50 tempest-VolumesActionsTest-288059650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1491bbd7-3a30-44e6-b6ad-3dfea2ee50d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:26:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-eb41b6b9-529d-4158-933d-589b84ea1e50 tempest-VolumesActionsTest-288059650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1491bbd7-3a30-44e6-b6ad-3dfea2ee50d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8672315-88de-4232-87b7-67d9cdc0c642', 'volume_name': 'volume-f8672315-88de-4232-87b7-67d9cdc0c642', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:26:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-eb41b6b9-529d-4158-933d-589b84ea1e50 tempest-VolumesActionsTest-288059650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (171038f0-141b-4e0a-a4db-b968423daf2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:26:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-eb41b6b9-529d-4158-933d-589b84ea1e50 tempest-VolumesActionsTest-288059650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (171038f0-141b-4e0a-a4db-b968423daf2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:26:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-eb41b6b9-529d-4158-933d-589b84ea1e50 tempest-VolumesActionsTest-288059650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c48ebd18-5881-4038-8ac8-1ac3fffc22f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:26:17 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-eb41b6b9-529d-4158-933d-589b84ea1e50 tempest-VolumesActionsTest-288059650 None] Volume f8672315-88de-4232-87b7-67d9cdc0c642: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8672315-88de-4232-87b7-67d9cdc0c642', 'volume_size': 1}
Jul 14 16:26:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-eb41b6b9-529d-4158-933d-589b84ea1e50 tempest-VolumesActionsTest-288059650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:26:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-eb41b6b9-529d-4158-933d-589b84ea1e50 tempest-VolumesActionsTest-288059650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:26:17 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-eb41b6b9-529d-4158-933d-589b84ea1e50 tempest-VolumesActionsTest-288059650 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:26:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1043922732',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8672315-88de-4232-87b7-67d9cdc0c642,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85b645b9e13e486e95e95114ec41db50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:26:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:26:17Z,use_quota=True,user_id='70463b999b824ea89265f51945ae7195',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:26:17 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-eb41b6b9-529d-4158-933d-589b84ea1e50 tempest-VolumesActionsTest-288059650 None] Creating volume f8672315-88de-4232-87b7-67d9cdc0c642 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:26:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-eb41b6b9-529d-4158-933d-589b84ea1e50 tempest-VolumesActionsTest-288059650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:26:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-eb41b6b9-529d-4158-933d-589b84ea1e50 tempest-VolumesActionsTest-288059650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:26:17 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-eb41b6b9-529d-4158-933d-589b84ea1e50 tempest-VolumesActionsTest-288059650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:26:17 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-eb41b6b9-529d-4158-933d-589b84ea1e50 tempest-VolumesActionsTest-288059650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:26:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-eb41b6b9-529d-4158-933d-589b84ea1e50 tempest-VolumesActionsTest-288059650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:26:17 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-eb41b6b9-529d-4158-933d-589b84ea1e50 tempest-VolumesActionsTest-288059650 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:26:17 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-eb41b6b9-529d-4158-933d-589b84ea1e50 tempest-VolumesActionsTest-288059650 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:26:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-eb41b6b9-529d-4158-933d-589b84ea1e50 tempest-VolumesActionsTest-288059650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f8672315-88de-4232-87b7-67d9cdc0c642 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:26:17 devstack sudo[90912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f8672315-88de-4232-87b7-67d9cdc0c642 1073741824
Jul 14 16:26:17 devstack sudo[90912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:26:18 devstack sudo[90912]: pam_unix(sudo:session): session closed for user root
Jul 14 16:26:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-eb41b6b9-529d-4158-933d-589b84ea1e50 tempest-VolumesActionsTest-288059650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f8672315-88de-4232-87b7-67d9cdc0c642 1073741824" returned: 0 in 0.517s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:26:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-eb41b6b9-529d-4158-933d-589b84ea1e50 tempest-VolumesActionsTest-288059650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f8672315-88de-4232-87b7-67d9cdc0c642 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:26:18 devstack sudo[90927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f8672315-88de-4232-87b7-67d9cdc0c642
Jul 14 16:26:18 devstack sudo[90927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:26:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-6650b165-fd65-4cda-b3fe-b0d5804effbc req-80bea6a0-7ba7-4899-a957-2be85639df36 tempest-ServerActionsTestOtherA-221655283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:26:18 devstack sudo[90927]: pam_unix(sudo:session): session closed for user root
Jul 14 16:26:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-eb41b6b9-529d-4158-933d-589b84ea1e50 tempest-VolumesActionsTest-288059650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f8672315-88de-4232-87b7-67d9cdc0c642" returned: 0 in 0.285s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:26:18 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-eb41b6b9-529d-4158-933d-589b84ea1e50 tempest-VolumesActionsTest-288059650 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:26:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-eb41b6b9-529d-4158-933d-589b84ea1e50 tempest-VolumesActionsTest-288059650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:26:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-6650b165-fd65-4cda-b3fe-b0d5804effbc req-80bea6a0-7ba7-4899-a957-2be85639df36 tempest-ServerActionsTestOtherA-221655283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.192s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:26:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-eb41b6b9-529d-4158-933d-589b84ea1e50 tempest-VolumesActionsTest-288059650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c48ebd18-5881-4038-8ac8-1ac3fffc22f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8672315-88de-4232-87b7-67d9cdc0c642', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:26:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-eb41b6b9-529d-4158-933d-589b84ea1e50 tempest-VolumesActionsTest-288059650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (888b2f10-b838-4fb7-996d-23543f2c90a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:26:18 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3dc1c8-27df-4343-b25e-efdfacce59ee]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:26:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-6650b165-fd65-4cda-b3fe-b0d5804effbc req-80bea6a0-7ba7-4899-a957-2be85639df36 tempest-ServerActionsTestOtherA-221655283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6761b33a-8d29-4ba0-8cd4-1532082a0ac9 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:26:18 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-eb41b6b9-529d-4158-933d-589b84ea1e50 tempest-VolumesActionsTest-288059650 None] Volume volume-f8672315-88de-4232-87b7-67d9cdc0c642 (f8672315-88de-4232-87b7-67d9cdc0c642): created successfully
Jul 14 16:26:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-eb41b6b9-529d-4158-933d-589b84ea1e50 tempest-VolumesActionsTest-288059650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (888b2f10-b838-4fb7-996d-23543f2c90a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:26:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-eb41b6b9-529d-4158-933d-589b84ea1e50 tempest-VolumesActionsTest-288059650 None] Flow 'volume_create_manager' (aa95f007-d005-41ab-8f6c-2646771b000d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:26:18 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-eb41b6b9-529d-4158-933d-589b84ea1e50 tempest-VolumesActionsTest-288059650 None] Created volume successfully.
Jul 14 16:26:18 devstack sudo[90930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6761b33a-8d29-4ba0-8cd4-1532082a0ac9
Jul 14 16:26:18 devstack sudo[90930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:26:18 devstack sudo[90930]: pam_unix(sudo:session): session closed for user root
Jul 14 16:26:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-6650b165-fd65-4cda-b3fe-b0d5804effbc req-80bea6a0-7ba7-4899-a957-2be85639df36 tempest-ServerActionsTestOtherA-221655283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6761b33a-8d29-4ba0-8cd4-1532082a0ac9" returned: 0 in 0.375s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:26:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-6650b165-fd65-4cda-b3fe-b0d5804effbc req-80bea6a0-7ba7-4899-a957-2be85639df36 tempest-ServerActionsTestOtherA-221655283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.415s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:26:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-6650b165-fd65-4cda-b3fe-b0d5804effbc req-80bea6a0-7ba7-4899-a957-2be85639df36 tempest-ServerActionsTestOtherA-221655283 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052', 'name': 'volume-6761b33a-8d29-4ba0-8cd4-1532082a0ac9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '24402ef4-acdf-484b-9134-2fab066f1384', 'enforce_multipath': True} {{(pid=87166) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 14 16:26:18 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-6650b165-fd65-4cda-b3fe-b0d5804effbc req-80bea6a0-7ba7-4899-a957-2be85639df36 tempest-ServerActionsTestOtherA-221655283 None] attachment_update completed successfully.
Jul 14 16:26:19 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-27924ce3-46d9-4b6a-9577-aea4ebd8391f tempest-VolumesActionsTest-1748201626 None] Acquiring lock "cinder-f8672315-88de-4232-87b7-67d9cdc0c642-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:26:19 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-27924ce3-46d9-4b6a-9577-aea4ebd8391f tempest-VolumesActionsTest-1748201626 None] Lock "cinder-f8672315-88de-4232-87b7-67d9cdc0c642-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:26:19 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-27924ce3-46d9-4b6a-9577-aea4ebd8391f tempest-VolumesActionsTest-1748201626 None] Acquiring lock "cinder-quobyte-f8672315-88de-4232-87b7-67d9cdc0c642" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:26:19 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-27924ce3-46d9-4b6a-9577-aea4ebd8391f tempest-VolumesActionsTest-1748201626 None] Lock "cinder-quobyte-f8672315-88de-4232-87b7-67d9cdc0c642" acquired by "delete_volume" :: waited 0.021s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:26:19 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[28dd249e-fdad-471f-94af-e4bfb741060a]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:26:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-27924ce3-46d9-4b6a-9577-aea4ebd8391f tempest-VolumesActionsTest-1748201626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f8672315-88de-4232-87b7-67d9cdc0c642 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:26:20 devstack sudo[91320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f8672315-88de-4232-87b7-67d9cdc0c642
Jul 14 16:26:20 devstack sudo[91320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:26:20 devstack sudo[91320]: pam_unix(sudo:session): session closed for user root
Jul 14 16:26:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-27924ce3-46d9-4b6a-9577-aea4ebd8391f tempest-VolumesActionsTest-1748201626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f8672315-88de-4232-87b7-67d9cdc0c642" returned: 0 in 0.416s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:26:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-27924ce3-46d9-4b6a-9577-aea4ebd8391f tempest-VolumesActionsTest-1748201626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f8672315-88de-4232-87b7-67d9cdc0c642 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:26:20 devstack sudo[91325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f8672315-88de-4232-87b7-67d9cdc0c642
Jul 14 16:26:20 devstack sudo[91325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:26:20 devstack sudo[91325]: pam_unix(sudo:session): session closed for user root
Jul 14 16:26:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-27924ce3-46d9-4b6a-9577-aea4ebd8391f tempest-VolumesActionsTest-1748201626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f8672315-88de-4232-87b7-67d9cdc0c642" returned: 0 in 0.306s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:26:20 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-27924ce3-46d9-4b6a-9577-aea4ebd8391f tempest-VolumesActionsTest-1748201626 None] Lock "cinder-quobyte-f8672315-88de-4232-87b7-67d9cdc0c642" released by "delete_volume" :: held 0.772s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:26:20 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-27924ce3-46d9-4b6a-9577-aea4ebd8391f tempest-VolumesActionsTest-1748201626 None] Created reservations ['7bc1377f-9908-4a3f-b2fc-98951a566e3a', 'c79c7bd8-cc27-482a-aff2-6cd84e53199d', 'c663af39-fbe1-44ba-88ab-ba5dc9218372', '06d3dcd0-f0b1-4e45-81ad-1fbfcf121a71'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:26:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-27924ce3-46d9-4b6a-9577-aea4ebd8391f tempest-VolumesActionsTest-1748201626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:26:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-27924ce3-46d9-4b6a-9577-aea4ebd8391f tempest-VolumesActionsTest-1748201626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:26:20 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-27924ce3-46d9-4b6a-9577-aea4ebd8391f tempest-VolumesActionsTest-1748201626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:26:20 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-27924ce3-46d9-4b6a-9577-aea4ebd8391f tempest-VolumesActionsTest-1748201626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:26:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-27924ce3-46d9-4b6a-9577-aea4ebd8391f tempest-VolumesActionsTest-1748201626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:26:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-27924ce3-46d9-4b6a-9577-aea4ebd8391f tempest-VolumesActionsTest-1748201626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:26:20 devstack sudo[91328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:26:20 devstack sudo[91328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:26:21 devstack sudo[91328]: pam_unix(sudo:session): session closed for user root
Jul 14 16:26:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-27924ce3-46d9-4b6a-9577-aea4ebd8391f tempest-VolumesActionsTest-1748201626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.373s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:26:21 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-27924ce3-46d9-4b6a-9577-aea4ebd8391f tempest-VolumesActionsTest-1748201626 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:26:21 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-27924ce3-46d9-4b6a-9577-aea4ebd8391f tempest-VolumesActionsTest-1748201626 None] Deleted volume successfully.
Jul 14 16:26:21 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-27924ce3-46d9-4b6a-9577-aea4ebd8391f tempest-VolumesActionsTest-1748201626 None] Lock "cinder-f8672315-88de-4232-87b7-67d9cdc0c642-delete_volume" released by "delete_volume" :: held 1.416s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:26:21 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9c1f1ec-b15b-4dca-9e62-737e27ed4bcb tempest-VolumesActionsTest-288059650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:26:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f9c1f1ec-b15b-4dca-9e62-737e27ed4bcb tempest-VolumesActionsTest-288059650 None] Flow 'volume_create_manager' (ae326768-ab2c-40c7-b144-2acd5ff74ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:26:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f9c1f1ec-b15b-4dca-9e62-737e27ed4bcb tempest-VolumesActionsTest-288059650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4308d9ad-5786-44ca-9cc4-8bb7f202da9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:26:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f9c1f1ec-b15b-4dca-9e62-737e27ed4bcb tempest-VolumesActionsTest-288059650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4308d9ad-5786-44ca-9cc4-8bb7f202da9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:26:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-99304025',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=739e2810-354e-4d1b-af00-d0fc9d887bc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85b645b9e13e486e95e95114ec41db50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:26:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:26:22Z,use_quota=True,user_id='70463b999b824ea89265f51945ae7195',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:26:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f9c1f1ec-b15b-4dca-9e62-737e27ed4bcb tempest-VolumesActionsTest-288059650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86ecb21d-88d8-478d-9c54-3f4d73096448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:26:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f9c1f1ec-b15b-4dca-9e62-737e27ed4bcb tempest-VolumesActionsTest-288059650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86ecb21d-88d8-478d-9c54-3f4d73096448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:26:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f9c1f1ec-b15b-4dca-9e62-737e27ed4bcb tempest-VolumesActionsTest-288059650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53125fe5-9026-4ed7-aeef-13ec048817cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:26:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f9c1f1ec-b15b-4dca-9e62-737e27ed4bcb tempest-VolumesActionsTest-288059650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53125fe5-9026-4ed7-aeef-13ec048817cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '739e2810-354e-4d1b-af00-d0fc9d887bc5', 'volume_name': 'volume-739e2810-354e-4d1b-af00-d0fc9d887bc5', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:26:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f9c1f1ec-b15b-4dca-9e62-737e27ed4bcb tempest-VolumesActionsTest-288059650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ab25148-7f1c-42da-afca-bac5fde2fa68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:26:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f9c1f1ec-b15b-4dca-9e62-737e27ed4bcb tempest-VolumesActionsTest-288059650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ab25148-7f1c-42da-afca-bac5fde2fa68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:26:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f9c1f1ec-b15b-4dca-9e62-737e27ed4bcb tempest-VolumesActionsTest-288059650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86ab1c8f-c3ef-48f2-a7af-36bcf8b99c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:26:22 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-f9c1f1ec-b15b-4dca-9e62-737e27ed4bcb tempest-VolumesActionsTest-288059650 None] Volume 739e2810-354e-4d1b-af00-d0fc9d887bc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-739e2810-354e-4d1b-af00-d0fc9d887bc5', 'volume_size': 1}
Jul 14 16:26:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f9c1f1ec-b15b-4dca-9e62-737e27ed4bcb tempest-VolumesActionsTest-288059650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:26:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f9c1f1ec-b15b-4dca-9e62-737e27ed4bcb tempest-VolumesActionsTest-288059650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:26:22 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f9c1f1ec-b15b-4dca-9e62-737e27ed4bcb tempest-VolumesActionsTest-288059650 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:26:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-99304025',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=739e2810-354e-4d1b-af00-d0fc9d887bc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85b645b9e13e486e95e95114ec41db50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:26:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:26:22Z,use_quota=True,user_id='70463b999b824ea89265f51945ae7195',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:26:22 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-f9c1f1ec-b15b-4dca-9e62-737e27ed4bcb tempest-VolumesActionsTest-288059650 None] Creating volume 739e2810-354e-4d1b-af00-d0fc9d887bc5 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:26:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f9c1f1ec-b15b-4dca-9e62-737e27ed4bcb tempest-VolumesActionsTest-288059650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:26:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f9c1f1ec-b15b-4dca-9e62-737e27ed4bcb tempest-VolumesActionsTest-288059650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:26:22 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f9c1f1ec-b15b-4dca-9e62-737e27ed4bcb tempest-VolumesActionsTest-288059650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:26:22 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f9c1f1ec-b15b-4dca-9e62-737e27ed4bcb tempest-VolumesActionsTest-288059650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:26:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f9c1f1ec-b15b-4dca-9e62-737e27ed4bcb tempest-VolumesActionsTest-288059650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:26:22 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f9c1f1ec-b15b-4dca-9e62-737e27ed4bcb tempest-VolumesActionsTest-288059650 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:26:22 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-f9c1f1ec-b15b-4dca-9e62-737e27ed4bcb tempest-VolumesActionsTest-288059650 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:26:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f9c1f1ec-b15b-4dca-9e62-737e27ed4bcb tempest-VolumesActionsTest-288059650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-739e2810-354e-4d1b-af00-d0fc9d887bc5 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:26:22 devstack sudo[91334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-739e2810-354e-4d1b-af00-d0fc9d887bc5 1073741824
Jul 14 16:26:22 devstack sudo[91334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:26:22 devstack sudo[91334]: pam_unix(sudo:session): session closed for user root
Jul 14 16:26:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f9c1f1ec-b15b-4dca-9e62-737e27ed4bcb tempest-VolumesActionsTest-288059650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-739e2810-354e-4d1b-af00-d0fc9d887bc5 1073741824" returned: 0 in 0.591s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:26:22 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-6111dc1a-daf1-40de-8a3d-33cdf3ed8fa7 req-10032dec-628d-473d-a423-de4512801f4b tempest-ServerActionsTestOtherA-221655283 None] Terminate volume connection completed successfully.
Jul 14 16:26:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-6111dc1a-daf1-40de-8a3d-33cdf3ed8fa7 req-10032dec-628d-473d-a423-de4512801f4b tempest-ServerActionsTestOtherA-221655283 None] Deleting attachment 24402ef4-acdf-484b-9134-2fab066f1384. {{(pid=87166) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 14 16:26:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f9c1f1ec-b15b-4dca-9e62-737e27ed4bcb tempest-VolumesActionsTest-288059650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-739e2810-354e-4d1b-af00-d0fc9d887bc5 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:26:22 devstack sudo[91371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-739e2810-354e-4d1b-af00-d0fc9d887bc5
Jul 14 16:26:22 devstack sudo[91371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:26:23 devstack sudo[91371]: pam_unix(sudo:session): session closed for user root
Jul 14 16:26:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f9c1f1ec-b15b-4dca-9e62-737e27ed4bcb tempest-VolumesActionsTest-288059650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-739e2810-354e-4d1b-af00-d0fc9d887bc5" returned: 0 in 0.609s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:26:23 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f9c1f1ec-b15b-4dca-9e62-737e27ed4bcb tempest-VolumesActionsTest-288059650 None] <== create_volume: return (1265ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:26:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f9c1f1ec-b15b-4dca-9e62-737e27ed4bcb tempest-VolumesActionsTest-288059650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.268s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:26:23 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f9c1f1ec-b15b-4dca-9e62-737e27ed4bcb tempest-VolumesActionsTest-288059650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86ab1c8f-c3ef-48f2-a7af-36bcf8b99c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-739e2810-354e-4d1b-af00-d0fc9d887bc5', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:26:23 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f9c1f1ec-b15b-4dca-9e62-737e27ed4bcb tempest-VolumesActionsTest-288059650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ac8ec75-d068-4c77-9f0a-bbfbb0d295cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:26:23 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-f9c1f1ec-b15b-4dca-9e62-737e27ed4bcb tempest-VolumesActionsTest-288059650 None] Volume volume-739e2810-354e-4d1b-af00-d0fc9d887bc5 (739e2810-354e-4d1b-af00-d0fc9d887bc5): created successfully
Jul 14 16:26:23 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f9c1f1ec-b15b-4dca-9e62-737e27ed4bcb tempest-VolumesActionsTest-288059650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ac8ec75-d068-4c77-9f0a-bbfbb0d295cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:26:23 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f9c1f1ec-b15b-4dca-9e62-737e27ed4bcb tempest-VolumesActionsTest-288059650 None] Flow 'volume_create_manager' (ae326768-ab2c-40c7-b144-2acd5ff74ce8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:26:23 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-f9c1f1ec-b15b-4dca-9e62-737e27ed4bcb tempest-VolumesActionsTest-288059650 None] Created volume successfully.
Jul 14 16:26:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-6111dc1a-daf1-40de-8a3d-33cdf3ed8fa7 req-28839fa7-3684-4e90-b45a-042b67729479 tempest-ServerActionsTestOtherA-221655283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:26:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-6111dc1a-daf1-40de-8a3d-33cdf3ed8fa7 req-28839fa7-3684-4e90-b45a-042b67729479 tempest-ServerActionsTestOtherA-221655283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:26:24 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[2681801e-09e2-407b-861b-3fbe30419b80]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:26:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-6111dc1a-daf1-40de-8a3d-33cdf3ed8fa7 req-28839fa7-3684-4e90-b45a-042b67729479 tempest-ServerActionsTestOtherA-221655283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6761b33a-8d29-4ba0-8cd4-1532082a0ac9 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:26:24 devstack sudo[91403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6761b33a-8d29-4ba0-8cd4-1532082a0ac9
Jul 14 16:26:24 devstack sudo[91403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:26:24 devstack sudo[91403]: pam_unix(sudo:session): session closed for user root
Jul 14 16:26:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-6111dc1a-daf1-40de-8a3d-33cdf3ed8fa7 req-28839fa7-3684-4e90-b45a-042b67729479 tempest-ServerActionsTestOtherA-221655283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6761b33a-8d29-4ba0-8cd4-1532082a0ac9" returned: 0 in 0.571s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:26:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-6111dc1a-daf1-40de-8a3d-33cdf3ed8fa7 req-28839fa7-3684-4e90-b45a-042b67729479 tempest-ServerActionsTestOtherA-221655283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.628s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:26:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-6111dc1a-daf1-40de-8a3d-33cdf3ed8fa7 req-28839fa7-3684-4e90-b45a-042b67729479 tempest-ServerActionsTestOtherA-221655283 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052', 'name': 'volume-6761b33a-8d29-4ba0-8cd4-1532082a0ac9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2445f3d2-1d7e-4e2d-8c97-e566093b883a', 'enforce_multipath': True} {{(pid=87166) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 14 16:26:24 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-6111dc1a-daf1-40de-8a3d-33cdf3ed8fa7 req-28839fa7-3684-4e90-b45a-042b67729479 tempest-ServerActionsTestOtherA-221655283 None] attachment_update completed successfully.
Jul 14 16:26:24 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2f684aeb-de54-4243-b0ae-c86d299c4b8f tempest-VolumesActionsTest-288059650 None] Acquiring lock "cinder-739e2810-354e-4d1b-af00-d0fc9d887bc5-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:26:24 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2f684aeb-de54-4243-b0ae-c86d299c4b8f tempest-VolumesActionsTest-288059650 None] Lock "cinder-739e2810-354e-4d1b-af00-d0fc9d887bc5-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:26:24 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2f684aeb-de54-4243-b0ae-c86d299c4b8f tempest-VolumesActionsTest-288059650 None] Acquiring lock "cinder-quobyte-739e2810-354e-4d1b-af00-d0fc9d887bc5" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:26:24 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2f684aeb-de54-4243-b0ae-c86d299c4b8f tempest-VolumesActionsTest-288059650 None] Lock "cinder-quobyte-739e2810-354e-4d1b-af00-d0fc9d887bc5" acquired by "delete_volume" :: waited 0.021s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:26:24 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dff8e9a-cb39-40f3-b3cc-b2cf84740f3d]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:26:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2f684aeb-de54-4243-b0ae-c86d299c4b8f tempest-VolumesActionsTest-288059650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-739e2810-354e-4d1b-af00-d0fc9d887bc5 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:26:25 devstack sudo[91408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-739e2810-354e-4d1b-af00-d0fc9d887bc5
Jul 14 16:26:25 devstack sudo[91408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:26:25 devstack sudo[91408]: pam_unix(sudo:session): session closed for user root
Jul 14 16:26:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2f684aeb-de54-4243-b0ae-c86d299c4b8f tempest-VolumesActionsTest-288059650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-739e2810-354e-4d1b-af00-d0fc9d887bc5" returned: 0 in 0.397s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:26:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2f684aeb-de54-4243-b0ae-c86d299c4b8f tempest-VolumesActionsTest-288059650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-739e2810-354e-4d1b-af00-d0fc9d887bc5 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:26:25 devstack sudo[91424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-739e2810-354e-4d1b-af00-d0fc9d887bc5
Jul 14 16:26:25 devstack sudo[91424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:26:25 devstack sudo[91424]: pam_unix(sudo:session): session closed for user root
Jul 14 16:26:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2f684aeb-de54-4243-b0ae-c86d299c4b8f tempest-VolumesActionsTest-288059650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-739e2810-354e-4d1b-af00-d0fc9d887bc5" returned: 0 in 0.333s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:26:25 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2f684aeb-de54-4243-b0ae-c86d299c4b8f tempest-VolumesActionsTest-288059650 None] Lock "cinder-quobyte-739e2810-354e-4d1b-af00-d0fc9d887bc5" released by "delete_volume" :: held 0.778s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:26:25 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-2f684aeb-de54-4243-b0ae-c86d299c4b8f tempest-VolumesActionsTest-288059650 None] Created reservations ['abcdd735-ae10-46f0-b389-4804e2fc2847', 'ab1ba3d2-1ef1-4644-ac23-36b1e1e9e46e', '1c80505a-1f94-4b5b-8271-4e9269133af5', '118cbda6-5f6c-4ba6-9655-5711ec524d78'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:26:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2f684aeb-de54-4243-b0ae-c86d299c4b8f tempest-VolumesActionsTest-288059650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:26:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2f684aeb-de54-4243-b0ae-c86d299c4b8f tempest-VolumesActionsTest-288059650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:26:25 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2f684aeb-de54-4243-b0ae-c86d299c4b8f tempest-VolumesActionsTest-288059650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:26:25 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2f684aeb-de54-4243-b0ae-c86d299c4b8f tempest-VolumesActionsTest-288059650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:26:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2f684aeb-de54-4243-b0ae-c86d299c4b8f tempest-VolumesActionsTest-288059650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:26:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2f684aeb-de54-4243-b0ae-c86d299c4b8f tempest-VolumesActionsTest-288059650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:26:25 devstack sudo[91438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:26:25 devstack sudo[91438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:26:26 devstack sudo[91438]: pam_unix(sudo:session): session closed for user root
Jul 14 16:26:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2f684aeb-de54-4243-b0ae-c86d299c4b8f tempest-VolumesActionsTest-288059650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.504s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:26:26 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-2f684aeb-de54-4243-b0ae-c86d299c4b8f tempest-VolumesActionsTest-288059650 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:26:26 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-2f684aeb-de54-4243-b0ae-c86d299c4b8f tempest-VolumesActionsTest-288059650 None] Deleted volume successfully.
Jul 14 16:26:26 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2f684aeb-de54-4243-b0ae-c86d299c4b8f tempest-VolumesActionsTest-288059650 None] Lock "cinder-739e2810-354e-4d1b-af00-d0fc9d887bc5-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:26:27 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-18f158a5-d828-4a1b-9ce9-1c9bac82d4b9 tempest-AttachVolumeShelveTestJSON-1892612854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:26:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-18f158a5-d828-4a1b-9ce9-1c9bac82d4b9 tempest-AttachVolumeShelveTestJSON-1892612854 None] Flow 'volume_create_manager' (480e8579-8c0d-403f-a3ae-ef46d9ddb467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:26:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-18f158a5-d828-4a1b-9ce9-1c9bac82d4b9 tempest-AttachVolumeShelveTestJSON-1892612854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5b91705-11dd-4097-a72f-12f731f905b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:26:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-18f158a5-d828-4a1b-9ce9-1c9bac82d4b9 tempest-AttachVolumeShelveTestJSON-1892612854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5b91705-11dd-4097-a72f-12f731f905b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-788870623',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c83cb3b1-e97b-400b-8675-5e44281df1f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d849b4a8ab9846d6b132cf0120a0a592',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:26:27Z,use_quota=True,user_id='1390729a935e499fadb51ccb040632f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:26:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-18f158a5-d828-4a1b-9ce9-1c9bac82d4b9 tempest-AttachVolumeShelveTestJSON-1892612854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0090026f-a53d-4e02-8b25-c51556231c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:26:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-18f158a5-d828-4a1b-9ce9-1c9bac82d4b9 tempest-AttachVolumeShelveTestJSON-1892612854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0090026f-a53d-4e02-8b25-c51556231c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:26:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-18f158a5-d828-4a1b-9ce9-1c9bac82d4b9 tempest-AttachVolumeShelveTestJSON-1892612854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d930af07-7577-422a-beeb-8b3a0cabb09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:26:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-18f158a5-d828-4a1b-9ce9-1c9bac82d4b9 tempest-AttachVolumeShelveTestJSON-1892612854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d930af07-7577-422a-beeb-8b3a0cabb09f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c83cb3b1-e97b-400b-8675-5e44281df1f3', 'volume_name': 'volume-c83cb3b1-e97b-400b-8675-5e44281df1f3', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:26:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-18f158a5-d828-4a1b-9ce9-1c9bac82d4b9 tempest-AttachVolumeShelveTestJSON-1892612854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (901a0640-bff6-4c18-90dc-aa3f47b6cc5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:26:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-18f158a5-d828-4a1b-9ce9-1c9bac82d4b9 tempest-AttachVolumeShelveTestJSON-1892612854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (901a0640-bff6-4c18-90dc-aa3f47b6cc5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:26:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-18f158a5-d828-4a1b-9ce9-1c9bac82d4b9 tempest-AttachVolumeShelveTestJSON-1892612854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (760fc7c9-11a1-45a0-bc0b-c3b9f3f7d542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:26:27 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-18f158a5-d828-4a1b-9ce9-1c9bac82d4b9 tempest-AttachVolumeShelveTestJSON-1892612854 None] Volume c83cb3b1-e97b-400b-8675-5e44281df1f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c83cb3b1-e97b-400b-8675-5e44281df1f3', 'volume_size': 1}
Jul 14 16:26:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-18f158a5-d828-4a1b-9ce9-1c9bac82d4b9 tempest-AttachVolumeShelveTestJSON-1892612854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:26:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-18f158a5-d828-4a1b-9ce9-1c9bac82d4b9 tempest-AttachVolumeShelveTestJSON-1892612854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:26:27 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-18f158a5-d828-4a1b-9ce9-1c9bac82d4b9 tempest-AttachVolumeShelveTestJSON-1892612854 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-788870623',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c83cb3b1-e97b-400b-8675-5e44281df1f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d849b4a8ab9846d6b132cf0120a0a592',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:26:27Z,use_quota=True,user_id='1390729a935e499fadb51ccb040632f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:26:27 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-18f158a5-d828-4a1b-9ce9-1c9bac82d4b9 tempest-AttachVolumeShelveTestJSON-1892612854 None] Creating volume c83cb3b1-e97b-400b-8675-5e44281df1f3 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:26:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-18f158a5-d828-4a1b-9ce9-1c9bac82d4b9 tempest-AttachVolumeShelveTestJSON-1892612854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:26:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-18f158a5-d828-4a1b-9ce9-1c9bac82d4b9 tempest-AttachVolumeShelveTestJSON-1892612854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:26:27 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-18f158a5-d828-4a1b-9ce9-1c9bac82d4b9 tempest-AttachVolumeShelveTestJSON-1892612854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:26:27 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-18f158a5-d828-4a1b-9ce9-1c9bac82d4b9 tempest-AttachVolumeShelveTestJSON-1892612854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:26:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-18f158a5-d828-4a1b-9ce9-1c9bac82d4b9 tempest-AttachVolumeShelveTestJSON-1892612854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:26:27 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-18f158a5-d828-4a1b-9ce9-1c9bac82d4b9 tempest-AttachVolumeShelveTestJSON-1892612854 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:26:27 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-18f158a5-d828-4a1b-9ce9-1c9bac82d4b9 tempest-AttachVolumeShelveTestJSON-1892612854 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:26:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-18f158a5-d828-4a1b-9ce9-1c9bac82d4b9 tempest-AttachVolumeShelveTestJSON-1892612854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c83cb3b1-e97b-400b-8675-5e44281df1f3 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:26:27 devstack sudo[91857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c83cb3b1-e97b-400b-8675-5e44281df1f3 1073741824
Jul 14 16:26:27 devstack sudo[91857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:26:28 devstack sudo[91857]: pam_unix(sudo:session): session closed for user root
Jul 14 16:26:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-18f158a5-d828-4a1b-9ce9-1c9bac82d4b9 tempest-AttachVolumeShelveTestJSON-1892612854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c83cb3b1-e97b-400b-8675-5e44281df1f3 1073741824" returned: 0 in 0.829s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:26:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-18f158a5-d828-4a1b-9ce9-1c9bac82d4b9 tempest-AttachVolumeShelveTestJSON-1892612854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c83cb3b1-e97b-400b-8675-5e44281df1f3 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:26:28 devstack sudo[91865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c83cb3b1-e97b-400b-8675-5e44281df1f3
Jul 14 16:26:28 devstack sudo[91865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:26:28 devstack sudo[91865]: pam_unix(sudo:session): session closed for user root
Jul 14 16:26:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-18f158a5-d828-4a1b-9ce9-1c9bac82d4b9 tempest-AttachVolumeShelveTestJSON-1892612854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c83cb3b1-e97b-400b-8675-5e44281df1f3" returned: 0 in 0.385s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:26:28 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-18f158a5-d828-4a1b-9ce9-1c9bac82d4b9 tempest-AttachVolumeShelveTestJSON-1892612854 None] <== create_volume: return (1377ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:26:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-18f158a5-d828-4a1b-9ce9-1c9bac82d4b9 tempest-AttachVolumeShelveTestJSON-1892612854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.385s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:26:28 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-18f158a5-d828-4a1b-9ce9-1c9bac82d4b9 tempest-AttachVolumeShelveTestJSON-1892612854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (760fc7c9-11a1-45a0-bc0b-c3b9f3f7d542) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c83cb3b1-e97b-400b-8675-5e44281df1f3', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:26:28 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-18f158a5-d828-4a1b-9ce9-1c9bac82d4b9 tempest-AttachVolumeShelveTestJSON-1892612854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1951990-9abe-4405-b6f5-43d2aa6ee15f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:26:28 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-18f158a5-d828-4a1b-9ce9-1c9bac82d4b9 tempest-AttachVolumeShelveTestJSON-1892612854 None] Volume volume-c83cb3b1-e97b-400b-8675-5e44281df1f3 (c83cb3b1-e97b-400b-8675-5e44281df1f3): created successfully
Jul 14 16:26:28 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-18f158a5-d828-4a1b-9ce9-1c9bac82d4b9 tempest-AttachVolumeShelveTestJSON-1892612854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1951990-9abe-4405-b6f5-43d2aa6ee15f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:26:28 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-18f158a5-d828-4a1b-9ce9-1c9bac82d4b9 tempest-AttachVolumeShelveTestJSON-1892612854 None] Flow 'volume_create_manager' (480e8579-8c0d-403f-a3ae-ef46d9ddb467) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:26:28 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-18f158a5-d828-4a1b-9ce9-1c9bac82d4b9 tempest-AttachVolumeShelveTestJSON-1892612854 None] Created volume successfully.
Jul 14 16:26:35 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 16:26:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:26:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:26:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:26:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:26:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:26:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:26:35 devstack sudo[91895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:26:35 devstack sudo[91895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:26:35 devstack sudo[91895]: pam_unix(sudo:session): session closed for user root
Jul 14 16:26:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.519s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:26:35 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:26:35 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Running periodic task VolumeManager._thread_info {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 16:26:35 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] thread count: 8 {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 14 16:26:35 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] thread info: [<_MainThread(MainThread, started 128606490927232)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128606415432960)>, <Thread(Thread-3 (stat_writer), started daemon 128606378859328)>, <Thread(Rabbit-heartbeat, started daemon 128606379646144)>, <Thread(Thread-5 (_runner), started daemon 128606377685824)>, <Thread(Thread-7 (_runner), started daemon 128606377701888)>, <Thread(fd_logger, started daemon 128606377091392)>, <Thread(privsep_reader, started daemon 128606375782080)>] {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 14 16:26:38 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:SELECT=77,cinder:INSERT=18,cinder:UPDATE=93,cinder:DELETE=12 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 16:26:38 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:SELECT=79,cinder:UPDATE=103,cinder:DELETE=5,cinder:INSERT=25 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 16:26:44 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-1392c6e8-53b0-46cc-afcc-c9b6f7d4b029 req-e1419476-e268-4392-9642-a40fa349050e tempest-AttachVolumeShelveTestJSON-1892612854 None] No connector for attachment dfbc22c0-dbab-4a6a-8bca-d20ad415f907; skipping storage backend terminate_connection call. {{(pid=87166) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}}
Jul 14 16:26:44 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-1392c6e8-53b0-46cc-afcc-c9b6f7d4b029 req-e1419476-e268-4392-9642-a40fa349050e tempest-AttachVolumeShelveTestJSON-1892612854 None] Deleting attachment dfbc22c0-dbab-4a6a-8bca-d20ad415f907. {{(pid=87166) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 14 16:26:44 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ef37756-6e58-41ba-8451-07d570590ee2 tempest-SnapshotMetadataTestJSON-838033286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:26:44 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0ef37756-6e58-41ba-8451-07d570590ee2 tempest-SnapshotMetadataTestJSON-838033286 None] Flow 'volume_create_manager' (aff6b064-aeba-4f39-a2b0-dc2dff00037a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:26:44 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0ef37756-6e58-41ba-8451-07d570590ee2 tempest-SnapshotMetadataTestJSON-838033286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (212ac48e-b7b0-43c2-afac-8a514e199ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:26:44 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0ef37756-6e58-41ba-8451-07d570590ee2 tempest-SnapshotMetadataTestJSON-838033286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (212ac48e-b7b0-43c2-afac-8a514e199ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:26:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-5312220',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e5b07ab-9926-45a8-89b6-c00214e9aaf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae09820311774f20b8d6eb56a70ca898',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:26:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:26:45Z,use_quota=True,user_id='8f53c46734f14986b174a58b0ca9f444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:26:44 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0ef37756-6e58-41ba-8451-07d570590ee2 tempest-SnapshotMetadataTestJSON-838033286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9bacc49-e5cf-4d9f-bfbd-b9b6db850787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:26:44 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0ef37756-6e58-41ba-8451-07d570590ee2 tempest-SnapshotMetadataTestJSON-838033286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9bacc49-e5cf-4d9f-bfbd-b9b6db850787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:26:44 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0ef37756-6e58-41ba-8451-07d570590ee2 tempest-SnapshotMetadataTestJSON-838033286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (180807bf-fcf4-4c5a-88c7-199249fc040c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:26:44 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0ef37756-6e58-41ba-8451-07d570590ee2 tempest-SnapshotMetadataTestJSON-838033286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (180807bf-fcf4-4c5a-88c7-199249fc040c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e5b07ab-9926-45a8-89b6-c00214e9aaf6', 'volume_name': 'volume-6e5b07ab-9926-45a8-89b6-c00214e9aaf6', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:26:44 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0ef37756-6e58-41ba-8451-07d570590ee2 tempest-SnapshotMetadataTestJSON-838033286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1512893b-1b08-43fa-a637-53c17554194a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:26:44 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0ef37756-6e58-41ba-8451-07d570590ee2 tempest-SnapshotMetadataTestJSON-838033286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1512893b-1b08-43fa-a637-53c17554194a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:26:44 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0ef37756-6e58-41ba-8451-07d570590ee2 tempest-SnapshotMetadataTestJSON-838033286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94188279-0eaa-407a-a486-8ee943c4dba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:26:44 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-0ef37756-6e58-41ba-8451-07d570590ee2 tempest-SnapshotMetadataTestJSON-838033286 None] Volume 6e5b07ab-9926-45a8-89b6-c00214e9aaf6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e5b07ab-9926-45a8-89b6-c00214e9aaf6', 'volume_size': 1}
Jul 14 16:26:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0ef37756-6e58-41ba-8451-07d570590ee2 tempest-SnapshotMetadataTestJSON-838033286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:26:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0ef37756-6e58-41ba-8451-07d570590ee2 tempest-SnapshotMetadataTestJSON-838033286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:26:44 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0ef37756-6e58-41ba-8451-07d570590ee2 tempest-SnapshotMetadataTestJSON-838033286 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:26:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-5312220',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e5b07ab-9926-45a8-89b6-c00214e9aaf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae09820311774f20b8d6eb56a70ca898',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:26:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:26:45Z,use_quota=True,user_id='8f53c46734f14986b174a58b0ca9f444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:26:44 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-0ef37756-6e58-41ba-8451-07d570590ee2 tempest-SnapshotMetadataTestJSON-838033286 None] Creating volume 6e5b07ab-9926-45a8-89b6-c00214e9aaf6 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:26:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0ef37756-6e58-41ba-8451-07d570590ee2 tempest-SnapshotMetadataTestJSON-838033286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:26:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0ef37756-6e58-41ba-8451-07d570590ee2 tempest-SnapshotMetadataTestJSON-838033286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:26:44 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0ef37756-6e58-41ba-8451-07d570590ee2 tempest-SnapshotMetadataTestJSON-838033286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:26:44 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0ef37756-6e58-41ba-8451-07d570590ee2 tempest-SnapshotMetadataTestJSON-838033286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:26:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0ef37756-6e58-41ba-8451-07d570590ee2 tempest-SnapshotMetadataTestJSON-838033286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:26:44 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0ef37756-6e58-41ba-8451-07d570590ee2 tempest-SnapshotMetadataTestJSON-838033286 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:26:44 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-0ef37756-6e58-41ba-8451-07d570590ee2 tempest-SnapshotMetadataTestJSON-838033286 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:26:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0ef37756-6e58-41ba-8451-07d570590ee2 tempest-SnapshotMetadataTestJSON-838033286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6e5b07ab-9926-45a8-89b6-c00214e9aaf6 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:26:44 devstack sudo[91965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6e5b07ab-9926-45a8-89b6-c00214e9aaf6 1073741824
Jul 14 16:26:44 devstack sudo[91965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:26:45 devstack sudo[91965]: pam_unix(sudo:session): session closed for user root
Jul 14 16:26:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0ef37756-6e58-41ba-8451-07d570590ee2 tempest-SnapshotMetadataTestJSON-838033286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6e5b07ab-9926-45a8-89b6-c00214e9aaf6 1073741824" returned: 0 in 0.578s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:26:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0ef37756-6e58-41ba-8451-07d570590ee2 tempest-SnapshotMetadataTestJSON-838033286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6e5b07ab-9926-45a8-89b6-c00214e9aaf6 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:26:45 devstack sudo[91972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6e5b07ab-9926-45a8-89b6-c00214e9aaf6
Jul 14 16:26:45 devstack sudo[91972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:26:45 devstack sudo[91972]: pam_unix(sudo:session): session closed for user root
Jul 14 16:26:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0ef37756-6e58-41ba-8451-07d570590ee2 tempest-SnapshotMetadataTestJSON-838033286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6e5b07ab-9926-45a8-89b6-c00214e9aaf6" returned: 0 in 0.356s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:26:45 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0ef37756-6e58-41ba-8451-07d570590ee2 tempest-SnapshotMetadataTestJSON-838033286 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:26:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0ef37756-6e58-41ba-8451-07d570590ee2 tempest-SnapshotMetadataTestJSON-838033286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:26:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0ef37756-6e58-41ba-8451-07d570590ee2 tempest-SnapshotMetadataTestJSON-838033286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94188279-0eaa-407a-a486-8ee943c4dba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e5b07ab-9926-45a8-89b6-c00214e9aaf6', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:26:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0ef37756-6e58-41ba-8451-07d570590ee2 tempest-SnapshotMetadataTestJSON-838033286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16489e11-388a-4503-a0e7-6986439dee2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:26:45 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-0ef37756-6e58-41ba-8451-07d570590ee2 tempest-SnapshotMetadataTestJSON-838033286 None] Volume volume-6e5b07ab-9926-45a8-89b6-c00214e9aaf6 (6e5b07ab-9926-45a8-89b6-c00214e9aaf6): created successfully
Jul 14 16:26:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0ef37756-6e58-41ba-8451-07d570590ee2 tempest-SnapshotMetadataTestJSON-838033286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16489e11-388a-4503-a0e7-6986439dee2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:26:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0ef37756-6e58-41ba-8451-07d570590ee2 tempest-SnapshotMetadataTestJSON-838033286 None] Flow 'volume_create_manager' (aff6b064-aeba-4f39-a2b0-dc2dff00037a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:26:45 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-0ef37756-6e58-41ba-8451-07d570590ee2 tempest-SnapshotMetadataTestJSON-838033286 None] Created volume successfully.
Jul 14 16:26:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-17a51261-f2e9-4cea-b80c-0249462b10c0 tempest-SnapshotMetadataTestJSON-838033286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:26:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-17a51261-f2e9-4cea-b80c-0249462b10c0 tempest-SnapshotMetadataTestJSON-838033286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:26:47 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-17a51261-f2e9-4cea-b80c-0249462b10c0 tempest-SnapshotMetadataTestJSON-838033286 None] Creating offline snapshot b6a2de48-c2cf-4eae-b626-7697aa503a40 of volume 6e5b07ab-9926-45a8-89b6-c00214e9aaf6 {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 16:26:47 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b543820-44c5-43c2-a7db-ab1b1e258102]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:26:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-17a51261-f2e9-4cea-b80c-0249462b10c0 tempest-SnapshotMetadataTestJSON-838033286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6e5b07ab-9926-45a8-89b6-c00214e9aaf6 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:26:47 devstack sudo[92018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6e5b07ab-9926-45a8-89b6-c00214e9aaf6
Jul 14 16:26:47 devstack sudo[92018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:26:47 devstack sudo[92018]: pam_unix(sudo:session): session closed for user root
Jul 14 16:26:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-17a51261-f2e9-4cea-b80c-0249462b10c0 tempest-SnapshotMetadataTestJSON-838033286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6e5b07ab-9926-45a8-89b6-c00214e9aaf6" returned: 0 in 0.419s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:26:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-17a51261-f2e9-4cea-b80c-0249462b10c0 tempest-SnapshotMetadataTestJSON-838033286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6e5b07ab-9926-45a8-89b6-c00214e9aaf6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6e5b07ab-9926-45a8-89b6-c00214e9aaf6.b6a2de48-c2cf-4eae-b626-7697aa503a40 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:26:47 devstack sudo[92023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6e5b07ab-9926-45a8-89b6-c00214e9aaf6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6e5b07ab-9926-45a8-89b6-c00214e9aaf6.b6a2de48-c2cf-4eae-b626-7697aa503a40 1G
Jul 14 16:26:47 devstack sudo[92023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:26:48 devstack sudo[92023]: pam_unix(sudo:session): session closed for user root
Jul 14 16:26:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-17a51261-f2e9-4cea-b80c-0249462b10c0 tempest-SnapshotMetadataTestJSON-838033286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6e5b07ab-9926-45a8-89b6-c00214e9aaf6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6e5b07ab-9926-45a8-89b6-c00214e9aaf6.b6a2de48-c2cf-4eae-b626-7697aa503a40 1G" returned: 0 in 0.623s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:26:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-17a51261-f2e9-4cea-b80c-0249462b10c0 tempest-SnapshotMetadataTestJSON-838033286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e5b07ab-9926-45a8-89b6-c00214e9aaf6 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6e5b07ab-9926-45a8-89b6-c00214e9aaf6.b6a2de48-c2cf-4eae-b626-7697aa503a40 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:26:48 devstack sudo[92030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e5b07ab-9926-45a8-89b6-c00214e9aaf6 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6e5b07ab-9926-45a8-89b6-c00214e9aaf6.b6a2de48-c2cf-4eae-b626-7697aa503a40
Jul 14 16:26:48 devstack sudo[92030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:26:48 devstack sudo[92030]: pam_unix(sudo:session): session closed for user root
Jul 14 16:26:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-17a51261-f2e9-4cea-b80c-0249462b10c0 tempest-SnapshotMetadataTestJSON-838033286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e5b07ab-9926-45a8-89b6-c00214e9aaf6 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6e5b07ab-9926-45a8-89b6-c00214e9aaf6.b6a2de48-c2cf-4eae-b626-7697aa503a40" returned: 0 in 0.385s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:26:48 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-17a51261-f2e9-4cea-b80c-0249462b10c0 tempest-SnapshotMetadataTestJSON-838033286 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6e5b07ab-9926-45a8-89b6-c00214e9aaf6.b6a2de48-c2cf-4eae-b626-7697aa503a40 is being set with open permissions: ugo+rw
Jul 14 16:26:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-17a51261-f2e9-4cea-b80c-0249462b10c0 tempest-SnapshotMetadataTestJSON-838033286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6e5b07ab-9926-45a8-89b6-c00214e9aaf6.b6a2de48-c2cf-4eae-b626-7697aa503a40 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:26:48 devstack sudo[92036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6e5b07ab-9926-45a8-89b6-c00214e9aaf6.b6a2de48-c2cf-4eae-b626-7697aa503a40
Jul 14 16:26:48 devstack sudo[92036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:26:48 devstack sudo[92036]: pam_unix(sudo:session): session closed for user root
Jul 14 16:26:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-17a51261-f2e9-4cea-b80c-0249462b10c0 tempest-SnapshotMetadataTestJSON-838033286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6e5b07ab-9926-45a8-89b6-c00214e9aaf6.b6a2de48-c2cf-4eae-b626-7697aa503a40" returned: 0 in 0.331s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:26:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-17a51261-f2e9-4cea-b80c-0249462b10c0 tempest-SnapshotMetadataTestJSON-838033286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6e5b07ab-9926-45a8-89b6-c00214e9aaf6.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:26:49 devstack sudo[92042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6e5b07ab-9926-45a8-89b6-c00214e9aaf6.info
Jul 14 16:26:49 devstack sudo[92042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:26:49 devstack sudo[92042]: pam_unix(sudo:session): session closed for user root
Jul 14 16:26:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-17a51261-f2e9-4cea-b80c-0249462b10c0 tempest-SnapshotMetadataTestJSON-838033286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6e5b07ab-9926-45a8-89b6-c00214e9aaf6.info" returned: 0 in 0.530s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:26:49 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-17a51261-f2e9-4cea-b80c-0249462b10c0 tempest-SnapshotMetadataTestJSON-838033286 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6e5b07ab-9926-45a8-89b6-c00214e9aaf6.info is being set with open permissions: ugo+rw
Jul 14 16:26:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-17a51261-f2e9-4cea-b80c-0249462b10c0 tempest-SnapshotMetadataTestJSON-838033286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6e5b07ab-9926-45a8-89b6-c00214e9aaf6.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:26:49 devstack sudo[92065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6e5b07ab-9926-45a8-89b6-c00214e9aaf6.info
Jul 14 16:26:49 devstack sudo[92065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:26:49 devstack sudo[92065]: pam_unix(sudo:session): session closed for user root
Jul 14 16:26:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-17a51261-f2e9-4cea-b80c-0249462b10c0 tempest-SnapshotMetadataTestJSON-838033286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6e5b07ab-9926-45a8-89b6-c00214e9aaf6.info" returned: 0 in 0.441s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:26:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-17a51261-f2e9-4cea-b80c-0249462b10c0 tempest-SnapshotMetadataTestJSON-838033286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.870s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:26:50 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-17a51261-f2e9-4cea-b80c-0249462b10c0 tempest-SnapshotMetadataTestJSON-838033286 None] Create snapshot completed successfully
Jul 14 16:26:52 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-46866333-e579-45f7-95d7-f303c33d8d46 tempest-SnapshotMetadataTestJSON-838033286 None] Acquiring lock "cinder-b6a2de48-c2cf-4eae-b626-7697aa503a40-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:26:52 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-46866333-e579-45f7-95d7-f303c33d8d46 tempest-SnapshotMetadataTestJSON-838033286 None] Lock "cinder-b6a2de48-c2cf-4eae-b626-7697aa503a40-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:26:52 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-46866333-e579-45f7-95d7-f303c33d8d46 tempest-SnapshotMetadataTestJSON-838033286 None] Acquiring lock "cinder-quobyte-6e5b07ab-9926-45a8-89b6-c00214e9aaf6" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:26:52 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-46866333-e579-45f7-95d7-f303c33d8d46 tempest-SnapshotMetadataTestJSON-838033286 None] Lock "cinder-quobyte-6e5b07ab-9926-45a8-89b6-c00214e9aaf6" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:26:52 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-46866333-e579-45f7-95d7-f303c33d8d46 tempest-SnapshotMetadataTestJSON-838033286 None] Acquiring lock "cinder-quobyte-b6a2de48-c2cf-4eae-b626-7697aa503a40" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:26:52 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-46866333-e579-45f7-95d7-f303c33d8d46 tempest-SnapshotMetadataTestJSON-838033286 None] Lock "cinder-quobyte-b6a2de48-c2cf-4eae-b626-7697aa503a40" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:26:52 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-46866333-e579-45f7-95d7-f303c33d8d46 tempest-SnapshotMetadataTestJSON-838033286 None] Deleting offline snapshot b6a2de48-c2cf-4eae-b626-7697aa503a40 of volume 6e5b07ab-9926-45a8-89b6-c00214e9aaf6 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 16:26:52 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-46866333-e579-45f7-95d7-f303c33d8d46 tempest-SnapshotMetadataTestJSON-838033286 None] snapshot_file for this snap is: volume-6e5b07ab-9926-45a8-89b6-c00214e9aaf6.b6a2de48-c2cf-4eae-b626-7697aa503a40 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 16:26:52 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5258221-3d21-4140-9abe-565f70e2cec5]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:26:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-46866333-e579-45f7-95d7-f303c33d8d46 tempest-SnapshotMetadataTestJSON-838033286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6e5b07ab-9926-45a8-89b6-c00214e9aaf6.b6a2de48-c2cf-4eae-b626-7697aa503a40 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:26:52 devstack sudo[92119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6e5b07ab-9926-45a8-89b6-c00214e9aaf6.b6a2de48-c2cf-4eae-b626-7697aa503a40
Jul 14 16:26:52 devstack sudo[92119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:26:53 devstack sudo[92119]: pam_unix(sudo:session): session closed for user root
Jul 14 16:26:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-46866333-e579-45f7-95d7-f303c33d8d46 tempest-SnapshotMetadataTestJSON-838033286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6e5b07ab-9926-45a8-89b6-c00214e9aaf6.b6a2de48-c2cf-4eae-b626-7697aa503a40" returned: 0 in 0.732s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:26:53 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-46866333-e579-45f7-95d7-f303c33d8d46 tempest-SnapshotMetadataTestJSON-838033286 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e5b07ab-9926-45a8-89b6-c00214e9aaf6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 16:26:53 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a10f00-2da6-4728-8c4e-3c81a31e675f]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:26:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-46866333-e579-45f7-95d7-f303c33d8d46 tempest-SnapshotMetadataTestJSON-838033286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6e5b07ab-9926-45a8-89b6-c00214e9aaf6 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:26:53 devstack sudo[92125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6e5b07ab-9926-45a8-89b6-c00214e9aaf6
Jul 14 16:26:53 devstack sudo[92125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:26:53 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-25698565-60a8-49a8-83dd-9aad30e7cfd5 req-fcdc290e-d04e-4fbc-913a-5646fa59e9ec tempest-ServerActionsTestOtherA-221655283 None] Terminate volume connection completed successfully.
Jul 14 16:26:53 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-25698565-60a8-49a8-83dd-9aad30e7cfd5 req-fcdc290e-d04e-4fbc-913a-5646fa59e9ec tempest-ServerActionsTestOtherA-221655283 None] Deleting attachment 2445f3d2-1d7e-4e2d-8c97-e566093b883a. {{(pid=87166) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 14 16:26:53 devstack sudo[92125]: pam_unix(sudo:session): session closed for user root
Jul 14 16:26:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-46866333-e579-45f7-95d7-f303c33d8d46 tempest-SnapshotMetadataTestJSON-838033286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6e5b07ab-9926-45a8-89b6-c00214e9aaf6" returned: 0 in 0.769s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:26:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-46866333-e579-45f7-95d7-f303c33d8d46 tempest-SnapshotMetadataTestJSON-838033286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6e5b07ab-9926-45a8-89b6-c00214e9aaf6.b6a2de48-c2cf-4eae-b626-7697aa503a40 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:26:53 devstack sudo[92133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6e5b07ab-9926-45a8-89b6-c00214e9aaf6.b6a2de48-c2cf-4eae-b626-7697aa503a40
Jul 14 16:26:53 devstack sudo[92133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:26:54 devstack sudo[92133]: pam_unix(sudo:session): session closed for user root
Jul 14 16:26:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-46866333-e579-45f7-95d7-f303c33d8d46 tempest-SnapshotMetadataTestJSON-838033286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6e5b07ab-9926-45a8-89b6-c00214e9aaf6.b6a2de48-c2cf-4eae-b626-7697aa503a40" returned: 0 in 0.597s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:26:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-46866333-e579-45f7-95d7-f303c33d8d46 tempest-SnapshotMetadataTestJSON-838033286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6e5b07ab-9926-45a8-89b6-c00214e9aaf6.b6a2de48-c2cf-4eae-b626-7697aa503a40 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:26:54 devstack sudo[92141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6e5b07ab-9926-45a8-89b6-c00214e9aaf6.b6a2de48-c2cf-4eae-b626-7697aa503a40
Jul 14 16:26:54 devstack sudo[92141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:26:55 devstack sudo[92141]: pam_unix(sudo:session): session closed for user root
Jul 14 16:26:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-46866333-e579-45f7-95d7-f303c33d8d46 tempest-SnapshotMetadataTestJSON-838033286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6e5b07ab-9926-45a8-89b6-c00214e9aaf6.b6a2de48-c2cf-4eae-b626-7697aa503a40" returned: 0 in 0.788s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:26:55 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-46866333-e579-45f7-95d7-f303c33d8d46 tempest-SnapshotMetadataTestJSON-838033286 None] Lock "cinder-quobyte-b6a2de48-c2cf-4eae-b626-7697aa503a40" released by "_delete_snapshot" :: held 3.090s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:26:55 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-46866333-e579-45f7-95d7-f303c33d8d46 tempest-SnapshotMetadataTestJSON-838033286 None] Lock "cinder-quobyte-6e5b07ab-9926-45a8-89b6-c00214e9aaf6" released by "delete_snapshot" :: held 3.136s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:26:55 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-46866333-e579-45f7-95d7-f303c33d8d46 tempest-SnapshotMetadataTestJSON-838033286 None] Created reservations ['cfac5ef5-c66d-4871-b2a9-d17f364c342a', 'bd9d8895-6574-4630-8b2b-d2b089d8ae95', 'c44fc2d8-e5fb-4228-89ef-3d8ea6ee9bf0', 'e52f7eee-418e-4606-8461-e1c0bb01bc70'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:26:55 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-46866333-e579-45f7-95d7-f303c33d8d46 tempest-SnapshotMetadataTestJSON-838033286 None] Delete snapshot completed successfully.
Jul 14 16:26:55 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-46866333-e579-45f7-95d7-f303c33d8d46 tempest-SnapshotMetadataTestJSON-838033286 None] Lock "cinder-b6a2de48-c2cf-4eae-b626-7697aa503a40-delete_snapshot" released by "delete_snapshot" :: held 3.556s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:26:57 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2a07a8c2-b816-45c0-8915-68d18fc2c584 tempest-SnapshotMetadataTestJSON-838033286 None] Acquiring lock "cinder-6e5b07ab-9926-45a8-89b6-c00214e9aaf6-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:26:57 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2a07a8c2-b816-45c0-8915-68d18fc2c584 tempest-SnapshotMetadataTestJSON-838033286 None] Lock "cinder-6e5b07ab-9926-45a8-89b6-c00214e9aaf6-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:26:57 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2a07a8c2-b816-45c0-8915-68d18fc2c584 tempest-SnapshotMetadataTestJSON-838033286 None] Acquiring lock "cinder-quobyte-6e5b07ab-9926-45a8-89b6-c00214e9aaf6" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:26:57 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2a07a8c2-b816-45c0-8915-68d18fc2c584 tempest-SnapshotMetadataTestJSON-838033286 None] Lock "cinder-quobyte-6e5b07ab-9926-45a8-89b6-c00214e9aaf6" acquired by "delete_volume" :: waited 0.051s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:26:57 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c9f389-fc7b-4d0f-a93e-d25704f4b8ba]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:26:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2a07a8c2-b816-45c0-8915-68d18fc2c584 tempest-SnapshotMetadataTestJSON-838033286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6e5b07ab-9926-45a8-89b6-c00214e9aaf6 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:26:57 devstack sudo[92255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6e5b07ab-9926-45a8-89b6-c00214e9aaf6
Jul 14 16:26:57 devstack sudo[92255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:26:58 devstack sudo[92255]: pam_unix(sudo:session): session closed for user root
Jul 14 16:26:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2a07a8c2-b816-45c0-8915-68d18fc2c584 tempest-SnapshotMetadataTestJSON-838033286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6e5b07ab-9926-45a8-89b6-c00214e9aaf6" returned: 0 in 0.833s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:26:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2a07a8c2-b816-45c0-8915-68d18fc2c584 tempest-SnapshotMetadataTestJSON-838033286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6e5b07ab-9926-45a8-89b6-c00214e9aaf6 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:26:58 devstack sudo[92267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6e5b07ab-9926-45a8-89b6-c00214e9aaf6
Jul 14 16:26:58 devstack sudo[92267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:26:58 devstack sudo[92267]: pam_unix(sudo:session): session closed for user root
Jul 14 16:26:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2a07a8c2-b816-45c0-8915-68d18fc2c584 tempest-SnapshotMetadataTestJSON-838033286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6e5b07ab-9926-45a8-89b6-c00214e9aaf6" returned: 0 in 0.608s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:26:58 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2a07a8c2-b816-45c0-8915-68d18fc2c584 tempest-SnapshotMetadataTestJSON-838033286 None] Lock "cinder-quobyte-6e5b07ab-9926-45a8-89b6-c00214e9aaf6" released by "delete_volume" :: held 1.577s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:26:58 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-2a07a8c2-b816-45c0-8915-68d18fc2c584 tempest-SnapshotMetadataTestJSON-838033286 None] Created reservations ['7331b265-351a-45aa-8b38-d51fee4456ac', 'b17fbe8d-4bd0-4833-b50e-2d01d7d6f078', 'cd7de23d-7bf0-4d27-9419-a87e81ab6ce4', 'd9f7eeaf-1a0e-4ead-b64f-6d88db64cf17'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:26:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2a07a8c2-b816-45c0-8915-68d18fc2c584 tempest-SnapshotMetadataTestJSON-838033286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:26:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2a07a8c2-b816-45c0-8915-68d18fc2c584 tempest-SnapshotMetadataTestJSON-838033286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:26:59 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2a07a8c2-b816-45c0-8915-68d18fc2c584 tempest-SnapshotMetadataTestJSON-838033286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:26:59 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2a07a8c2-b816-45c0-8915-68d18fc2c584 tempest-SnapshotMetadataTestJSON-838033286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:26:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2a07a8c2-b816-45c0-8915-68d18fc2c584 tempest-SnapshotMetadataTestJSON-838033286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:26:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2a07a8c2-b816-45c0-8915-68d18fc2c584 tempest-SnapshotMetadataTestJSON-838033286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:26:59 devstack sudo[92272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:26:59 devstack sudo[92272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:26:59 devstack sudo[92272]: pam_unix(sudo:session): session closed for user root
Jul 14 16:26:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2a07a8c2-b816-45c0-8915-68d18fc2c584 tempest-SnapshotMetadataTestJSON-838033286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.364s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:26:59 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-2a07a8c2-b816-45c0-8915-68d18fc2c584 tempest-SnapshotMetadataTestJSON-838033286 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:26:59 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-2a07a8c2-b816-45c0-8915-68d18fc2c584 tempest-SnapshotMetadataTestJSON-838033286 None] Deleted volume successfully.
Jul 14 16:26:59 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2a07a8c2-b816-45c0-8915-68d18fc2c584 tempest-SnapshotMetadataTestJSON-838033286 None] Lock "cinder-6e5b07ab-9926-45a8-89b6-c00214e9aaf6-delete_volume" released by "delete_volume" :: held 2.426s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:27:03 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-1b2a532a-5e4a-4a92-8175-4c48a8c6c7c2 tempest-ServerActionsTestOtherA-221655283 None] Acquiring lock "cinder-6761b33a-8d29-4ba0-8cd4-1532082a0ac9-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:27:03 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-1b2a532a-5e4a-4a92-8175-4c48a8c6c7c2 tempest-ServerActionsTestOtherA-221655283 None] Lock "cinder-6761b33a-8d29-4ba0-8cd4-1532082a0ac9-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:27:03 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-1b2a532a-5e4a-4a92-8175-4c48a8c6c7c2 tempest-ServerActionsTestOtherA-221655283 None] Acquiring lock "cinder-quobyte-6761b33a-8d29-4ba0-8cd4-1532082a0ac9" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:27:03 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-1b2a532a-5e4a-4a92-8175-4c48a8c6c7c2 tempest-ServerActionsTestOtherA-221655283 None] Lock "cinder-quobyte-6761b33a-8d29-4ba0-8cd4-1532082a0ac9" acquired by "delete_volume" :: waited 0.027s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:27:03 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e59eb35-5ac9-48d3-a810-70f88d39d1ac]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:27:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1b2a532a-5e4a-4a92-8175-4c48a8c6c7c2 tempest-ServerActionsTestOtherA-221655283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6761b33a-8d29-4ba0-8cd4-1532082a0ac9 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:27:03 devstack sudo[92344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6761b33a-8d29-4ba0-8cd4-1532082a0ac9
Jul 14 16:27:03 devstack sudo[92344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:27:03 devstack sudo[92344]: pam_unix(sudo:session): session closed for user root
Jul 14 16:27:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1b2a532a-5e4a-4a92-8175-4c48a8c6c7c2 tempest-ServerActionsTestOtherA-221655283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6761b33a-8d29-4ba0-8cd4-1532082a0ac9" returned: 0 in 0.550s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:27:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1b2a532a-5e4a-4a92-8175-4c48a8c6c7c2 tempest-ServerActionsTestOtherA-221655283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6761b33a-8d29-4ba0-8cd4-1532082a0ac9 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:27:04 devstack sudo[92361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6761b33a-8d29-4ba0-8cd4-1532082a0ac9
Jul 14 16:27:04 devstack sudo[92361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:27:04 devstack sudo[92361]: pam_unix(sudo:session): session closed for user root
Jul 14 16:27:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1b2a532a-5e4a-4a92-8175-4c48a8c6c7c2 tempest-ServerActionsTestOtherA-221655283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6761b33a-8d29-4ba0-8cd4-1532082a0ac9" returned: 0 in 0.307s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:27:04 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-1b2a532a-5e4a-4a92-8175-4c48a8c6c7c2 tempest-ServerActionsTestOtherA-221655283 None] Lock "cinder-quobyte-6761b33a-8d29-4ba0-8cd4-1532082a0ac9" released by "delete_volume" :: held 0.960s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:27:04 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-1b2a532a-5e4a-4a92-8175-4c48a8c6c7c2 tempest-ServerActionsTestOtherA-221655283 None] Created reservations ['c58661aa-fedf-4ac0-8bdd-1e4aca2d40c0', '3414a800-a8cb-4fdf-8757-ac3d5af26ca2', '1241e190-2817-4b2c-aa02-516c18bdfde9', 'ecc0d1d2-1d27-4c96-82eb-6cbac863388f'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:27:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1b2a532a-5e4a-4a92-8175-4c48a8c6c7c2 tempest-ServerActionsTestOtherA-221655283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:27:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1b2a532a-5e4a-4a92-8175-4c48a8c6c7c2 tempest-ServerActionsTestOtherA-221655283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:27:04 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-1b2a532a-5e4a-4a92-8175-4c48a8c6c7c2 tempest-ServerActionsTestOtherA-221655283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:27:04 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-1b2a532a-5e4a-4a92-8175-4c48a8c6c7c2 tempest-ServerActionsTestOtherA-221655283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:27:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1b2a532a-5e4a-4a92-8175-4c48a8c6c7c2 tempest-ServerActionsTestOtherA-221655283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:27:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1b2a532a-5e4a-4a92-8175-4c48a8c6c7c2 tempest-ServerActionsTestOtherA-221655283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:27:04 devstack sudo[92367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:27:04 devstack sudo[92367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:27:04 devstack sudo[92367]: pam_unix(sudo:session): session closed for user root
Jul 14 16:27:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1b2a532a-5e4a-4a92-8175-4c48a8c6c7c2 tempest-ServerActionsTestOtherA-221655283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.325s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:27:04 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-1b2a532a-5e4a-4a92-8175-4c48a8c6c7c2 tempest-ServerActionsTestOtherA-221655283 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:27:04 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-1b2a532a-5e4a-4a92-8175-4c48a8c6c7c2 tempest-ServerActionsTestOtherA-221655283 None] Deleted volume successfully.
Jul 14 16:27:04 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-1b2a532a-5e4a-4a92-8175-4c48a8c6c7c2 tempest-ServerActionsTestOtherA-221655283 None] Lock "cinder-6761b33a-8d29-4ba0-8cd4-1532082a0ac9-delete_volume" released by "delete_volume" :: held 1.714s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:27:09 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-26012477-edd7-41db-96bf-e1a07e167916 tempest-AbsoluteLimitsTests-1743893469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:27:09 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-26012477-edd7-41db-96bf-e1a07e167916 tempest-AbsoluteLimitsTests-1743893469 None] Flow 'volume_create_manager' (48d288f8-6f25-4ff8-b55e-20bbf35b31ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:27:09 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-26012477-edd7-41db-96bf-e1a07e167916 tempest-AbsoluteLimitsTests-1743893469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2abda1dc-1fea-4555-9ea6-212ce7aa1276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:27:09 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-26012477-edd7-41db-96bf-e1a07e167916 tempest-AbsoluteLimitsTests-1743893469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2abda1dc-1fea-4555-9ea6-212ce7aa1276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:27:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1535426945',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b25e0985-38a5-4d9f-85a3-5e2f6f4a1804,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0445aa3b421043c4a59a7d69936d1684',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:27:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:27:09Z,use_quota=True,user_id='a317295d885c471eb509e78faf140353',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:27:09 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-26012477-edd7-41db-96bf-e1a07e167916 tempest-AbsoluteLimitsTests-1743893469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efdd1327-e8e2-40fd-9158-55c13aef3ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:27:09 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-26012477-edd7-41db-96bf-e1a07e167916 tempest-AbsoluteLimitsTests-1743893469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efdd1327-e8e2-40fd-9158-55c13aef3ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:27:09 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-26012477-edd7-41db-96bf-e1a07e167916 tempest-AbsoluteLimitsTests-1743893469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81524b2a-6f8b-4667-a7ea-8098146e767e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:27:09 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-26012477-edd7-41db-96bf-e1a07e167916 tempest-AbsoluteLimitsTests-1743893469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81524b2a-6f8b-4667-a7ea-8098146e767e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b25e0985-38a5-4d9f-85a3-5e2f6f4a1804', 'volume_name': 'volume-b25e0985-38a5-4d9f-85a3-5e2f6f4a1804', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:27:09 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-26012477-edd7-41db-96bf-e1a07e167916 tempest-AbsoluteLimitsTests-1743893469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50d040b1-2b93-4a46-8753-4134a74dfbb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:27:09 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-26012477-edd7-41db-96bf-e1a07e167916 tempest-AbsoluteLimitsTests-1743893469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50d040b1-2b93-4a46-8753-4134a74dfbb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:27:09 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-26012477-edd7-41db-96bf-e1a07e167916 tempest-AbsoluteLimitsTests-1743893469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe905d3f-e85f-4ab8-a263-aa0faf3b8e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:27:09 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-26012477-edd7-41db-96bf-e1a07e167916 tempest-AbsoluteLimitsTests-1743893469 None] Volume b25e0985-38a5-4d9f-85a3-5e2f6f4a1804: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b25e0985-38a5-4d9f-85a3-5e2f6f4a1804', 'volume_size': 1}
Jul 14 16:27:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-26012477-edd7-41db-96bf-e1a07e167916 tempest-AbsoluteLimitsTests-1743893469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:27:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-26012477-edd7-41db-96bf-e1a07e167916 tempest-AbsoluteLimitsTests-1743893469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:27:09 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-26012477-edd7-41db-96bf-e1a07e167916 tempest-AbsoluteLimitsTests-1743893469 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:27:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1535426945',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b25e0985-38a5-4d9f-85a3-5e2f6f4a1804,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0445aa3b421043c4a59a7d69936d1684',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:27:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:27:09Z,use_quota=True,user_id='a317295d885c471eb509e78faf140353',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:27:09 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-26012477-edd7-41db-96bf-e1a07e167916 tempest-AbsoluteLimitsTests-1743893469 None] Creating volume b25e0985-38a5-4d9f-85a3-5e2f6f4a1804 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:27:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-26012477-edd7-41db-96bf-e1a07e167916 tempest-AbsoluteLimitsTests-1743893469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:27:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-26012477-edd7-41db-96bf-e1a07e167916 tempest-AbsoluteLimitsTests-1743893469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:27:09 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-26012477-edd7-41db-96bf-e1a07e167916 tempest-AbsoluteLimitsTests-1743893469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:27:09 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-26012477-edd7-41db-96bf-e1a07e167916 tempest-AbsoluteLimitsTests-1743893469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:27:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-26012477-edd7-41db-96bf-e1a07e167916 tempest-AbsoluteLimitsTests-1743893469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:27:09 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-26012477-edd7-41db-96bf-e1a07e167916 tempest-AbsoluteLimitsTests-1743893469 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:27:09 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-26012477-edd7-41db-96bf-e1a07e167916 tempest-AbsoluteLimitsTests-1743893469 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:27:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-26012477-edd7-41db-96bf-e1a07e167916 tempest-AbsoluteLimitsTests-1743893469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b25e0985-38a5-4d9f-85a3-5e2f6f4a1804 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:27:09 devstack sudo[92398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b25e0985-38a5-4d9f-85a3-5e2f6f4a1804 1073741824
Jul 14 16:27:09 devstack sudo[92398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:27:09 devstack sudo[92398]: pam_unix(sudo:session): session closed for user root
Jul 14 16:27:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-26012477-edd7-41db-96bf-e1a07e167916 tempest-AbsoluteLimitsTests-1743893469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b25e0985-38a5-4d9f-85a3-5e2f6f4a1804 1073741824" returned: 0 in 0.457s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:27:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-26012477-edd7-41db-96bf-e1a07e167916 tempest-AbsoluteLimitsTests-1743893469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b25e0985-38a5-4d9f-85a3-5e2f6f4a1804 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:27:09 devstack sudo[92404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b25e0985-38a5-4d9f-85a3-5e2f6f4a1804
Jul 14 16:27:09 devstack sudo[92404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:27:10 devstack sudo[92404]: pam_unix(sudo:session): session closed for user root
Jul 14 16:27:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-26012477-edd7-41db-96bf-e1a07e167916 tempest-AbsoluteLimitsTests-1743893469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b25e0985-38a5-4d9f-85a3-5e2f6f4a1804" returned: 0 in 0.264s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:27:10 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-26012477-edd7-41db-96bf-e1a07e167916 tempest-AbsoluteLimitsTests-1743893469 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:27:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-26012477-edd7-41db-96bf-e1a07e167916 tempest-AbsoluteLimitsTests-1743893469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:27:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-26012477-edd7-41db-96bf-e1a07e167916 tempest-AbsoluteLimitsTests-1743893469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe905d3f-e85f-4ab8-a263-aa0faf3b8e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b25e0985-38a5-4d9f-85a3-5e2f6f4a1804', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:27:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-26012477-edd7-41db-96bf-e1a07e167916 tempest-AbsoluteLimitsTests-1743893469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cf1137c-1d80-4a3a-987e-2861ba1260c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:27:10 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-26012477-edd7-41db-96bf-e1a07e167916 tempest-AbsoluteLimitsTests-1743893469 None] Volume volume-b25e0985-38a5-4d9f-85a3-5e2f6f4a1804 (b25e0985-38a5-4d9f-85a3-5e2f6f4a1804): created successfully
Jul 14 16:27:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-26012477-edd7-41db-96bf-e1a07e167916 tempest-AbsoluteLimitsTests-1743893469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cf1137c-1d80-4a3a-987e-2861ba1260c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:27:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-26012477-edd7-41db-96bf-e1a07e167916 tempest-AbsoluteLimitsTests-1743893469 None] Flow 'volume_create_manager' (48d288f8-6f25-4ff8-b55e-20bbf35b31ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:27:10 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-26012477-edd7-41db-96bf-e1a07e167916 tempest-AbsoluteLimitsTests-1743893469 None] Created volume successfully.
Jul 14 16:27:11 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6ed42e43-d24a-4340-9d57-ec49d7e75e32 tempest-AbsoluteLimitsTests-1743893469 None] Acquiring lock "cinder-b25e0985-38a5-4d9f-85a3-5e2f6f4a1804-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:27:11 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6ed42e43-d24a-4340-9d57-ec49d7e75e32 tempest-AbsoluteLimitsTests-1743893469 None] Lock "cinder-b25e0985-38a5-4d9f-85a3-5e2f6f4a1804-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:27:11 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6ed42e43-d24a-4340-9d57-ec49d7e75e32 tempest-AbsoluteLimitsTests-1743893469 None] Acquiring lock "cinder-quobyte-b25e0985-38a5-4d9f-85a3-5e2f6f4a1804" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:27:11 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6ed42e43-d24a-4340-9d57-ec49d7e75e32 tempest-AbsoluteLimitsTests-1743893469 None] Lock "cinder-quobyte-b25e0985-38a5-4d9f-85a3-5e2f6f4a1804" acquired by "delete_volume" :: waited 0.022s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:27:11 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[05dbd1a0-dd90-4e7a-a1ab-5c7c2b3652a7]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:27:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6ed42e43-d24a-4340-9d57-ec49d7e75e32 tempest-AbsoluteLimitsTests-1743893469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b25e0985-38a5-4d9f-85a3-5e2f6f4a1804 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:27:11 devstack sudo[92414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b25e0985-38a5-4d9f-85a3-5e2f6f4a1804
Jul 14 16:27:11 devstack sudo[92414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:27:12 devstack sudo[92414]: pam_unix(sudo:session): session closed for user root
Jul 14 16:27:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6ed42e43-d24a-4340-9d57-ec49d7e75e32 tempest-AbsoluteLimitsTests-1743893469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b25e0985-38a5-4d9f-85a3-5e2f6f4a1804" returned: 0 in 0.474s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:27:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6ed42e43-d24a-4340-9d57-ec49d7e75e32 tempest-AbsoluteLimitsTests-1743893469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b25e0985-38a5-4d9f-85a3-5e2f6f4a1804 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:27:12 devstack sudo[92419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b25e0985-38a5-4d9f-85a3-5e2f6f4a1804
Jul 14 16:27:12 devstack sudo[92419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:27:12 devstack sudo[92419]: pam_unix(sudo:session): session closed for user root
Jul 14 16:27:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6ed42e43-d24a-4340-9d57-ec49d7e75e32 tempest-AbsoluteLimitsTests-1743893469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b25e0985-38a5-4d9f-85a3-5e2f6f4a1804" returned: 0 in 0.434s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:27:12 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6ed42e43-d24a-4340-9d57-ec49d7e75e32 tempest-AbsoluteLimitsTests-1743893469 None] Lock "cinder-quobyte-b25e0985-38a5-4d9f-85a3-5e2f6f4a1804" released by "delete_volume" :: held 0.964s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:27:12 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-6ed42e43-d24a-4340-9d57-ec49d7e75e32 tempest-AbsoluteLimitsTests-1743893469 None] Created reservations ['304e43c9-0882-49c9-b4e4-2642fe881634', '4d17b57e-e237-424b-827f-88ae62d0ee89', 'ab1f1d62-7b77-4078-a84a-794958402526', 'c5e702b8-9af0-4940-8fad-d742082b661a'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:27:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6ed42e43-d24a-4340-9d57-ec49d7e75e32 tempest-AbsoluteLimitsTests-1743893469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:27:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6ed42e43-d24a-4340-9d57-ec49d7e75e32 tempest-AbsoluteLimitsTests-1743893469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:27:12 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6ed42e43-d24a-4340-9d57-ec49d7e75e32 tempest-AbsoluteLimitsTests-1743893469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:27:12 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6ed42e43-d24a-4340-9d57-ec49d7e75e32 tempest-AbsoluteLimitsTests-1743893469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:27:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6ed42e43-d24a-4340-9d57-ec49d7e75e32 tempest-AbsoluteLimitsTests-1743893469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:27:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6ed42e43-d24a-4340-9d57-ec49d7e75e32 tempest-AbsoluteLimitsTests-1743893469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:27:12 devstack sudo[92422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:27:12 devstack sudo[92422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:27:13 devstack sudo[92422]: pam_unix(sudo:session): session closed for user root
Jul 14 16:27:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6ed42e43-d24a-4340-9d57-ec49d7e75e32 tempest-AbsoluteLimitsTests-1743893469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.446s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:27:13 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-6ed42e43-d24a-4340-9d57-ec49d7e75e32 tempest-AbsoluteLimitsTests-1743893469 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:27:13 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-6ed42e43-d24a-4340-9d57-ec49d7e75e32 tempest-AbsoluteLimitsTests-1743893469 None] Deleted volume successfully.
Jul 14 16:27:13 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6ed42e43-d24a-4340-9d57-ec49d7e75e32 tempest-AbsoluteLimitsTests-1743893469 None] Lock "cinder-b25e0985-38a5-4d9f-85a3-5e2f6f4a1804-delete_volume" released by "delete_volume" :: held 1.726s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:27:16 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-21b2a5a5-5281-4a11-9cdf-e079c76818ea tempest-AttachVolumeNegativeTest-1726980645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:27:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-21b2a5a5-5281-4a11-9cdf-e079c76818ea tempest-AttachVolumeNegativeTest-1726980645 None] Flow 'volume_create_manager' (a24e2e6a-69cf-4cd6-90f4-368fb32161ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:27:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-21b2a5a5-5281-4a11-9cdf-e079c76818ea tempest-AttachVolumeNegativeTest-1726980645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac1cdcff-88cd-4719-bbc2-5825709dad0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:27:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-21b2a5a5-5281-4a11-9cdf-e079c76818ea tempest-AttachVolumeNegativeTest-1726980645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac1cdcff-88cd-4719-bbc2-5825709dad0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:27:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-58083789',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cacbc5a3-73ea-4ff6-9e6b-adfedd97f448,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cf84256246844f789857d186f14522c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:27:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:27:16Z,use_quota=True,user_id='4409e01f79d64f8eab1c43653e9d8333',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:27:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-21b2a5a5-5281-4a11-9cdf-e079c76818ea tempest-AttachVolumeNegativeTest-1726980645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c118463b-c8d5-4c97-92c7-d47b58e483b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:27:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-21b2a5a5-5281-4a11-9cdf-e079c76818ea tempest-AttachVolumeNegativeTest-1726980645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c118463b-c8d5-4c97-92c7-d47b58e483b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:27:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-21b2a5a5-5281-4a11-9cdf-e079c76818ea tempest-AttachVolumeNegativeTest-1726980645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01ff2995-a654-44bb-86e8-1e567446916d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:27:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-21b2a5a5-5281-4a11-9cdf-e079c76818ea tempest-AttachVolumeNegativeTest-1726980645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01ff2995-a654-44bb-86e8-1e567446916d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cacbc5a3-73ea-4ff6-9e6b-adfedd97f448', 'volume_name': 'volume-cacbc5a3-73ea-4ff6-9e6b-adfedd97f448', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:27:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-21b2a5a5-5281-4a11-9cdf-e079c76818ea tempest-AttachVolumeNegativeTest-1726980645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b074b9c-0f82-4308-9fed-caab8f21c94c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:27:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-21b2a5a5-5281-4a11-9cdf-e079c76818ea tempest-AttachVolumeNegativeTest-1726980645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b074b9c-0f82-4308-9fed-caab8f21c94c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:27:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-21b2a5a5-5281-4a11-9cdf-e079c76818ea tempest-AttachVolumeNegativeTest-1726980645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2049637-32d5-4862-8aa7-02939120b387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:27:16 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-21b2a5a5-5281-4a11-9cdf-e079c76818ea tempest-AttachVolumeNegativeTest-1726980645 None] Volume cacbc5a3-73ea-4ff6-9e6b-adfedd97f448: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cacbc5a3-73ea-4ff6-9e6b-adfedd97f448', 'volume_size': 1}
Jul 14 16:27:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-21b2a5a5-5281-4a11-9cdf-e079c76818ea tempest-AttachVolumeNegativeTest-1726980645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:27:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-21b2a5a5-5281-4a11-9cdf-e079c76818ea tempest-AttachVolumeNegativeTest-1726980645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:27:16 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-21b2a5a5-5281-4a11-9cdf-e079c76818ea tempest-AttachVolumeNegativeTest-1726980645 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:27:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-58083789',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cacbc5a3-73ea-4ff6-9e6b-adfedd97f448,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cf84256246844f789857d186f14522c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:27:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:27:16Z,use_quota=True,user_id='4409e01f79d64f8eab1c43653e9d8333',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:27:16 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-21b2a5a5-5281-4a11-9cdf-e079c76818ea tempest-AttachVolumeNegativeTest-1726980645 None] Creating volume cacbc5a3-73ea-4ff6-9e6b-adfedd97f448 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:27:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-21b2a5a5-5281-4a11-9cdf-e079c76818ea tempest-AttachVolumeNegativeTest-1726980645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:27:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-21b2a5a5-5281-4a11-9cdf-e079c76818ea tempest-AttachVolumeNegativeTest-1726980645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:27:16 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-21b2a5a5-5281-4a11-9cdf-e079c76818ea tempest-AttachVolumeNegativeTest-1726980645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:27:16 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-21b2a5a5-5281-4a11-9cdf-e079c76818ea tempest-AttachVolumeNegativeTest-1726980645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:27:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-21b2a5a5-5281-4a11-9cdf-e079c76818ea tempest-AttachVolumeNegativeTest-1726980645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:27:16 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-21b2a5a5-5281-4a11-9cdf-e079c76818ea tempest-AttachVolumeNegativeTest-1726980645 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:27:16 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-21b2a5a5-5281-4a11-9cdf-e079c76818ea tempest-AttachVolumeNegativeTest-1726980645 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:27:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-21b2a5a5-5281-4a11-9cdf-e079c76818ea tempest-AttachVolumeNegativeTest-1726980645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cacbc5a3-73ea-4ff6-9e6b-adfedd97f448 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:27:16 devstack sudo[92433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cacbc5a3-73ea-4ff6-9e6b-adfedd97f448 1073741824
Jul 14 16:27:16 devstack sudo[92433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:27:17 devstack sudo[92433]: pam_unix(sudo:session): session closed for user root
Jul 14 16:27:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-21b2a5a5-5281-4a11-9cdf-e079c76818ea tempest-AttachVolumeNegativeTest-1726980645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cacbc5a3-73ea-4ff6-9e6b-adfedd97f448 1073741824" returned: 0 in 0.517s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:27:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-21b2a5a5-5281-4a11-9cdf-e079c76818ea tempest-AttachVolumeNegativeTest-1726980645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cacbc5a3-73ea-4ff6-9e6b-adfedd97f448 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:27:17 devstack sudo[92439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cacbc5a3-73ea-4ff6-9e6b-adfedd97f448
Jul 14 16:27:17 devstack sudo[92439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:27:17 devstack sudo[92439]: pam_unix(sudo:session): session closed for user root
Jul 14 16:27:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-21b2a5a5-5281-4a11-9cdf-e079c76818ea tempest-AttachVolumeNegativeTest-1726980645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cacbc5a3-73ea-4ff6-9e6b-adfedd97f448" returned: 0 in 0.291s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:27:17 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-21b2a5a5-5281-4a11-9cdf-e079c76818ea tempest-AttachVolumeNegativeTest-1726980645 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:27:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-21b2a5a5-5281-4a11-9cdf-e079c76818ea tempest-AttachVolumeNegativeTest-1726980645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:27:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-21b2a5a5-5281-4a11-9cdf-e079c76818ea tempest-AttachVolumeNegativeTest-1726980645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2049637-32d5-4862-8aa7-02939120b387) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cacbc5a3-73ea-4ff6-9e6b-adfedd97f448', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:27:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-21b2a5a5-5281-4a11-9cdf-e079c76818ea tempest-AttachVolumeNegativeTest-1726980645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (977ca246-59e0-4392-8c1d-7d7c4ed411f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:27:17 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-21b2a5a5-5281-4a11-9cdf-e079c76818ea tempest-AttachVolumeNegativeTest-1726980645 None] Volume volume-cacbc5a3-73ea-4ff6-9e6b-adfedd97f448 (cacbc5a3-73ea-4ff6-9e6b-adfedd97f448): created successfully
Jul 14 16:27:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-21b2a5a5-5281-4a11-9cdf-e079c76818ea tempest-AttachVolumeNegativeTest-1726980645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (977ca246-59e0-4392-8c1d-7d7c4ed411f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:27:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-21b2a5a5-5281-4a11-9cdf-e079c76818ea tempest-AttachVolumeNegativeTest-1726980645 None] Flow 'volume_create_manager' (a24e2e6a-69cf-4cd6-90f4-368fb32161ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:27:17 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-21b2a5a5-5281-4a11-9cdf-e079c76818ea tempest-AttachVolumeNegativeTest-1726980645 None] Created volume successfully.
Jul 14 16:27:18 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7fee98a-e676-4a0b-9e89-41806516cfdc tempest-VolumesMetadataTest-1339729206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:27:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a7fee98a-e676-4a0b-9e89-41806516cfdc tempest-VolumesMetadataTest-1339729206 None] Flow 'volume_create_manager' (b3060d97-d56d-42a5-853b-d4cfe6ef1f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:27:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a7fee98a-e676-4a0b-9e89-41806516cfdc tempest-VolumesMetadataTest-1339729206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a24154d8-d9e3-4b7e-b485-f8a2f24107c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:27:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a7fee98a-e676-4a0b-9e89-41806516cfdc tempest-VolumesMetadataTest-1339729206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a24154d8-d9e3-4b7e-b485-f8a2f24107c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:27:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-511872731',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5986d1f-c02a-4cf9-98af-48e871904841,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='152b001fa1d7469b8cdb40e1bcb6a424',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:27:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:27:18Z,use_quota=True,user_id='ab82e476907643e6a41d51b9ed14aaba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:27:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a7fee98a-e676-4a0b-9e89-41806516cfdc tempest-VolumesMetadataTest-1339729206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f94c7b1-f599-4733-8772-1b3aabd5252a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:27:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a7fee98a-e676-4a0b-9e89-41806516cfdc tempest-VolumesMetadataTest-1339729206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f94c7b1-f599-4733-8772-1b3aabd5252a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:27:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a7fee98a-e676-4a0b-9e89-41806516cfdc tempest-VolumesMetadataTest-1339729206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cd8fd15-7bb7-4d53-8ae7-a973a8badb53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:27:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a7fee98a-e676-4a0b-9e89-41806516cfdc tempest-VolumesMetadataTest-1339729206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cd8fd15-7bb7-4d53-8ae7-a973a8badb53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5986d1f-c02a-4cf9-98af-48e871904841', 'volume_name': 'volume-e5986d1f-c02a-4cf9-98af-48e871904841', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:27:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a7fee98a-e676-4a0b-9e89-41806516cfdc tempest-VolumesMetadataTest-1339729206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83b872ab-16d6-4b85-99d3-2139101e845a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:27:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a7fee98a-e676-4a0b-9e89-41806516cfdc tempest-VolumesMetadataTest-1339729206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83b872ab-16d6-4b85-99d3-2139101e845a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:27:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a7fee98a-e676-4a0b-9e89-41806516cfdc tempest-VolumesMetadataTest-1339729206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86329eb3-04e0-4826-8c07-10f84010513f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:27:18 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-a7fee98a-e676-4a0b-9e89-41806516cfdc tempest-VolumesMetadataTest-1339729206 None] Volume e5986d1f-c02a-4cf9-98af-48e871904841: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5986d1f-c02a-4cf9-98af-48e871904841', 'volume_size': 1}
Jul 14 16:27:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a7fee98a-e676-4a0b-9e89-41806516cfdc tempest-VolumesMetadataTest-1339729206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:27:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a7fee98a-e676-4a0b-9e89-41806516cfdc tempest-VolumesMetadataTest-1339729206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:27:18 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a7fee98a-e676-4a0b-9e89-41806516cfdc tempest-VolumesMetadataTest-1339729206 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:27:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-511872731',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5986d1f-c02a-4cf9-98af-48e871904841,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='152b001fa1d7469b8cdb40e1bcb6a424',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:27:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:27:18Z,use_quota=True,user_id='ab82e476907643e6a41d51b9ed14aaba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:27:18 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-a7fee98a-e676-4a0b-9e89-41806516cfdc tempest-VolumesMetadataTest-1339729206 None] Creating volume e5986d1f-c02a-4cf9-98af-48e871904841 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:27:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a7fee98a-e676-4a0b-9e89-41806516cfdc tempest-VolumesMetadataTest-1339729206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:27:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a7fee98a-e676-4a0b-9e89-41806516cfdc tempest-VolumesMetadataTest-1339729206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:27:18 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a7fee98a-e676-4a0b-9e89-41806516cfdc tempest-VolumesMetadataTest-1339729206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:27:18 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a7fee98a-e676-4a0b-9e89-41806516cfdc tempest-VolumesMetadataTest-1339729206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:27:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a7fee98a-e676-4a0b-9e89-41806516cfdc tempest-VolumesMetadataTest-1339729206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:27:18 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a7fee98a-e676-4a0b-9e89-41806516cfdc tempest-VolumesMetadataTest-1339729206 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:27:18 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-a7fee98a-e676-4a0b-9e89-41806516cfdc tempest-VolumesMetadataTest-1339729206 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:27:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a7fee98a-e676-4a0b-9e89-41806516cfdc tempest-VolumesMetadataTest-1339729206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e5986d1f-c02a-4cf9-98af-48e871904841 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:27:18 devstack sudo[92442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e5986d1f-c02a-4cf9-98af-48e871904841 1073741824
Jul 14 16:27:18 devstack sudo[92442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:27:19 devstack sudo[92442]: pam_unix(sudo:session): session closed for user root
Jul 14 16:27:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a7fee98a-e676-4a0b-9e89-41806516cfdc tempest-VolumesMetadataTest-1339729206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e5986d1f-c02a-4cf9-98af-48e871904841 1073741824" returned: 0 in 0.603s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:27:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a7fee98a-e676-4a0b-9e89-41806516cfdc tempest-VolumesMetadataTest-1339729206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e5986d1f-c02a-4cf9-98af-48e871904841 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:27:19 devstack sudo[92461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e5986d1f-c02a-4cf9-98af-48e871904841
Jul 14 16:27:19 devstack sudo[92461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:27:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-b4443960-d3c1-4036-b7bd-90f7cb746cf4 req-ab1dee7f-ce2a-4892-81e5-14ddea212415 tempest-AttachVolumeNegativeTest-1726980645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:27:19 devstack sudo[92461]: pam_unix(sudo:session): session closed for user root
Jul 14 16:27:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a7fee98a-e676-4a0b-9e89-41806516cfdc tempest-VolumesMetadataTest-1339729206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e5986d1f-c02a-4cf9-98af-48e871904841" returned: 0 in 0.288s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:27:19 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a7fee98a-e676-4a0b-9e89-41806516cfdc tempest-VolumesMetadataTest-1339729206 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:27:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a7fee98a-e676-4a0b-9e89-41806516cfdc tempest-VolumesMetadataTest-1339729206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:27:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-b4443960-d3c1-4036-b7bd-90f7cb746cf4 req-ab1dee7f-ce2a-4892-81e5-14ddea212415 tempest-AttachVolumeNegativeTest-1726980645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.136s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:27:19 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ecc2f0d-587d-4f6f-91d8-9c33a083a680]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:27:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-b4443960-d3c1-4036-b7bd-90f7cb746cf4 req-ab1dee7f-ce2a-4892-81e5-14ddea212415 tempest-AttachVolumeNegativeTest-1726980645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cacbc5a3-73ea-4ff6-9e6b-adfedd97f448 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:27:19 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a7fee98a-e676-4a0b-9e89-41806516cfdc tempest-VolumesMetadataTest-1339729206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86329eb3-04e0-4826-8c07-10f84010513f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5986d1f-c02a-4cf9-98af-48e871904841', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:27:19 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a7fee98a-e676-4a0b-9e89-41806516cfdc tempest-VolumesMetadataTest-1339729206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7176d2eb-82a6-476a-b63a-e86b37e4a8a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:27:19 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-a7fee98a-e676-4a0b-9e89-41806516cfdc tempest-VolumesMetadataTest-1339729206 None] Volume volume-e5986d1f-c02a-4cf9-98af-48e871904841 (e5986d1f-c02a-4cf9-98af-48e871904841): created successfully
Jul 14 16:27:19 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a7fee98a-e676-4a0b-9e89-41806516cfdc tempest-VolumesMetadataTest-1339729206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7176d2eb-82a6-476a-b63a-e86b37e4a8a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:27:19 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a7fee98a-e676-4a0b-9e89-41806516cfdc tempest-VolumesMetadataTest-1339729206 None] Flow 'volume_create_manager' (b3060d97-d56d-42a5-853b-d4cfe6ef1f85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:27:19 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-a7fee98a-e676-4a0b-9e89-41806516cfdc tempest-VolumesMetadataTest-1339729206 None] Created volume successfully.
Jul 14 16:27:19 devstack sudo[92465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cacbc5a3-73ea-4ff6-9e6b-adfedd97f448
Jul 14 16:27:19 devstack sudo[92465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:27:19 devstack sudo[92465]: pam_unix(sudo:session): session closed for user root
Jul 14 16:27:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-b4443960-d3c1-4036-b7bd-90f7cb746cf4 req-ab1dee7f-ce2a-4892-81e5-14ddea212415 tempest-AttachVolumeNegativeTest-1726980645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cacbc5a3-73ea-4ff6-9e6b-adfedd97f448" returned: 0 in 0.365s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:27:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-b4443960-d3c1-4036-b7bd-90f7cb746cf4 req-ab1dee7f-ce2a-4892-81e5-14ddea212415 tempest-AttachVolumeNegativeTest-1726980645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.384s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:27:19 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-b4443960-d3c1-4036-b7bd-90f7cb746cf4 req-ab1dee7f-ce2a-4892-81e5-14ddea212415 tempest-AttachVolumeNegativeTest-1726980645 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052', 'name': 'volume-cacbc5a3-73ea-4ff6-9e6b-adfedd97f448', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '65db7a73-4695-4a78-b86c-a2f7a763ef01', 'enforce_multipath': True} {{(pid=87166) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 14 16:27:19 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-b4443960-d3c1-4036-b7bd-90f7cb746cf4 req-ab1dee7f-ce2a-4892-81e5-14ddea212415 tempest-AttachVolumeNegativeTest-1726980645 None] attachment_update completed successfully.
Jul 14 16:27:21 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2d0ca126-71fa-4bb7-8dd0-c28f9476ddb9 tempest-VolumesMetadataTest-1339729206 None] Acquiring lock "cinder-e5986d1f-c02a-4cf9-98af-48e871904841-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:27:21 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2d0ca126-71fa-4bb7-8dd0-c28f9476ddb9 tempest-VolumesMetadataTest-1339729206 None] Lock "cinder-e5986d1f-c02a-4cf9-98af-48e871904841-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:27:21 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2d0ca126-71fa-4bb7-8dd0-c28f9476ddb9 tempest-VolumesMetadataTest-1339729206 None] Acquiring lock "cinder-quobyte-e5986d1f-c02a-4cf9-98af-48e871904841" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:27:21 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2d0ca126-71fa-4bb7-8dd0-c28f9476ddb9 tempest-VolumesMetadataTest-1339729206 None] Lock "cinder-quobyte-e5986d1f-c02a-4cf9-98af-48e871904841" acquired by "delete_volume" :: waited 0.038s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:27:21 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b1252d3-a687-4f86-bd5f-4755a8feea5b]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:27:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2d0ca126-71fa-4bb7-8dd0-c28f9476ddb9 tempest-VolumesMetadataTest-1339729206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e5986d1f-c02a-4cf9-98af-48e871904841 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:27:21 devstack sudo[92854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e5986d1f-c02a-4cf9-98af-48e871904841
Jul 14 16:27:21 devstack sudo[92854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:27:22 devstack sudo[92854]: pam_unix(sudo:session): session closed for user root
Jul 14 16:27:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2d0ca126-71fa-4bb7-8dd0-c28f9476ddb9 tempest-VolumesMetadataTest-1339729206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e5986d1f-c02a-4cf9-98af-48e871904841" returned: 0 in 0.626s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:27:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2d0ca126-71fa-4bb7-8dd0-c28f9476ddb9 tempest-VolumesMetadataTest-1339729206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e5986d1f-c02a-4cf9-98af-48e871904841 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:27:22 devstack sudo[92860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e5986d1f-c02a-4cf9-98af-48e871904841
Jul 14 16:27:22 devstack sudo[92860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:27:22 devstack sudo[92860]: pam_unix(sudo:session): session closed for user root
Jul 14 16:27:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2d0ca126-71fa-4bb7-8dd0-c28f9476ddb9 tempest-VolumesMetadataTest-1339729206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e5986d1f-c02a-4cf9-98af-48e871904841" returned: 0 in 0.331s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:27:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2d0ca126-71fa-4bb7-8dd0-c28f9476ddb9 tempest-VolumesMetadataTest-1339729206 None] Lock "cinder-quobyte-e5986d1f-c02a-4cf9-98af-48e871904841" released by "delete_volume" :: held 1.031s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:27:22 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-2d0ca126-71fa-4bb7-8dd0-c28f9476ddb9 tempest-VolumesMetadataTest-1339729206 None] Created reservations ['5ba91072-dd86-4b30-a374-1280aa6c5461', '34f7a31e-200e-45ee-a7e3-26cf7f99a102', '02c1b390-fc21-445e-9bcd-a01ec3c44e23', '5f479298-dc3b-453b-bf15-7291a871c258'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:27:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2d0ca126-71fa-4bb7-8dd0-c28f9476ddb9 tempest-VolumesMetadataTest-1339729206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:27:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2d0ca126-71fa-4bb7-8dd0-c28f9476ddb9 tempest-VolumesMetadataTest-1339729206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:27:22 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2d0ca126-71fa-4bb7-8dd0-c28f9476ddb9 tempest-VolumesMetadataTest-1339729206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:27:22 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2d0ca126-71fa-4bb7-8dd0-c28f9476ddb9 tempest-VolumesMetadataTest-1339729206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:27:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2d0ca126-71fa-4bb7-8dd0-c28f9476ddb9 tempest-VolumesMetadataTest-1339729206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:27:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2d0ca126-71fa-4bb7-8dd0-c28f9476ddb9 tempest-VolumesMetadataTest-1339729206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:27:22 devstack sudo[92863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:27:22 devstack sudo[92863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:27:23 devstack sudo[92863]: pam_unix(sudo:session): session closed for user root
Jul 14 16:27:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2d0ca126-71fa-4bb7-8dd0-c28f9476ddb9 tempest-VolumesMetadataTest-1339729206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.427s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:27:23 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-2d0ca126-71fa-4bb7-8dd0-c28f9476ddb9 tempest-VolumesMetadataTest-1339729206 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:27:23 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-2d0ca126-71fa-4bb7-8dd0-c28f9476ddb9 tempest-VolumesMetadataTest-1339729206 None] Deleted volume successfully.
Jul 14 16:27:23 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2d0ca126-71fa-4bb7-8dd0-c28f9476ddb9 tempest-VolumesMetadataTest-1339729206 None] Lock "cinder-e5986d1f-c02a-4cf9-98af-48e871904841-delete_volume" released by "delete_volume" :: held 1.822s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:27:31 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f178c6e1-10d3-4c2d-ad1b-3346d200922d tempest-AttachVolumeShelveTestJSON-1892612854 None] Acquiring lock "cinder-c83cb3b1-e97b-400b-8675-5e44281df1f3-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:27:31 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f178c6e1-10d3-4c2d-ad1b-3346d200922d tempest-AttachVolumeShelveTestJSON-1892612854 None] Lock "cinder-c83cb3b1-e97b-400b-8675-5e44281df1f3-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:27:31 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f178c6e1-10d3-4c2d-ad1b-3346d200922d tempest-AttachVolumeShelveTestJSON-1892612854 None] Acquiring lock "cinder-quobyte-c83cb3b1-e97b-400b-8675-5e44281df1f3" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:27:31 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f178c6e1-10d3-4c2d-ad1b-3346d200922d tempest-AttachVolumeShelveTestJSON-1892612854 None] Lock "cinder-quobyte-c83cb3b1-e97b-400b-8675-5e44281df1f3" acquired by "delete_volume" :: waited 0.036s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:27:31 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[36867406-94fd-44fa-ba14-e90cc09badad]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:27:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f178c6e1-10d3-4c2d-ad1b-3346d200922d tempest-AttachVolumeShelveTestJSON-1892612854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c83cb3b1-e97b-400b-8675-5e44281df1f3 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:27:32 devstack sudo[92902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c83cb3b1-e97b-400b-8675-5e44281df1f3
Jul 14 16:27:32 devstack sudo[92902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:27:32 devstack sudo[92902]: pam_unix(sudo:session): session closed for user root
Jul 14 16:27:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f178c6e1-10d3-4c2d-ad1b-3346d200922d tempest-AttachVolumeShelveTestJSON-1892612854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c83cb3b1-e97b-400b-8675-5e44281df1f3" returned: 0 in 0.781s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:27:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f178c6e1-10d3-4c2d-ad1b-3346d200922d tempest-AttachVolumeShelveTestJSON-1892612854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c83cb3b1-e97b-400b-8675-5e44281df1f3 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:27:32 devstack sudo[92922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c83cb3b1-e97b-400b-8675-5e44281df1f3
Jul 14 16:27:32 devstack sudo[92922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:27:32 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-79787df5-8bef-4027-9670-5bf5ec737f4f tempest-VolumesTransfersV357Test-1843503382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:27:32 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-79787df5-8bef-4027-9670-5bf5ec737f4f tempest-VolumesTransfersV357Test-1843503382 None] Flow 'volume_create_manager' (7ca56b0e-8cbc-4227-92d8-2822f3c573b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:27:32 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-79787df5-8bef-4027-9670-5bf5ec737f4f tempest-VolumesTransfersV357Test-1843503382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21662fff-c2a3-43aa-b115-e9224e71e9cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:27:32 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-79787df5-8bef-4027-9670-5bf5ec737f4f tempest-VolumesTransfersV357Test-1843503382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21662fff-c2a3-43aa-b115-e9224e71e9cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:27:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-104064365',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2203e9e2-b2e2-402a-a8e2-139bb0a9a000,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1010900f028645cb8ce099556fd00a1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:27:33Z,use_quota=True,user_id='69d11d9e43994ed4aaa22c12805cf4c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:27:32 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-79787df5-8bef-4027-9670-5bf5ec737f4f tempest-VolumesTransfersV357Test-1843503382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29b8183a-f17f-4f52-9b57-bb08cabe9715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:27:32 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-79787df5-8bef-4027-9670-5bf5ec737f4f tempest-VolumesTransfersV357Test-1843503382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29b8183a-f17f-4f52-9b57-bb08cabe9715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:27:32 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-79787df5-8bef-4027-9670-5bf5ec737f4f tempest-VolumesTransfersV357Test-1843503382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9352db39-17d9-4787-b65d-fe125306d992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:27:32 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-79787df5-8bef-4027-9670-5bf5ec737f4f tempest-VolumesTransfersV357Test-1843503382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9352db39-17d9-4787-b65d-fe125306d992) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2203e9e2-b2e2-402a-a8e2-139bb0a9a000', 'volume_name': 'volume-2203e9e2-b2e2-402a-a8e2-139bb0a9a000', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:27:32 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-79787df5-8bef-4027-9670-5bf5ec737f4f tempest-VolumesTransfersV357Test-1843503382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87c556a6-f7d5-4b81-bffa-86b4da5c9020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:27:33 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-79787df5-8bef-4027-9670-5bf5ec737f4f tempest-VolumesTransfersV357Test-1843503382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87c556a6-f7d5-4b81-bffa-86b4da5c9020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:27:33 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-79787df5-8bef-4027-9670-5bf5ec737f4f tempest-VolumesTransfersV357Test-1843503382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e31fd7d-53f6-4a7f-b03d-0d0329f059f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:27:33 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-79787df5-8bef-4027-9670-5bf5ec737f4f tempest-VolumesTransfersV357Test-1843503382 None] Volume 2203e9e2-b2e2-402a-a8e2-139bb0a9a000: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2203e9e2-b2e2-402a-a8e2-139bb0a9a000', 'volume_size': 1}
Jul 14 16:27:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-79787df5-8bef-4027-9670-5bf5ec737f4f tempest-VolumesTransfersV357Test-1843503382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:27:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-79787df5-8bef-4027-9670-5bf5ec737f4f tempest-VolumesTransfersV357Test-1843503382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:27:33 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-79787df5-8bef-4027-9670-5bf5ec737f4f tempest-VolumesTransfersV357Test-1843503382 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:27:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-104064365',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2203e9e2-b2e2-402a-a8e2-139bb0a9a000,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1010900f028645cb8ce099556fd00a1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:27:33Z,use_quota=True,user_id='69d11d9e43994ed4aaa22c12805cf4c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:27:33 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-79787df5-8bef-4027-9670-5bf5ec737f4f tempest-VolumesTransfersV357Test-1843503382 None] Creating volume 2203e9e2-b2e2-402a-a8e2-139bb0a9a000 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:27:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-79787df5-8bef-4027-9670-5bf5ec737f4f tempest-VolumesTransfersV357Test-1843503382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:27:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-79787df5-8bef-4027-9670-5bf5ec737f4f tempest-VolumesTransfersV357Test-1843503382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:27:33 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-79787df5-8bef-4027-9670-5bf5ec737f4f tempest-VolumesTransfersV357Test-1843503382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:27:33 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-79787df5-8bef-4027-9670-5bf5ec737f4f tempest-VolumesTransfersV357Test-1843503382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:27:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-79787df5-8bef-4027-9670-5bf5ec737f4f tempest-VolumesTransfersV357Test-1843503382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:27:33 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-79787df5-8bef-4027-9670-5bf5ec737f4f tempest-VolumesTransfersV357Test-1843503382 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:27:33 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-79787df5-8bef-4027-9670-5bf5ec737f4f tempest-VolumesTransfersV357Test-1843503382 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:27:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-79787df5-8bef-4027-9670-5bf5ec737f4f tempest-VolumesTransfersV357Test-1843503382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2203e9e2-b2e2-402a-a8e2-139bb0a9a000 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:27:33 devstack sudo[92924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2203e9e2-b2e2-402a-a8e2-139bb0a9a000 1073741824
Jul 14 16:27:33 devstack sudo[92924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:27:33 devstack sudo[92922]: pam_unix(sudo:session): session closed for user root
Jul 14 16:27:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f178c6e1-10d3-4c2d-ad1b-3346d200922d tempest-AttachVolumeShelveTestJSON-1892612854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c83cb3b1-e97b-400b-8675-5e44281df1f3" returned: 0 in 0.388s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:27:33 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f178c6e1-10d3-4c2d-ad1b-3346d200922d tempest-AttachVolumeShelveTestJSON-1892612854 None] Lock "cinder-quobyte-c83cb3b1-e97b-400b-8675-5e44281df1f3" released by "delete_volume" :: held 1.246s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:27:33 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-f178c6e1-10d3-4c2d-ad1b-3346d200922d tempest-AttachVolumeShelveTestJSON-1892612854 None] Created reservations ['812d60f1-3944-40c3-8c6c-1cc40561887b', 'd5bb475e-f6be-4d92-ae8c-89d8e57005b8', 'c8d66f53-9a90-4e7d-864e-a6851abbc331', '4d143813-bc43-44ad-b133-c233ebc5a759'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:27:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f178c6e1-10d3-4c2d-ad1b-3346d200922d tempest-AttachVolumeShelveTestJSON-1892612854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:27:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f178c6e1-10d3-4c2d-ad1b-3346d200922d tempest-AttachVolumeShelveTestJSON-1892612854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:27:33 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f178c6e1-10d3-4c2d-ad1b-3346d200922d tempest-AttachVolumeShelveTestJSON-1892612854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:27:33 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f178c6e1-10d3-4c2d-ad1b-3346d200922d tempest-AttachVolumeShelveTestJSON-1892612854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:27:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f178c6e1-10d3-4c2d-ad1b-3346d200922d tempest-AttachVolumeShelveTestJSON-1892612854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:27:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f178c6e1-10d3-4c2d-ad1b-3346d200922d tempest-AttachVolumeShelveTestJSON-1892612854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:27:33 devstack sudo[92931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:27:33 devstack sudo[92931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:27:33 devstack sudo[92924]: pam_unix(sudo:session): session closed for user root
Jul 14 16:27:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-79787df5-8bef-4027-9670-5bf5ec737f4f tempest-VolumesTransfersV357Test-1843503382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2203e9e2-b2e2-402a-a8e2-139bb0a9a000 1073741824" returned: 0 in 0.601s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:27:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-79787df5-8bef-4027-9670-5bf5ec737f4f tempest-VolumesTransfersV357Test-1843503382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2203e9e2-b2e2-402a-a8e2-139bb0a9a000 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:27:33 devstack sudo[92931]: pam_unix(sudo:session): session closed for user root
Jul 14 16:27:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f178c6e1-10d3-4c2d-ad1b-3346d200922d tempest-AttachVolumeShelveTestJSON-1892612854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.371s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:27:33 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-f178c6e1-10d3-4c2d-ad1b-3346d200922d tempest-AttachVolumeShelveTestJSON-1892612854 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:27:33 devstack sudo[92935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2203e9e2-b2e2-402a-a8e2-139bb0a9a000
Jul 14 16:27:33 devstack sudo[92935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:27:33 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-f178c6e1-10d3-4c2d-ad1b-3346d200922d tempest-AttachVolumeShelveTestJSON-1892612854 None] Deleted volume successfully.
Jul 14 16:27:33 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f178c6e1-10d3-4c2d-ad1b-3346d200922d tempest-AttachVolumeShelveTestJSON-1892612854 None] Lock "cinder-c83cb3b1-e97b-400b-8675-5e44281df1f3-delete_volume" released by "delete_volume" :: held 1.946s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:27:34 devstack sudo[92935]: pam_unix(sudo:session): session closed for user root
Jul 14 16:27:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-79787df5-8bef-4027-9670-5bf5ec737f4f tempest-VolumesTransfersV357Test-1843503382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2203e9e2-b2e2-402a-a8e2-139bb0a9a000" returned: 0 in 0.316s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:27:34 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-79787df5-8bef-4027-9670-5bf5ec737f4f tempest-VolumesTransfersV357Test-1843503382 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:27:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-79787df5-8bef-4027-9670-5bf5ec737f4f tempest-VolumesTransfersV357Test-1843503382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:27:34 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-79787df5-8bef-4027-9670-5bf5ec737f4f tempest-VolumesTransfersV357Test-1843503382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e31fd7d-53f6-4a7f-b03d-0d0329f059f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2203e9e2-b2e2-402a-a8e2-139bb0a9a000', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:27:34 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-79787df5-8bef-4027-9670-5bf5ec737f4f tempest-VolumesTransfersV357Test-1843503382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05131e44-c552-4c2c-b500-b1d6303df4f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:27:34 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-79787df5-8bef-4027-9670-5bf5ec737f4f tempest-VolumesTransfersV357Test-1843503382 None] Volume volume-2203e9e2-b2e2-402a-a8e2-139bb0a9a000 (2203e9e2-b2e2-402a-a8e2-139bb0a9a000): created successfully
Jul 14 16:27:34 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-79787df5-8bef-4027-9670-5bf5ec737f4f tempest-VolumesTransfersV357Test-1843503382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05131e44-c552-4c2c-b500-b1d6303df4f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:27:34 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-79787df5-8bef-4027-9670-5bf5ec737f4f tempest-VolumesTransfersV357Test-1843503382 None] Flow 'volume_create_manager' (7ca56b0e-8cbc-4227-92d8-2822f3c573b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:27:34 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-79787df5-8bef-4027-9670-5bf5ec737f4f tempest-VolumesTransfersV357Test-1843503382 None] Created volume successfully.
Jul 14 16:27:35 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 16:27:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:27:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:27:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:27:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:27:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:27:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:27:35 devstack sudo[92957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:27:35 devstack sudo[92957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:27:35 devstack sudo[92957]: pam_unix(sudo:session): session closed for user root
Jul 14 16:27:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.355s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:27:35 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:27:35 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Running periodic task VolumeManager._thread_info {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 16:27:35 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] thread count: 8 {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 14 16:27:35 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] thread info: [<_MainThread(MainThread, started 128606490927232)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128606415432960)>, <Thread(Thread-3 (stat_writer), started daemon 128606378859328)>, <Thread(Rabbit-heartbeat, started daemon 128606379646144)>, <Thread(Thread-5 (_runner), started daemon 128606377685824)>, <Thread(Thread-7 (_runner), started daemon 128606377701888)>, <Thread(fd_logger, started daemon 128606377091392)>, <Thread(privsep_reader, started daemon 128606375782080)>] {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 14 16:27:35 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-d7387b10-20c1-4284-b627-4b286444cc43 tempest-VolumesTransfersV357Test-966343848 None] Transfer volume completed successfully.
Jul 14 16:27:36 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-990275fe-02e1-4d25-8e79-4e2f69de2426 tempest-VolumesTransfersV357Test-1461613222 None] Acquiring lock "cinder-2203e9e2-b2e2-402a-a8e2-139bb0a9a000-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:27:36 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-990275fe-02e1-4d25-8e79-4e2f69de2426 tempest-VolumesTransfersV357Test-1461613222 None] Lock "cinder-2203e9e2-b2e2-402a-a8e2-139bb0a9a000-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:27:36 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-990275fe-02e1-4d25-8e79-4e2f69de2426 tempest-VolumesTransfersV357Test-1461613222 None] Acquiring lock "cinder-quobyte-2203e9e2-b2e2-402a-a8e2-139bb0a9a000" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:27:36 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-990275fe-02e1-4d25-8e79-4e2f69de2426 tempest-VolumesTransfersV357Test-1461613222 None] Lock "cinder-quobyte-2203e9e2-b2e2-402a-a8e2-139bb0a9a000" acquired by "delete_volume" :: waited 0.022s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:27:36 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e4ce33-44cb-46d6-96ea-7f2479e5ee22]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:27:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-990275fe-02e1-4d25-8e79-4e2f69de2426 tempest-VolumesTransfersV357Test-1461613222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2203e9e2-b2e2-402a-a8e2-139bb0a9a000 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:27:36 devstack sudo[92964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2203e9e2-b2e2-402a-a8e2-139bb0a9a000
Jul 14 16:27:36 devstack sudo[92964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:27:37 devstack sudo[92964]: pam_unix(sudo:session): session closed for user root
Jul 14 16:27:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-990275fe-02e1-4d25-8e79-4e2f69de2426 tempest-VolumesTransfersV357Test-1461613222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2203e9e2-b2e2-402a-a8e2-139bb0a9a000" returned: 0 in 0.429s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:27:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-990275fe-02e1-4d25-8e79-4e2f69de2426 tempest-VolumesTransfersV357Test-1461613222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2203e9e2-b2e2-402a-a8e2-139bb0a9a000 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:27:37 devstack sudo[92969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2203e9e2-b2e2-402a-a8e2-139bb0a9a000
Jul 14 16:27:37 devstack sudo[92969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:27:37 devstack sudo[92969]: pam_unix(sudo:session): session closed for user root
Jul 14 16:27:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-990275fe-02e1-4d25-8e79-4e2f69de2426 tempest-VolumesTransfersV357Test-1461613222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2203e9e2-b2e2-402a-a8e2-139bb0a9a000" returned: 0 in 0.490s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:27:37 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-990275fe-02e1-4d25-8e79-4e2f69de2426 tempest-VolumesTransfersV357Test-1461613222 None] Lock "cinder-quobyte-2203e9e2-b2e2-402a-a8e2-139bb0a9a000" released by "delete_volume" :: held 0.986s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:27:37 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-990275fe-02e1-4d25-8e79-4e2f69de2426 tempest-VolumesTransfersV357Test-1461613222 None] Created reservations ['e7b5a318-0e95-4227-8ea3-91fadc2bde9b', 'c01b91da-b56b-4969-99ec-e4344b1458c8', 'd6f98fc2-8d2b-4f65-ba61-3e68cea24374', '13d052f9-9739-4e77-a85a-68efe29b3b83'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:27:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-990275fe-02e1-4d25-8e79-4e2f69de2426 tempest-VolumesTransfersV357Test-1461613222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:27:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-990275fe-02e1-4d25-8e79-4e2f69de2426 tempest-VolumesTransfersV357Test-1461613222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:27:37 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-990275fe-02e1-4d25-8e79-4e2f69de2426 tempest-VolumesTransfersV357Test-1461613222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:27:37 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-990275fe-02e1-4d25-8e79-4e2f69de2426 tempest-VolumesTransfersV357Test-1461613222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:27:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-990275fe-02e1-4d25-8e79-4e2f69de2426 tempest-VolumesTransfersV357Test-1461613222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:27:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-990275fe-02e1-4d25-8e79-4e2f69de2426 tempest-VolumesTransfersV357Test-1461613222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:27:37 devstack sudo[93004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:27:37 devstack sudo[93004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:27:38 devstack sudo[93004]: pam_unix(sudo:session): session closed for user root
Jul 14 16:27:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-990275fe-02e1-4d25-8e79-4e2f69de2426 tempest-VolumesTransfersV357Test-1461613222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.802s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:27:38 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-990275fe-02e1-4d25-8e79-4e2f69de2426 tempest-VolumesTransfersV357Test-1461613222 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:27:38 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-990275fe-02e1-4d25-8e79-4e2f69de2426 tempest-VolumesTransfersV357Test-1461613222 None] Deleted volume successfully.
Jul 14 16:27:38 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-990275fe-02e1-4d25-8e79-4e2f69de2426 tempest-VolumesTransfersV357Test-1461613222 None] Lock "cinder-2203e9e2-b2e2-402a-a8e2-139bb0a9a000-delete_volume" released by "delete_volume" :: held 2.220s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:27:40 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:SELECT=53,cinder:UPDATE=71,cinder:INSERT=20,cinder:DELETE=9 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 16:27:40 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:SELECT=62,cinder:UPDATE=73,cinder:INSERT=14,cinder:DELETE=3 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 16:27:40 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ca4cd84-1319-496f-921c-0af5401d346d tempest-VolumesTransfersV357Test-1843503382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:27:40 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3ca4cd84-1319-496f-921c-0af5401d346d tempest-VolumesTransfersV357Test-1843503382 None] Flow 'volume_create_manager' (e3b8e8d2-2fe3-4511-a510-80e5c27028f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:27:40 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3ca4cd84-1319-496f-921c-0af5401d346d tempest-VolumesTransfersV357Test-1843503382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c8850e7-1855-4fe3-8eb8-f381bddaf427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:27:40 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3ca4cd84-1319-496f-921c-0af5401d346d tempest-VolumesTransfersV357Test-1843503382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c8850e7-1855-4fe3-8eb8-f381bddaf427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:27:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1014289537',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffe721a2-ae2d-4f48-806f-6bda73525809,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1010900f028645cb8ce099556fd00a1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:27:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:27:40Z,use_quota=True,user_id='69d11d9e43994ed4aaa22c12805cf4c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:27:40 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3ca4cd84-1319-496f-921c-0af5401d346d tempest-VolumesTransfersV357Test-1843503382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae1cc655-e6ab-4bfd-af63-a9591d880bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:27:40 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3ca4cd84-1319-496f-921c-0af5401d346d tempest-VolumesTransfersV357Test-1843503382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae1cc655-e6ab-4bfd-af63-a9591d880bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:27:40 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3ca4cd84-1319-496f-921c-0af5401d346d tempest-VolumesTransfersV357Test-1843503382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf1a4486-0f6d-4a9f-b750-6ab6f36b1139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:27:40 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3ca4cd84-1319-496f-921c-0af5401d346d tempest-VolumesTransfersV357Test-1843503382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf1a4486-0f6d-4a9f-b750-6ab6f36b1139) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffe721a2-ae2d-4f48-806f-6bda73525809', 'volume_name': 'volume-ffe721a2-ae2d-4f48-806f-6bda73525809', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:27:40 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3ca4cd84-1319-496f-921c-0af5401d346d tempest-VolumesTransfersV357Test-1843503382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1586598-6d82-4eb1-8999-e8f9471cb85f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:27:40 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3ca4cd84-1319-496f-921c-0af5401d346d tempest-VolumesTransfersV357Test-1843503382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1586598-6d82-4eb1-8999-e8f9471cb85f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:27:40 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3ca4cd84-1319-496f-921c-0af5401d346d tempest-VolumesTransfersV357Test-1843503382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7074a24c-276c-4fd8-a137-3d3a6d675d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:27:40 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-3ca4cd84-1319-496f-921c-0af5401d346d tempest-VolumesTransfersV357Test-1843503382 None] Volume ffe721a2-ae2d-4f48-806f-6bda73525809: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffe721a2-ae2d-4f48-806f-6bda73525809', 'volume_size': 1}
Jul 14 16:27:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3ca4cd84-1319-496f-921c-0af5401d346d tempest-VolumesTransfersV357Test-1843503382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:27:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3ca4cd84-1319-496f-921c-0af5401d346d tempest-VolumesTransfersV357Test-1843503382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:27:40 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-3ca4cd84-1319-496f-921c-0af5401d346d tempest-VolumesTransfersV357Test-1843503382 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:27:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1014289537',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffe721a2-ae2d-4f48-806f-6bda73525809,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1010900f028645cb8ce099556fd00a1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:27:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:27:40Z,use_quota=True,user_id='69d11d9e43994ed4aaa22c12805cf4c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:27:40 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-3ca4cd84-1319-496f-921c-0af5401d346d tempest-VolumesTransfersV357Test-1843503382 None] Creating volume ffe721a2-ae2d-4f48-806f-6bda73525809 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:27:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3ca4cd84-1319-496f-921c-0af5401d346d tempest-VolumesTransfersV357Test-1843503382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:27:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3ca4cd84-1319-496f-921c-0af5401d346d tempest-VolumesTransfersV357Test-1843503382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:27:40 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-3ca4cd84-1319-496f-921c-0af5401d346d tempest-VolumesTransfersV357Test-1843503382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:27:40 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-3ca4cd84-1319-496f-921c-0af5401d346d tempest-VolumesTransfersV357Test-1843503382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:27:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3ca4cd84-1319-496f-921c-0af5401d346d tempest-VolumesTransfersV357Test-1843503382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:27:40 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-3ca4cd84-1319-496f-921c-0af5401d346d tempest-VolumesTransfersV357Test-1843503382 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:27:40 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-3ca4cd84-1319-496f-921c-0af5401d346d tempest-VolumesTransfersV357Test-1843503382 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:27:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3ca4cd84-1319-496f-921c-0af5401d346d tempest-VolumesTransfersV357Test-1843503382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ffe721a2-ae2d-4f48-806f-6bda73525809 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:27:40 devstack sudo[93108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ffe721a2-ae2d-4f48-806f-6bda73525809 1073741824
Jul 14 16:27:40 devstack sudo[93108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:27:41 devstack sudo[93108]: pam_unix(sudo:session): session closed for user root
Jul 14 16:27:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3ca4cd84-1319-496f-921c-0af5401d346d tempest-VolumesTransfersV357Test-1843503382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ffe721a2-ae2d-4f48-806f-6bda73525809 1073741824" returned: 0 in 1.102s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:27:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3ca4cd84-1319-496f-921c-0af5401d346d tempest-VolumesTransfersV357Test-1843503382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ffe721a2-ae2d-4f48-806f-6bda73525809 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:27:42 devstack sudo[93115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ffe721a2-ae2d-4f48-806f-6bda73525809
Jul 14 16:27:42 devstack sudo[93115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:27:42 devstack sudo[93115]: pam_unix(sudo:session): session closed for user root
Jul 14 16:27:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3ca4cd84-1319-496f-921c-0af5401d346d tempest-VolumesTransfersV357Test-1843503382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ffe721a2-ae2d-4f48-806f-6bda73525809" returned: 0 in 0.680s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:27:42 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-3ca4cd84-1319-496f-921c-0af5401d346d tempest-VolumesTransfersV357Test-1843503382 None] <== create_volume: return (1909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:27:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3ca4cd84-1319-496f-921c-0af5401d346d tempest-VolumesTransfersV357Test-1843503382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.913s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:27:42 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3ca4cd84-1319-496f-921c-0af5401d346d tempest-VolumesTransfersV357Test-1843503382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7074a24c-276c-4fd8-a137-3d3a6d675d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffe721a2-ae2d-4f48-806f-6bda73525809', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:27:42 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3ca4cd84-1319-496f-921c-0af5401d346d tempest-VolumesTransfersV357Test-1843503382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a5cda41-def1-47c7-8be2-e7884ecb1c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:27:42 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-3ca4cd84-1319-496f-921c-0af5401d346d tempest-VolumesTransfersV357Test-1843503382 None] Volume volume-ffe721a2-ae2d-4f48-806f-6bda73525809 (ffe721a2-ae2d-4f48-806f-6bda73525809): created successfully
Jul 14 16:27:42 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3ca4cd84-1319-496f-921c-0af5401d346d tempest-VolumesTransfersV357Test-1843503382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a5cda41-def1-47c7-8be2-e7884ecb1c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:27:42 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3ca4cd84-1319-496f-921c-0af5401d346d tempest-VolumesTransfersV357Test-1843503382 None] Flow 'volume_create_manager' (e3b8e8d2-2fe3-4511-a510-80e5c27028f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:27:42 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-3ca4cd84-1319-496f-921c-0af5401d346d tempest-VolumesTransfersV357Test-1843503382 None] Created volume successfully.
Jul 14 16:27:44 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a0ef8815-7465-48bb-9a37-d6187a81db74 tempest-VolumesTransfersV357Test-1461613222 None] Acquiring lock "cinder-ffe721a2-ae2d-4f48-806f-6bda73525809-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:27:44 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a0ef8815-7465-48bb-9a37-d6187a81db74 tempest-VolumesTransfersV357Test-1461613222 None] Lock "cinder-ffe721a2-ae2d-4f48-806f-6bda73525809-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:27:44 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a0ef8815-7465-48bb-9a37-d6187a81db74 tempest-VolumesTransfersV357Test-1461613222 None] Acquiring lock "cinder-quobyte-ffe721a2-ae2d-4f48-806f-6bda73525809" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:27:44 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a0ef8815-7465-48bb-9a37-d6187a81db74 tempest-VolumesTransfersV357Test-1461613222 None] Lock "cinder-quobyte-ffe721a2-ae2d-4f48-806f-6bda73525809" acquired by "delete_volume" :: waited 0.035s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:27:44 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c1f6c5-0e60-4715-aff3-9db24576d364]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:27:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a0ef8815-7465-48bb-9a37-d6187a81db74 tempest-VolumesTransfersV357Test-1461613222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ffe721a2-ae2d-4f48-806f-6bda73525809 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:27:44 devstack sudo[93120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ffe721a2-ae2d-4f48-806f-6bda73525809
Jul 14 16:27:44 devstack sudo[93120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:27:45 devstack sudo[93120]: pam_unix(sudo:session): session closed for user root
Jul 14 16:27:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a0ef8815-7465-48bb-9a37-d6187a81db74 tempest-VolumesTransfersV357Test-1461613222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ffe721a2-ae2d-4f48-806f-6bda73525809" returned: 0 in 0.618s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:27:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a0ef8815-7465-48bb-9a37-d6187a81db74 tempest-VolumesTransfersV357Test-1461613222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ffe721a2-ae2d-4f48-806f-6bda73525809 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:27:45 devstack sudo[93126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ffe721a2-ae2d-4f48-806f-6bda73525809
Jul 14 16:27:45 devstack sudo[93126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:27:45 devstack sudo[93126]: pam_unix(sudo:session): session closed for user root
Jul 14 16:27:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a0ef8815-7465-48bb-9a37-d6187a81db74 tempest-VolumesTransfersV357Test-1461613222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ffe721a2-ae2d-4f48-806f-6bda73525809" returned: 0 in 0.456s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:27:45 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a0ef8815-7465-48bb-9a37-d6187a81db74 tempest-VolumesTransfersV357Test-1461613222 None] Lock "cinder-quobyte-ffe721a2-ae2d-4f48-806f-6bda73525809" released by "delete_volume" :: held 1.175s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:27:45 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-a0ef8815-7465-48bb-9a37-d6187a81db74 tempest-VolumesTransfersV357Test-1461613222 None] Created reservations ['9e1236d7-3a6e-45c3-9933-264342e182e4', '7f83010b-5a88-43de-a694-26028bced6f4', 'b2fad251-1f8c-4ff1-8ffb-6385dbc4cc75', '29b2c019-184a-4c28-a418-083a1c161770'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:27:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a0ef8815-7465-48bb-9a37-d6187a81db74 tempest-VolumesTransfersV357Test-1461613222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:27:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a0ef8815-7465-48bb-9a37-d6187a81db74 tempest-VolumesTransfersV357Test-1461613222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:27:46 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a0ef8815-7465-48bb-9a37-d6187a81db74 tempest-VolumesTransfersV357Test-1461613222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:27:46 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a0ef8815-7465-48bb-9a37-d6187a81db74 tempest-VolumesTransfersV357Test-1461613222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:27:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a0ef8815-7465-48bb-9a37-d6187a81db74 tempest-VolumesTransfersV357Test-1461613222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:27:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a0ef8815-7465-48bb-9a37-d6187a81db74 tempest-VolumesTransfersV357Test-1461613222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:27:46 devstack sudo[93129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:27:46 devstack sudo[93129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:27:46 devstack sudo[93129]: pam_unix(sudo:session): session closed for user root
Jul 14 16:27:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a0ef8815-7465-48bb-9a37-d6187a81db74 tempest-VolumesTransfersV357Test-1461613222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.704s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:27:46 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-a0ef8815-7465-48bb-9a37-d6187a81db74 tempest-VolumesTransfersV357Test-1461613222 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:27:46 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-a0ef8815-7465-48bb-9a37-d6187a81db74 tempest-VolumesTransfersV357Test-1461613222 None] Deleted volume successfully.
Jul 14 16:27:46 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a0ef8815-7465-48bb-9a37-d6187a81db74 tempest-VolumesTransfersV357Test-1461613222 None] Lock "cinder-ffe721a2-ae2d-4f48-806f-6bda73525809-delete_volume" released by "delete_volume" :: held 2.426s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:27:50 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-50e78afd-c5c5-4649-884b-f120c7ae6b49 tempest-GroupSnapshotsTest-1880376477 None] Group tempest-GroupSnapshotsTest-Group-1612732565: creating
Jul 14 16:27:50 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-50e78afd-c5c5-4649-884b-f120c7ae6b49 tempest-GroupSnapshotsTest-1880376477 None] Group tempest-GroupSnapshotsTest-Group-1612732565: created successfully
Jul 14 16:27:50 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-50e78afd-c5c5-4649-884b-f120c7ae6b49 tempest-GroupSnapshotsTest-1880376477 None] Create group completed successfully.
Jul 14 16:27:51 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7fbdcbb-75aa-4f14-8c96-33a23f35663c tempest-GroupSnapshotsTest-1880376477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:27:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f7fbdcbb-75aa-4f14-8c96-33a23f35663c tempest-GroupSnapshotsTest-1880376477 None] Flow 'volume_create_manager' (ff7c646f-4e90-465d-8b21-caf7b381e248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:27:52 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f7fbdcbb-75aa-4f14-8c96-33a23f35663c tempest-GroupSnapshotsTest-1880376477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (778808a6-2479-4fd7-8915-4a26c1ad4e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:27:52 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f7fbdcbb-75aa-4f14-8c96-33a23f35663c tempest-GroupSnapshotsTest-1880376477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (778808a6-2479-4fd7-8915-4a26c1ad4e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:27:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-854983533',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=3b2cb7d2-162d-49dd-97d3-400f1a592b73,host='devstack@QuobyteHD#QuobyteHD',id=2f257612-dc56-4a89-af48-a89112430d72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbdc2b87a94f462c9c15afe22ca87a42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:27:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:27:52Z,use_quota=True,user_id='c4899276ef4a456b979726b690a13ca1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8311f7ce-ce6f-42bd-a720-a3c77f9410c3),volume_type_id=8311f7ce-ce6f-42bd-a720-a3c77f9410c3)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:27:52 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f7fbdcbb-75aa-4f14-8c96-33a23f35663c tempest-GroupSnapshotsTest-1880376477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7374dd06-0999-4429-9205-442039f03214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:27:52 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f7fbdcbb-75aa-4f14-8c96-33a23f35663c tempest-GroupSnapshotsTest-1880376477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7374dd06-0999-4429-9205-442039f03214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:27:52 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f7fbdcbb-75aa-4f14-8c96-33a23f35663c tempest-GroupSnapshotsTest-1880376477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b20b899f-6980-43d9-bbc2-faecd34c4fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:27:52 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f7fbdcbb-75aa-4f14-8c96-33a23f35663c tempest-GroupSnapshotsTest-1880376477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b20b899f-6980-43d9-bbc2-faecd34c4fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f257612-dc56-4a89-af48-a89112430d72', 'volume_name': 'volume-2f257612-dc56-4a89-af48-a89112430d72', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:27:52 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f7fbdcbb-75aa-4f14-8c96-33a23f35663c tempest-GroupSnapshotsTest-1880376477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d25421e-2456-461d-bb88-420902e95181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:27:52 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f7fbdcbb-75aa-4f14-8c96-33a23f35663c tempest-GroupSnapshotsTest-1880376477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d25421e-2456-461d-bb88-420902e95181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:27:52 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f7fbdcbb-75aa-4f14-8c96-33a23f35663c tempest-GroupSnapshotsTest-1880376477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0bc4809-6e05-4dce-aea6-4732c970a1d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:27:52 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-f7fbdcbb-75aa-4f14-8c96-33a23f35663c tempest-GroupSnapshotsTest-1880376477 None] Volume 2f257612-dc56-4a89-af48-a89112430d72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f257612-dc56-4a89-af48-a89112430d72', 'volume_size': 1}
Jul 14 16:27:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f7fbdcbb-75aa-4f14-8c96-33a23f35663c tempest-GroupSnapshotsTest-1880376477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:27:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f7fbdcbb-75aa-4f14-8c96-33a23f35663c tempest-GroupSnapshotsTest-1880376477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:27:52 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f7fbdcbb-75aa-4f14-8c96-33a23f35663c tempest-GroupSnapshotsTest-1880376477 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=3b2cb7d2-162d-49dd-97d3-400f1a592b73,created_at=2026-07-14T14:27:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-854983533',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=3b2cb7d2-162d-49dd-97d3-400f1a592b73,host='devstack@QuobyteHD#QuobyteHD',id=2f257612-dc56-4a89-af48-a89112430d72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbdc2b87a94f462c9c15afe22ca87a42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:27:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:27:52Z,use_quota=True,user_id='c4899276ef4a456b979726b690a13ca1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8311f7ce-ce6f-42bd-a720-a3c77f9410c3),volume_type_id=8311f7ce-ce6f-42bd-a720-a3c77f9410c3)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:27:52 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-f7fbdcbb-75aa-4f14-8c96-33a23f35663c tempest-GroupSnapshotsTest-1880376477 None] Creating volume 2f257612-dc56-4a89-af48-a89112430d72 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:27:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f7fbdcbb-75aa-4f14-8c96-33a23f35663c tempest-GroupSnapshotsTest-1880376477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:27:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f7fbdcbb-75aa-4f14-8c96-33a23f35663c tempest-GroupSnapshotsTest-1880376477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:27:52 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f7fbdcbb-75aa-4f14-8c96-33a23f35663c tempest-GroupSnapshotsTest-1880376477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:27:52 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f7fbdcbb-75aa-4f14-8c96-33a23f35663c tempest-GroupSnapshotsTest-1880376477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:27:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f7fbdcbb-75aa-4f14-8c96-33a23f35663c tempest-GroupSnapshotsTest-1880376477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:27:52 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f7fbdcbb-75aa-4f14-8c96-33a23f35663c tempest-GroupSnapshotsTest-1880376477 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:27:52 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-f7fbdcbb-75aa-4f14-8c96-33a23f35663c tempest-GroupSnapshotsTest-1880376477 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:27:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f7fbdcbb-75aa-4f14-8c96-33a23f35663c tempest-GroupSnapshotsTest-1880376477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2f257612-dc56-4a89-af48-a89112430d72 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:27:52 devstack sudo[93135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2f257612-dc56-4a89-af48-a89112430d72 1073741824
Jul 14 16:27:52 devstack sudo[93135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:27:52 devstack sudo[93135]: pam_unix(sudo:session): session closed for user root
Jul 14 16:27:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f7fbdcbb-75aa-4f14-8c96-33a23f35663c tempest-GroupSnapshotsTest-1880376477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2f257612-dc56-4a89-af48-a89112430d72 1073741824" returned: 0 in 0.599s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:27:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f7fbdcbb-75aa-4f14-8c96-33a23f35663c tempest-GroupSnapshotsTest-1880376477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2f257612-dc56-4a89-af48-a89112430d72 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:27:52 devstack sudo[93141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2f257612-dc56-4a89-af48-a89112430d72
Jul 14 16:27:52 devstack sudo[93141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:27:53 devstack sudo[93141]: pam_unix(sudo:session): session closed for user root
Jul 14 16:27:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f7fbdcbb-75aa-4f14-8c96-33a23f35663c tempest-GroupSnapshotsTest-1880376477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2f257612-dc56-4a89-af48-a89112430d72" returned: 0 in 0.301s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:27:53 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f7fbdcbb-75aa-4f14-8c96-33a23f35663c tempest-GroupSnapshotsTest-1880376477 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:27:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f7fbdcbb-75aa-4f14-8c96-33a23f35663c tempest-GroupSnapshotsTest-1880376477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:27:53 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f7fbdcbb-75aa-4f14-8c96-33a23f35663c tempest-GroupSnapshotsTest-1880376477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0bc4809-6e05-4dce-aea6-4732c970a1d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f257612-dc56-4a89-af48-a89112430d72', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:27:53 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f7fbdcbb-75aa-4f14-8c96-33a23f35663c tempest-GroupSnapshotsTest-1880376477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9078aa4c-0ade-48ca-a78f-bcff59cddef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:27:53 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-f7fbdcbb-75aa-4f14-8c96-33a23f35663c tempest-GroupSnapshotsTest-1880376477 None] Volume volume-2f257612-dc56-4a89-af48-a89112430d72 (2f257612-dc56-4a89-af48-a89112430d72): created successfully
Jul 14 16:27:53 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f7fbdcbb-75aa-4f14-8c96-33a23f35663c tempest-GroupSnapshotsTest-1880376477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9078aa4c-0ade-48ca-a78f-bcff59cddef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:27:53 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f7fbdcbb-75aa-4f14-8c96-33a23f35663c tempest-GroupSnapshotsTest-1880376477 None] Flow 'volume_create_manager' (ff7c646f-4e90-465d-8b21-caf7b381e248) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:27:53 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-f7fbdcbb-75aa-4f14-8c96-33a23f35663c tempest-GroupSnapshotsTest-1880376477 None] Created volume successfully.
Jul 14 16:27:54 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-70902b76-a7be-4b59-a6ff-fc2b119931a5 tempest-VolumesCloneTest-1876138912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:27:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-70902b76-a7be-4b59-a6ff-fc2b119931a5 tempest-VolumesCloneTest-1876138912 None] Flow 'volume_create_manager' (5dfb2ebe-a6c2-4d5b-92e2-cdeb69a3a6f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:27:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-70902b76-a7be-4b59-a6ff-fc2b119931a5 tempest-VolumesCloneTest-1876138912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b9c7461-dc22-4e10-a343-73e98e811932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:27:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-70902b76-a7be-4b59-a6ff-fc2b119931a5 tempest-VolumesCloneTest-1876138912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b9c7461-dc22-4e10-a343-73e98e811932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:27:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-958688948',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf2c446c-266a-4e9b-b642-b0ca7e4f6921,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ed94e1935574db39c4dcd9c7c900de0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:27:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:27:55Z,use_quota=True,user_id='e3c8d1d85b1e4d3b9f7121d1f4b399b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:27:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-70902b76-a7be-4b59-a6ff-fc2b119931a5 tempest-VolumesCloneTest-1876138912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (384a28ed-2f43-40ae-9eb4-566b2ec813a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:27:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-70902b76-a7be-4b59-a6ff-fc2b119931a5 tempest-VolumesCloneTest-1876138912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (384a28ed-2f43-40ae-9eb4-566b2ec813a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:27:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-70902b76-a7be-4b59-a6ff-fc2b119931a5 tempest-VolumesCloneTest-1876138912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2be6b6c5-043e-4483-9f09-0709d8c01377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:27:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-70902b76-a7be-4b59-a6ff-fc2b119931a5 tempest-VolumesCloneTest-1876138912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2be6b6c5-043e-4483-9f09-0709d8c01377) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf2c446c-266a-4e9b-b642-b0ca7e4f6921', 'volume_name': 'volume-cf2c446c-266a-4e9b-b642-b0ca7e4f6921', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:27:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-70902b76-a7be-4b59-a6ff-fc2b119931a5 tempest-VolumesCloneTest-1876138912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0272dc7-2cd8-4e1b-9c76-23315e1a0259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:27:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-70902b76-a7be-4b59-a6ff-fc2b119931a5 tempest-VolumesCloneTest-1876138912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0272dc7-2cd8-4e1b-9c76-23315e1a0259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:27:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-70902b76-a7be-4b59-a6ff-fc2b119931a5 tempest-VolumesCloneTest-1876138912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3532991f-113f-4c30-b2dc-87ae48a568d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:27:54 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-70902b76-a7be-4b59-a6ff-fc2b119931a5 tempest-VolumesCloneTest-1876138912 None] Volume cf2c446c-266a-4e9b-b642-b0ca7e4f6921: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf2c446c-266a-4e9b-b642-b0ca7e4f6921', 'volume_size': 1}
Jul 14 16:27:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-70902b76-a7be-4b59-a6ff-fc2b119931a5 tempest-VolumesCloneTest-1876138912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:27:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-70902b76-a7be-4b59-a6ff-fc2b119931a5 tempest-VolumesCloneTest-1876138912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:27:54 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-70902b76-a7be-4b59-a6ff-fc2b119931a5 tempest-VolumesCloneTest-1876138912 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:27:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-958688948',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf2c446c-266a-4e9b-b642-b0ca7e4f6921,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ed94e1935574db39c4dcd9c7c900de0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:27:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:27:55Z,use_quota=True,user_id='e3c8d1d85b1e4d3b9f7121d1f4b399b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:27:54 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-70902b76-a7be-4b59-a6ff-fc2b119931a5 tempest-VolumesCloneTest-1876138912 None] Creating volume cf2c446c-266a-4e9b-b642-b0ca7e4f6921 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:27:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-70902b76-a7be-4b59-a6ff-fc2b119931a5 tempest-VolumesCloneTest-1876138912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:27:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-70902b76-a7be-4b59-a6ff-fc2b119931a5 tempest-VolumesCloneTest-1876138912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:27:54 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-70902b76-a7be-4b59-a6ff-fc2b119931a5 tempest-VolumesCloneTest-1876138912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:27:54 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-70902b76-a7be-4b59-a6ff-fc2b119931a5 tempest-VolumesCloneTest-1876138912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:27:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-70902b76-a7be-4b59-a6ff-fc2b119931a5 tempest-VolumesCloneTest-1876138912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:27:54 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-70902b76-a7be-4b59-a6ff-fc2b119931a5 tempest-VolumesCloneTest-1876138912 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:27:54 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-70902b76-a7be-4b59-a6ff-fc2b119931a5 tempest-VolumesCloneTest-1876138912 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:27:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-70902b76-a7be-4b59-a6ff-fc2b119931a5 tempest-VolumesCloneTest-1876138912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cf2c446c-266a-4e9b-b642-b0ca7e4f6921 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:27:54 devstack sudo[93156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cf2c446c-266a-4e9b-b642-b0ca7e4f6921 1073741824
Jul 14 16:27:54 devstack sudo[93156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:27:55 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-de8bf1b0-5e72-4077-9a92-5c1233726e40 tempest-GroupSnapshotsTest-1880376477 None] GroupSnapshot a6283812-e705-4140-9521-725516120dde: creating.
Jul 14 16:27:55 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-de8bf1b0-5e72-4077-9a92-5c1233726e40 tempest-GroupSnapshotsTest-1880376477 None] Group snapshot a6283812-e705-4140-9521-725516120dde: creating. {{(pid=87166) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 14 16:27:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-de8bf1b0-5e72-4077-9a92-5c1233726e40 tempest-GroupSnapshotsTest-1880376477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:27:55 devstack sudo[93156]: pam_unix(sudo:session): session closed for user root
Jul 14 16:27:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-70902b76-a7be-4b59-a6ff-fc2b119931a5 tempest-VolumesCloneTest-1876138912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cf2c446c-266a-4e9b-b642-b0ca7e4f6921 1073741824" returned: 0 in 0.777s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:27:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-70902b76-a7be-4b59-a6ff-fc2b119931a5 tempest-VolumesCloneTest-1876138912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cf2c446c-266a-4e9b-b642-b0ca7e4f6921 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:27:55 devstack sudo[93204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cf2c446c-266a-4e9b-b642-b0ca7e4f6921
Jul 14 16:27:55 devstack sudo[93204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:27:55 devstack sudo[93204]: pam_unix(sudo:session): session closed for user root
Jul 14 16:27:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-70902b76-a7be-4b59-a6ff-fc2b119931a5 tempest-VolumesCloneTest-1876138912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cf2c446c-266a-4e9b-b642-b0ca7e4f6921" returned: 0 in 0.312s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:27:56 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-70902b76-a7be-4b59-a6ff-fc2b119931a5 tempest-VolumesCloneTest-1876138912 None] <== create_volume: return (1143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:27:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-70902b76-a7be-4b59-a6ff-fc2b119931a5 tempest-VolumesCloneTest-1876138912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.147s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:27:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-de8bf1b0-5e72-4077-9a92-5c1233726e40 tempest-GroupSnapshotsTest-1880376477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.622s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:27:56 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-70902b76-a7be-4b59-a6ff-fc2b119931a5 tempest-VolumesCloneTest-1876138912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3532991f-113f-4c30-b2dc-87ae48a568d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf2c446c-266a-4e9b-b642-b0ca7e4f6921', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:27:56 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-70902b76-a7be-4b59-a6ff-fc2b119931a5 tempest-VolumesCloneTest-1876138912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb2c433b-38c0-42cf-b0b3-d833d3a41445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:27:56 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-de8bf1b0-5e72-4077-9a92-5c1233726e40 tempest-GroupSnapshotsTest-1880376477 None] Creating offline snapshot 123f15b4-c97e-4684-a256-9b2c99c45e31 of volume 2f257612-dc56-4a89-af48-a89112430d72 {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 16:27:56 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-70902b76-a7be-4b59-a6ff-fc2b119931a5 tempest-VolumesCloneTest-1876138912 None] Volume volume-cf2c446c-266a-4e9b-b642-b0ca7e4f6921 (cf2c446c-266a-4e9b-b642-b0ca7e4f6921): created successfully
Jul 14 16:27:56 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-70902b76-a7be-4b59-a6ff-fc2b119931a5 tempest-VolumesCloneTest-1876138912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb2c433b-38c0-42cf-b0b3-d833d3a41445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:27:56 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-70902b76-a7be-4b59-a6ff-fc2b119931a5 tempest-VolumesCloneTest-1876138912 None] Flow 'volume_create_manager' (5dfb2ebe-a6c2-4d5b-92e2-cdeb69a3a6f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:27:56 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52218af-95b7-4a10-9ca7-9f18342b90d5]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:27:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-de8bf1b0-5e72-4077-9a92-5c1233726e40 tempest-GroupSnapshotsTest-1880376477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2f257612-dc56-4a89-af48-a89112430d72 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:27:56 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-70902b76-a7be-4b59-a6ff-fc2b119931a5 tempest-VolumesCloneTest-1876138912 None] Created volume successfully.
Jul 14 16:27:56 devstack sudo[93208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2f257612-dc56-4a89-af48-a89112430d72
Jul 14 16:27:56 devstack sudo[93208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:27:56 devstack sudo[93208]: pam_unix(sudo:session): session closed for user root
Jul 14 16:27:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-de8bf1b0-5e72-4077-9a92-5c1233726e40 tempest-GroupSnapshotsTest-1880376477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2f257612-dc56-4a89-af48-a89112430d72" returned: 0 in 0.387s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:27:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-de8bf1b0-5e72-4077-9a92-5c1233726e40 tempest-GroupSnapshotsTest-1880376477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2f257612-dc56-4a89-af48-a89112430d72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2f257612-dc56-4a89-af48-a89112430d72.123f15b4-c97e-4684-a256-9b2c99c45e31 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:27:56 devstack sudo[93229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2f257612-dc56-4a89-af48-a89112430d72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2f257612-dc56-4a89-af48-a89112430d72.123f15b4-c97e-4684-a256-9b2c99c45e31 1G
Jul 14 16:27:56 devstack sudo[93229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:27:56 devstack sudo[93229]: pam_unix(sudo:session): session closed for user root
Jul 14 16:27:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-de8bf1b0-5e72-4077-9a92-5c1233726e40 tempest-GroupSnapshotsTest-1880376477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2f257612-dc56-4a89-af48-a89112430d72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2f257612-dc56-4a89-af48-a89112430d72.123f15b4-c97e-4684-a256-9b2c99c45e31 1G" returned: 0 in 0.412s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:27:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-de8bf1b0-5e72-4077-9a92-5c1233726e40 tempest-GroupSnapshotsTest-1880376477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f257612-dc56-4a89-af48-a89112430d72 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2f257612-dc56-4a89-af48-a89112430d72.123f15b4-c97e-4684-a256-9b2c99c45e31 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:27:56 devstack sudo[93235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f257612-dc56-4a89-af48-a89112430d72 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2f257612-dc56-4a89-af48-a89112430d72.123f15b4-c97e-4684-a256-9b2c99c45e31
Jul 14 16:27:56 devstack sudo[93235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:27:57 devstack sudo[93235]: pam_unix(sudo:session): session closed for user root
Jul 14 16:27:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-de8bf1b0-5e72-4077-9a92-5c1233726e40 tempest-GroupSnapshotsTest-1880376477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f257612-dc56-4a89-af48-a89112430d72 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2f257612-dc56-4a89-af48-a89112430d72.123f15b4-c97e-4684-a256-9b2c99c45e31" returned: 0 in 0.293s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:27:57 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-de8bf1b0-5e72-4077-9a92-5c1233726e40 tempest-GroupSnapshotsTest-1880376477 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2f257612-dc56-4a89-af48-a89112430d72.123f15b4-c97e-4684-a256-9b2c99c45e31 is being set with open permissions: ugo+rw: NotImplementedError
Jul 14 16:27:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-de8bf1b0-5e72-4077-9a92-5c1233726e40 tempest-GroupSnapshotsTest-1880376477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2f257612-dc56-4a89-af48-a89112430d72.123f15b4-c97e-4684-a256-9b2c99c45e31 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:27:57 devstack sudo[93240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2f257612-dc56-4a89-af48-a89112430d72.123f15b4-c97e-4684-a256-9b2c99c45e31
Jul 14 16:27:57 devstack sudo[93240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:27:57 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-6da7ff2d-7fbd-45ad-8a02-ad466eade2f4 tempest-VolumesCloneTest-1876138912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:27:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6da7ff2d-7fbd-45ad-8a02-ad466eade2f4 tempest-VolumesCloneTest-1876138912 None] Flow 'volume_create_manager' (d6dae03e-523a-435b-88ee-c3a1868a752f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:27:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6da7ff2d-7fbd-45ad-8a02-ad466eade2f4 tempest-VolumesCloneTest-1876138912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fcb8b91-106a-499e-bb8d-0050b28696e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:27:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6da7ff2d-7fbd-45ad-8a02-ad466eade2f4 tempest-VolumesCloneTest-1876138912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fcb8b91-106a-499e-bb8d-0050b28696e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:27:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1326342659',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c40bd0b7-c1ac-4438-8095-833b74028757,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ed94e1935574db39c4dcd9c7c900de0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:27:57Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=cf2c446c-266a-4e9b-b642-b0ca7e4f6921,status='creating',terminated_at=None,updated_at=2026-07-14T14:27:57Z,use_quota=True,user_id='e3c8d1d85b1e4d3b9f7121d1f4b399b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:27:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6da7ff2d-7fbd-45ad-8a02-ad466eade2f4 tempest-VolumesCloneTest-1876138912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f0c5f49-5c0e-4547-a582-079c2c59330b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:27:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6da7ff2d-7fbd-45ad-8a02-ad466eade2f4 tempest-VolumesCloneTest-1876138912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f0c5f49-5c0e-4547-a582-079c2c59330b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:27:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6da7ff2d-7fbd-45ad-8a02-ad466eade2f4 tempest-VolumesCloneTest-1876138912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18214e1f-4353-4466-a8ca-28df9ea34edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:27:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6da7ff2d-7fbd-45ad-8a02-ad466eade2f4 tempest-VolumesCloneTest-1876138912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18214e1f-4353-4466-a8ca-28df9ea34edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'c40bd0b7-c1ac-4438-8095-833b74028757', 'volume_name': 'volume-c40bd0b7-c1ac-4438-8095-833b74028757', 'volume_size': 2, 'source_volid': 'cf2c446c-266a-4e9b-b642-b0ca7e4f6921', 'source_volstatus': 'available'}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:27:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6da7ff2d-7fbd-45ad-8a02-ad466eade2f4 tempest-VolumesCloneTest-1876138912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f11289bc-080b-4380-8eef-513961da279f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:27:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6da7ff2d-7fbd-45ad-8a02-ad466eade2f4 tempest-VolumesCloneTest-1876138912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f11289bc-080b-4380-8eef-513961da279f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:27:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6da7ff2d-7fbd-45ad-8a02-ad466eade2f4 tempest-VolumesCloneTest-1876138912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57a838ce-58c5-4c39-8d22-efddd7d29728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:27:57 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-6da7ff2d-7fbd-45ad-8a02-ad466eade2f4 tempest-VolumesCloneTest-1876138912 None] Volume c40bd0b7-c1ac-4438-8095-833b74028757: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-c40bd0b7-c1ac-4438-8095-833b74028757', 'volume_size': 2, 'source_volid': 'cf2c446c-266a-4e9b-b642-b0ca7e4f6921', 'source_volstatus': 'available'}
Jul 14 16:27:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6da7ff2d-7fbd-45ad-8a02-ad466eade2f4 tempest-VolumesCloneTest-1876138912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:27:57 devstack sudo[93240]: pam_unix(sudo:session): session closed for user root
Jul 14 16:27:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-de8bf1b0-5e72-4077-9a92-5c1233726e40 tempest-GroupSnapshotsTest-1880376477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2f257612-dc56-4a89-af48-a89112430d72.123f15b4-c97e-4684-a256-9b2c99c45e31" returned: 0 in 0.241s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:27:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-de8bf1b0-5e72-4077-9a92-5c1233726e40 tempest-GroupSnapshotsTest-1880376477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2f257612-dc56-4a89-af48-a89112430d72.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:27:57 devstack sudo[93243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2f257612-dc56-4a89-af48-a89112430d72.info
Jul 14 16:27:57 devstack sudo[93243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:27:57 devstack sudo[93243]: pam_unix(sudo:session): session closed for user root
Jul 14 16:27:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-de8bf1b0-5e72-4077-9a92-5c1233726e40 tempest-GroupSnapshotsTest-1880376477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2f257612-dc56-4a89-af48-a89112430d72.info" returned: 0 in 0.237s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:27:57 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-de8bf1b0-5e72-4077-9a92-5c1233726e40 tempest-GroupSnapshotsTest-1880376477 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2f257612-dc56-4a89-af48-a89112430d72.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 14 16:27:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-de8bf1b0-5e72-4077-9a92-5c1233726e40 tempest-GroupSnapshotsTest-1880376477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2f257612-dc56-4a89-af48-a89112430d72.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:27:57 devstack sudo[93246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2f257612-dc56-4a89-af48-a89112430d72.info
Jul 14 16:27:57 devstack sudo[93246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:27:57 devstack sudo[93246]: pam_unix(sudo:session): session closed for user root
Jul 14 16:27:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-de8bf1b0-5e72-4077-9a92-5c1233726e40 tempest-GroupSnapshotsTest-1880376477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2f257612-dc56-4a89-af48-a89112430d72.info" returned: 0 in 0.230s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:27:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-de8bf1b0-5e72-4077-9a92-5c1233726e40 tempest-GroupSnapshotsTest-1880376477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.909s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:27:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6da7ff2d-7fbd-45ad-8a02-ad466eade2f4 tempest-VolumesCloneTest-1876138912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.543s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:27:57 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-6da7ff2d-7fbd-45ad-8a02-ad466eade2f4 tempest-VolumesCloneTest-1876138912 None] Cloning volume cf2c446c-266a-4e9b-b642-b0ca7e4f6921 to volume c40bd0b7-c1ac-4438-8095-833b74028757
Jul 14 16:27:57 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-6da7ff2d-7fbd-45ad-8a02-ad466eade2f4 tempest-VolumesCloneTest-1876138912 None] Creating offline snapshot 9b3238a8-87ab-483b-a5c7-868a9e7de813 of volume cf2c446c-266a-4e9b-b642-b0ca7e4f6921 {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 16:27:57 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f988217-4a0c-496c-bd31-a66b78dd3f53]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:27:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6da7ff2d-7fbd-45ad-8a02-ad466eade2f4 tempest-VolumesCloneTest-1876138912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cf2c446c-266a-4e9b-b642-b0ca7e4f6921 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:27:58 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-de8bf1b0-5e72-4077-9a92-5c1233726e40 tempest-GroupSnapshotsTest-1880376477 None] group_snapshot a6283812-e705-4140-9521-725516120dde: created successfully
Jul 14 16:27:58 devstack sudo[93249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cf2c446c-266a-4e9b-b642-b0ca7e4f6921
Jul 14 16:27:58 devstack sudo[93249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:27:58 devstack sudo[93249]: pam_unix(sudo:session): session closed for user root
Jul 14 16:27:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6da7ff2d-7fbd-45ad-8a02-ad466eade2f4 tempest-VolumesCloneTest-1876138912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cf2c446c-266a-4e9b-b642-b0ca7e4f6921" returned: 0 in 0.342s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:27:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6da7ff2d-7fbd-45ad-8a02-ad466eade2f4 tempest-VolumesCloneTest-1876138912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cf2c446c-266a-4e9b-b642-b0ca7e4f6921,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cf2c446c-266a-4e9b-b642-b0ca7e4f6921.9b3238a8-87ab-483b-a5c7-868a9e7de813 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:27:58 devstack sudo[93288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cf2c446c-266a-4e9b-b642-b0ca7e4f6921,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cf2c446c-266a-4e9b-b642-b0ca7e4f6921.9b3238a8-87ab-483b-a5c7-868a9e7de813 1G
Jul 14 16:27:58 devstack sudo[93288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:27:58 devstack sudo[93288]: pam_unix(sudo:session): session closed for user root
Jul 14 16:27:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6da7ff2d-7fbd-45ad-8a02-ad466eade2f4 tempest-VolumesCloneTest-1876138912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cf2c446c-266a-4e9b-b642-b0ca7e4f6921,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cf2c446c-266a-4e9b-b642-b0ca7e4f6921.9b3238a8-87ab-483b-a5c7-868a9e7de813 1G" returned: 0 in 0.416s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:27:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6da7ff2d-7fbd-45ad-8a02-ad466eade2f4 tempest-VolumesCloneTest-1876138912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf2c446c-266a-4e9b-b642-b0ca7e4f6921 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cf2c446c-266a-4e9b-b642-b0ca7e4f6921.9b3238a8-87ab-483b-a5c7-868a9e7de813 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:27:58 devstack sudo[93295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf2c446c-266a-4e9b-b642-b0ca7e4f6921 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cf2c446c-266a-4e9b-b642-b0ca7e4f6921.9b3238a8-87ab-483b-a5c7-868a9e7de813
Jul 14 16:27:58 devstack sudo[93295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:27:59 devstack sudo[93295]: pam_unix(sudo:session): session closed for user root
Jul 14 16:27:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6da7ff2d-7fbd-45ad-8a02-ad466eade2f4 tempest-VolumesCloneTest-1876138912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf2c446c-266a-4e9b-b642-b0ca7e4f6921 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cf2c446c-266a-4e9b-b642-b0ca7e4f6921.9b3238a8-87ab-483b-a5c7-868a9e7de813" returned: 0 in 0.274s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:27:59 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-6da7ff2d-7fbd-45ad-8a02-ad466eade2f4 tempest-VolumesCloneTest-1876138912 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cf2c446c-266a-4e9b-b642-b0ca7e4f6921.9b3238a8-87ab-483b-a5c7-868a9e7de813 is being set with open permissions: ugo+rw
Jul 14 16:27:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6da7ff2d-7fbd-45ad-8a02-ad466eade2f4 tempest-VolumesCloneTest-1876138912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cf2c446c-266a-4e9b-b642-b0ca7e4f6921.9b3238a8-87ab-483b-a5c7-868a9e7de813 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:27:59 devstack sudo[93301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cf2c446c-266a-4e9b-b642-b0ca7e4f6921.9b3238a8-87ab-483b-a5c7-868a9e7de813
Jul 14 16:27:59 devstack sudo[93301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:27:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-96836f45-9cbe-4835-8472-d1221bbcd662 tempest-GroupSnapshotsTest-1880376477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:27:59 devstack sudo[93301]: pam_unix(sudo:session): session closed for user root
Jul 14 16:27:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6da7ff2d-7fbd-45ad-8a02-ad466eade2f4 tempest-VolumesCloneTest-1876138912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cf2c446c-266a-4e9b-b642-b0ca7e4f6921.9b3238a8-87ab-483b-a5c7-868a9e7de813" returned: 0 in 0.247s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:27:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6da7ff2d-7fbd-45ad-8a02-ad466eade2f4 tempest-VolumesCloneTest-1876138912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cf2c446c-266a-4e9b-b642-b0ca7e4f6921.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:27:59 devstack sudo[93304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cf2c446c-266a-4e9b-b642-b0ca7e4f6921.info
Jul 14 16:27:59 devstack sudo[93304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:27:59 devstack sudo[93304]: pam_unix(sudo:session): session closed for user root
Jul 14 16:27:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6da7ff2d-7fbd-45ad-8a02-ad466eade2f4 tempest-VolumesCloneTest-1876138912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cf2c446c-266a-4e9b-b642-b0ca7e4f6921.info" returned: 0 in 0.274s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:27:59 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-6da7ff2d-7fbd-45ad-8a02-ad466eade2f4 tempest-VolumesCloneTest-1876138912 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cf2c446c-266a-4e9b-b642-b0ca7e4f6921.info is being set with open permissions: ugo+rw
Jul 14 16:27:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6da7ff2d-7fbd-45ad-8a02-ad466eade2f4 tempest-VolumesCloneTest-1876138912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cf2c446c-266a-4e9b-b642-b0ca7e4f6921.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:27:59 devstack sudo[93307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cf2c446c-266a-4e9b-b642-b0ca7e4f6921.info
Jul 14 16:27:59 devstack sudo[93307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:27:59 devstack sudo[93307]: pam_unix(sudo:session): session closed for user root
Jul 14 16:27:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6da7ff2d-7fbd-45ad-8a02-ad466eade2f4 tempest-VolumesCloneTest-1876138912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cf2c446c-266a-4e9b-b642-b0ca7e4f6921.info" returned: 0 in 0.254s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:27:59 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6da7ff2d-7fbd-45ad-8a02-ad466eade2f4 tempest-VolumesCloneTest-1876138912 None] Acquiring lock "cinder-quobyte-c40bd0b7-c1ac-4438-8095-833b74028757" by "_copy_volume_from_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:27:59 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6da7ff2d-7fbd-45ad-8a02-ad466eade2f4 tempest-VolumesCloneTest-1876138912 None] Lock "cinder-quobyte-c40bd0b7-c1ac-4438-8095-833b74028757" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:27:59 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6da7ff2d-7fbd-45ad-8a02-ad466eade2f4 tempest-VolumesCloneTest-1876138912 None] snapshot: 9b3238a8-87ab-483b-a5c7-868a9e7de813, volume: c40bd0b7-c1ac-4438-8095-833b74028757,  {{(pid=87166) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 14 16:27:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6da7ff2d-7fbd-45ad-8a02-ad466eade2f4 tempest-VolumesCloneTest-1876138912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:27:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6da7ff2d-7fbd-45ad-8a02-ad466eade2f4 tempest-VolumesCloneTest-1876138912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:27:59 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6da7ff2d-7fbd-45ad-8a02-ad466eade2f4 tempest-VolumesCloneTest-1876138912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:27:59 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6da7ff2d-7fbd-45ad-8a02-ad466eade2f4 tempest-VolumesCloneTest-1876138912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:27:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6da7ff2d-7fbd-45ad-8a02-ad466eade2f4 tempest-VolumesCloneTest-1876138912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:27:59 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a30a1dc-27ae-400a-a982-4581f633e6e9]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:27:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6da7ff2d-7fbd-45ad-8a02-ad466eade2f4 tempest-VolumesCloneTest-1876138912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cf2c446c-266a-4e9b-b642-b0ca7e4f6921.9b3238a8-87ab-483b-a5c7-868a9e7de813 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:27:59 devstack sudo[93310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cf2c446c-266a-4e9b-b642-b0ca7e4f6921.9b3238a8-87ab-483b-a5c7-868a9e7de813
Jul 14 16:27:59 devstack sudo[93310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:00 devstack sudo[93310]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6da7ff2d-7fbd-45ad-8a02-ad466eade2f4 tempest-VolumesCloneTest-1876138912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cf2c446c-266a-4e9b-b642-b0ca7e4f6921.9b3238a8-87ab-483b-a5c7-868a9e7de813" returned: 0 in 0.342s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:00 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-6da7ff2d-7fbd-45ad-8a02-ad466eade2f4 tempest-VolumesCloneTest-1876138912 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf2c446c-266a-4e9b-b642-b0ca7e4f6921(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 16:28:00 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6da7ff2d-7fbd-45ad-8a02-ad466eade2f4 tempest-VolumesCloneTest-1876138912 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cf2c446c-266a-4e9b-b642-b0ca7e4f6921 {{(pid=87166) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 14 16:28:00 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6da7ff2d-7fbd-45ad-8a02-ad466eade2f4 tempest-VolumesCloneTest-1876138912 None] Creating direct copy from snapshot {{(pid=87166) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 14 16:28:00 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[c98f5d80-2088-4f13-a913-e6c56041eb25]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:28:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6da7ff2d-7fbd-45ad-8a02-ad466eade2f4 tempest-VolumesCloneTest-1876138912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cf2c446c-266a-4e9b-b642-b0ca7e4f6921 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:00 devstack sudo[93315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cf2c446c-266a-4e9b-b642-b0ca7e4f6921
Jul 14 16:28:00 devstack sudo[93315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:00 devstack sudo[93315]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6da7ff2d-7fbd-45ad-8a02-ad466eade2f4 tempest-VolumesCloneTest-1876138912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cf2c446c-266a-4e9b-b642-b0ca7e4f6921" returned: 0 in 0.359s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:00 devstack cinder-volume[87166]: DEBUG cinder.utils [None req-6da7ff2d-7fbd-45ad-8a02-ad466eade2f4 tempest-VolumesCloneTest-1876138912 None] Path /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c40bd0b7-c1ac-4438-8095-833b74028757 not found in is_blk_device check {{(pid=87166) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 14 16:28:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6da7ff2d-7fbd-45ad-8a02-ad466eade2f4 tempest-VolumesCloneTest-1876138912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cf2c446c-266a-4e9b-b642-b0ca7e4f6921 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c40bd0b7-c1ac-4438-8095-833b74028757 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:00 devstack sudo[93320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cf2c446c-266a-4e9b-b642-b0ca7e4f6921 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c40bd0b7-c1ac-4438-8095-833b74028757
Jul 14 16:28:00 devstack sudo[93320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:06 devstack sudo[93320]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6da7ff2d-7fbd-45ad-8a02-ad466eade2f4 tempest-VolumesCloneTest-1876138912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cf2c446c-266a-4e9b-b642-b0ca7e4f6921 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c40bd0b7-c1ac-4438-8095-833b74028757" returned: 0 in 5.755s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:06 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab6a17e-b059-40fb-97db-30d2812d8433]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:28:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6da7ff2d-7fbd-45ad-8a02-ad466eade2f4 tempest-VolumesCloneTest-1876138912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cf2c446c-266a-4e9b-b642-b0ca7e4f6921 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:06 devstack sudo[93367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cf2c446c-266a-4e9b-b642-b0ca7e4f6921
Jul 14 16:28:06 devstack sudo[93367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:07 devstack sudo[93367]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6da7ff2d-7fbd-45ad-8a02-ad466eade2f4 tempest-VolumesCloneTest-1876138912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cf2c446c-266a-4e9b-b642-b0ca7e4f6921" returned: 0 in 0.756s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:07 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-6da7ff2d-7fbd-45ad-8a02-ad466eade2f4 tempest-VolumesCloneTest-1876138912 None] Image conversion details: src /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cf2c446c-266a-4e9b-b642-b0ca7e4f6921, size 1024.00 MB, duration 5.76 sec, destination /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c40bd0b7-c1ac-4438-8095-833b74028757 {{(pid=87166) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 14 16:28:07 devstack cinder-volume[87166]: INFO cinder.image.image_utils [None req-6da7ff2d-7fbd-45ad-8a02-ad466eade2f4 tempest-VolumesCloneTest-1876138912 None] Converted 1024.00 MB image at 177.89 MB/s
Jul 14 16:28:07 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-6da7ff2d-7fbd-45ad-8a02-ad466eade2f4 tempest-VolumesCloneTest-1876138912 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c40bd0b7-c1ac-4438-8095-833b74028757 is being set with open permissions: ugo+rw
Jul 14 16:28:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6da7ff2d-7fbd-45ad-8a02-ad466eade2f4 tempest-VolumesCloneTest-1876138912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c40bd0b7-c1ac-4438-8095-833b74028757 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:07 devstack sudo[93388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c40bd0b7-c1ac-4438-8095-833b74028757
Jul 14 16:28:07 devstack sudo[93388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:07 devstack sudo[93388]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6da7ff2d-7fbd-45ad-8a02-ad466eade2f4 tempest-VolumesCloneTest-1876138912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c40bd0b7-c1ac-4438-8095-833b74028757" returned: 0 in 0.278s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:07 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6da7ff2d-7fbd-45ad-8a02-ad466eade2f4 tempest-VolumesCloneTest-1876138912 None] Lock "cinder-quobyte-c40bd0b7-c1ac-4438-8095-833b74028757" released by "_copy_volume_from_snapshot" :: held 7.587s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:28:07 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6da7ff2d-7fbd-45ad-8a02-ad466eade2f4 tempest-VolumesCloneTest-1876138912 None] Acquiring lock "cinder-quobyte-9b3238a8-87ab-483b-a5c7-868a9e7de813" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:28:07 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6da7ff2d-7fbd-45ad-8a02-ad466eade2f4 tempest-VolumesCloneTest-1876138912 None] Lock "cinder-quobyte-9b3238a8-87ab-483b-a5c7-868a9e7de813" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:28:07 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-6da7ff2d-7fbd-45ad-8a02-ad466eade2f4 tempest-VolumesCloneTest-1876138912 None] Deleting offline snapshot 9b3238a8-87ab-483b-a5c7-868a9e7de813 of volume cf2c446c-266a-4e9b-b642-b0ca7e4f6921 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 16:28:07 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-6da7ff2d-7fbd-45ad-8a02-ad466eade2f4 tempest-VolumesCloneTest-1876138912 None] snapshot_file for this snap is: volume-cf2c446c-266a-4e9b-b642-b0ca7e4f6921.9b3238a8-87ab-483b-a5c7-868a9e7de813 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 16:28:07 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb14874-69ff-45e8-a0c0-ce55004429ac]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:28:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6da7ff2d-7fbd-45ad-8a02-ad466eade2f4 tempest-VolumesCloneTest-1876138912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cf2c446c-266a-4e9b-b642-b0ca7e4f6921.9b3238a8-87ab-483b-a5c7-868a9e7de813 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:07 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-d704da86-3243-44a7-8693-0caf5f57fabe tempest-AttachVolumeTestJSON-1037344391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:28:07 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d704da86-3243-44a7-8693-0caf5f57fabe tempest-AttachVolumeTestJSON-1037344391 None] Flow 'volume_create_manager' (db2cb0a1-e84d-463e-a243-be603cffddaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:28:07 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d704da86-3243-44a7-8693-0caf5f57fabe tempest-AttachVolumeTestJSON-1037344391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bffab87c-d97a-491a-9ebb-401d4bdebdd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:28:07 devstack sudo[93391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cf2c446c-266a-4e9b-b642-b0ca7e4f6921.9b3238a8-87ab-483b-a5c7-868a9e7de813
Jul 14 16:28:07 devstack sudo[93391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:07 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d704da86-3243-44a7-8693-0caf5f57fabe tempest-AttachVolumeTestJSON-1037344391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bffab87c-d97a-491a-9ebb-401d4bdebdd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:28:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2126601730',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88a61666-6013-4c47-abae-f04015c3c760,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a48e5fb250034dfbb4de440df0be7961',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:28:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:28:08Z,use_quota=True,user_id='ab1817e4c8eb4dfe8f1a0db1c01094e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:28:07 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d704da86-3243-44a7-8693-0caf5f57fabe tempest-AttachVolumeTestJSON-1037344391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (147d86ce-b852-47e0-a458-9819d6c41c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:28:07 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d704da86-3243-44a7-8693-0caf5f57fabe tempest-AttachVolumeTestJSON-1037344391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (147d86ce-b852-47e0-a458-9819d6c41c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:28:07 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d704da86-3243-44a7-8693-0caf5f57fabe tempest-AttachVolumeTestJSON-1037344391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af6ac29e-004b-4629-8662-621555f5b4d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:28:07 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d704da86-3243-44a7-8693-0caf5f57fabe tempest-AttachVolumeTestJSON-1037344391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af6ac29e-004b-4629-8662-621555f5b4d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88a61666-6013-4c47-abae-f04015c3c760', 'volume_name': 'volume-88a61666-6013-4c47-abae-f04015c3c760', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:28:07 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d704da86-3243-44a7-8693-0caf5f57fabe tempest-AttachVolumeTestJSON-1037344391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66dab316-7742-47fb-9e26-7202f8a72ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:28:07 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d704da86-3243-44a7-8693-0caf5f57fabe tempest-AttachVolumeTestJSON-1037344391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66dab316-7742-47fb-9e26-7202f8a72ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:28:07 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d704da86-3243-44a7-8693-0caf5f57fabe tempest-AttachVolumeTestJSON-1037344391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0174c77c-d030-4c3d-9eda-c056ef744e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:28:07 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-d704da86-3243-44a7-8693-0caf5f57fabe tempest-AttachVolumeTestJSON-1037344391 None] Volume 88a61666-6013-4c47-abae-f04015c3c760: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88a61666-6013-4c47-abae-f04015c3c760', 'volume_size': 1}
Jul 14 16:28:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d704da86-3243-44a7-8693-0caf5f57fabe tempest-AttachVolumeTestJSON-1037344391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:28:08 devstack sudo[93391]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6da7ff2d-7fbd-45ad-8a02-ad466eade2f4 tempest-VolumesCloneTest-1876138912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cf2c446c-266a-4e9b-b642-b0ca7e4f6921.9b3238a8-87ab-483b-a5c7-868a9e7de813" returned: 0 in 0.601s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:08 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-6da7ff2d-7fbd-45ad-8a02-ad466eade2f4 tempest-VolumesCloneTest-1876138912 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf2c446c-266a-4e9b-b642-b0ca7e4f6921(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 16:28:08 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c604aa-3210-4f72-9f10-6dbe51039579]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:28:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6da7ff2d-7fbd-45ad-8a02-ad466eade2f4 tempest-VolumesCloneTest-1876138912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cf2c446c-266a-4e9b-b642-b0ca7e4f6921 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:08 devstack sudo[93398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cf2c446c-266a-4e9b-b642-b0ca7e4f6921
Jul 14 16:28:08 devstack sudo[93398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:08 devstack sudo[93398]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6da7ff2d-7fbd-45ad-8a02-ad466eade2f4 tempest-VolumesCloneTest-1876138912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cf2c446c-266a-4e9b-b642-b0ca7e4f6921" returned: 0 in 0.424s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6da7ff2d-7fbd-45ad-8a02-ad466eade2f4 tempest-VolumesCloneTest-1876138912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cf2c446c-266a-4e9b-b642-b0ca7e4f6921.9b3238a8-87ab-483b-a5c7-868a9e7de813 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:08 devstack sudo[93403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cf2c446c-266a-4e9b-b642-b0ca7e4f6921.9b3238a8-87ab-483b-a5c7-868a9e7de813
Jul 14 16:28:08 devstack sudo[93403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:08 devstack sudo[93403]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6da7ff2d-7fbd-45ad-8a02-ad466eade2f4 tempest-VolumesCloneTest-1876138912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cf2c446c-266a-4e9b-b642-b0ca7e4f6921.9b3238a8-87ab-483b-a5c7-868a9e7de813" returned: 0 in 0.357s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6da7ff2d-7fbd-45ad-8a02-ad466eade2f4 tempest-VolumesCloneTest-1876138912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cf2c446c-266a-4e9b-b642-b0ca7e4f6921.9b3238a8-87ab-483b-a5c7-868a9e7de813 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:09 devstack sudo[93409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cf2c446c-266a-4e9b-b642-b0ca7e4f6921.9b3238a8-87ab-483b-a5c7-868a9e7de813
Jul 14 16:28:09 devstack sudo[93409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:09 devstack sudo[93409]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6da7ff2d-7fbd-45ad-8a02-ad466eade2f4 tempest-VolumesCloneTest-1876138912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cf2c446c-266a-4e9b-b642-b0ca7e4f6921.9b3238a8-87ab-483b-a5c7-868a9e7de813" returned: 0 in 0.254s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:09 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6da7ff2d-7fbd-45ad-8a02-ad466eade2f4 tempest-VolumesCloneTest-1876138912 None] Lock "cinder-quobyte-9b3238a8-87ab-483b-a5c7-868a9e7de813" released by "_delete_snapshot" :: held 1.786s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:28:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6da7ff2d-7fbd-45ad-8a02-ad466eade2f4 tempest-VolumesCloneTest-1876138912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.407s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:28:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-96836f45-9cbe-4835-8472-d1221bbcd662 tempest-GroupSnapshotsTest-1880376477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 10.096s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:28:09 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-96836f45-9cbe-4835-8472-d1221bbcd662 tempest-GroupSnapshotsTest-1880376477 None] Acquiring lock "cinder-quobyte-123f15b4-c97e-4684-a256-9b2c99c45e31-904c9d05-74c7-426b-9950-de4e6fb261aa" by "_create_volume_from_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:28:09 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6da7ff2d-7fbd-45ad-8a02-ad466eade2f4 tempest-VolumesCloneTest-1876138912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57a838ce-58c5-4c39-8d22-efddd7d29728) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c40bd0b7-c1ac-4438-8095-833b74028757', 'volume_size': 2, 'source_volid': 'cf2c446c-266a-4e9b-b642-b0ca7e4f6921', 'source_volstatus': 'available'}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:28:09 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6da7ff2d-7fbd-45ad-8a02-ad466eade2f4 tempest-VolumesCloneTest-1876138912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac062ea8-41ee-40cb-9e8f-9f57219f623c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:28:09 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-96836f45-9cbe-4835-8472-d1221bbcd662 tempest-GroupSnapshotsTest-1880376477 None] Lock "cinder-quobyte-123f15b4-c97e-4684-a256-9b2c99c45e31-904c9d05-74c7-426b-9950-de4e6fb261aa" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:28:09 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-96836f45-9cbe-4835-8472-d1221bbcd662 tempest-GroupSnapshotsTest-1880376477 None] Creating volume 904c9d05-74c7-426b-9950-de4e6fb261aa from snapshot 123f15b4-c97e-4684-a256-9b2c99c45e31 {{(pid=87166) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 14 16:28:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-96836f45-9cbe-4835-8472-d1221bbcd662 tempest-GroupSnapshotsTest-1880376477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:28:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-96836f45-9cbe-4835-8472-d1221bbcd662 tempest-GroupSnapshotsTest-1880376477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:28:09 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-96836f45-9cbe-4835-8472-d1221bbcd662 tempest-GroupSnapshotsTest-1880376477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:28:09 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-96836f45-9cbe-4835-8472-d1221bbcd662 tempest-GroupSnapshotsTest-1880376477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:28:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-96836f45-9cbe-4835-8472-d1221bbcd662 tempest-GroupSnapshotsTest-1880376477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:28:09 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-96836f45-9cbe-4835-8472-d1221bbcd662 tempest-GroupSnapshotsTest-1880376477 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:28:09 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-96836f45-9cbe-4835-8472-d1221bbcd662 tempest-GroupSnapshotsTest-1880376477 None] Acquiring lock "cinder-quobyte-904c9d05-74c7-426b-9950-de4e6fb261aa" by "_copy_volume_from_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:28:09 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-6da7ff2d-7fbd-45ad-8a02-ad466eade2f4 tempest-VolumesCloneTest-1876138912 None] Volume volume-c40bd0b7-c1ac-4438-8095-833b74028757 (c40bd0b7-c1ac-4438-8095-833b74028757): created successfully
Jul 14 16:28:09 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6da7ff2d-7fbd-45ad-8a02-ad466eade2f4 tempest-VolumesCloneTest-1876138912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac062ea8-41ee-40cb-9e8f-9f57219f623c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:28:09 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6da7ff2d-7fbd-45ad-8a02-ad466eade2f4 tempest-VolumesCloneTest-1876138912 None] Flow 'volume_create_manager' (d6dae03e-523a-435b-88ee-c3a1868a752f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:28:09 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-96836f45-9cbe-4835-8472-d1221bbcd662 tempest-GroupSnapshotsTest-1880376477 None] Lock "cinder-quobyte-904c9d05-74c7-426b-9950-de4e6fb261aa" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:28:09 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-96836f45-9cbe-4835-8472-d1221bbcd662 tempest-GroupSnapshotsTest-1880376477 None] snapshot: 123f15b4-c97e-4684-a256-9b2c99c45e31, volume: 904c9d05-74c7-426b-9950-de4e6fb261aa,  {{(pid=87166) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 14 16:28:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-96836f45-9cbe-4835-8472-d1221bbcd662 tempest-GroupSnapshotsTest-1880376477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:28:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-96836f45-9cbe-4835-8472-d1221bbcd662 tempest-GroupSnapshotsTest-1880376477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:28:09 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-96836f45-9cbe-4835-8472-d1221bbcd662 tempest-GroupSnapshotsTest-1880376477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:28:09 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-96836f45-9cbe-4835-8472-d1221bbcd662 tempest-GroupSnapshotsTest-1880376477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:28:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-96836f45-9cbe-4835-8472-d1221bbcd662 tempest-GroupSnapshotsTest-1880376477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:28:09 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-6da7ff2d-7fbd-45ad-8a02-ad466eade2f4 tempest-VolumesCloneTest-1876138912 None] Created volume successfully.
Jul 14 16:28:09 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f77fd2e-308e-43b2-bd1e-166da6826a32]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:28:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-96836f45-9cbe-4835-8472-d1221bbcd662 tempest-GroupSnapshotsTest-1880376477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2f257612-dc56-4a89-af48-a89112430d72.123f15b4-c97e-4684-a256-9b2c99c45e31 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:09 devstack sudo[93412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2f257612-dc56-4a89-af48-a89112430d72.123f15b4-c97e-4684-a256-9b2c99c45e31
Jul 14 16:28:09 devstack sudo[93412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:09 devstack sudo[93412]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-96836f45-9cbe-4835-8472-d1221bbcd662 tempest-GroupSnapshotsTest-1880376477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2f257612-dc56-4a89-af48-a89112430d72.123f15b4-c97e-4684-a256-9b2c99c45e31" returned: 0 in 0.398s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:09 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-96836f45-9cbe-4835-8472-d1221bbcd662 tempest-GroupSnapshotsTest-1880376477 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f257612-dc56-4a89-af48-a89112430d72(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 16:28:09 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-96836f45-9cbe-4835-8472-d1221bbcd662 tempest-GroupSnapshotsTest-1880376477 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2f257612-dc56-4a89-af48-a89112430d72 {{(pid=87166) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 14 16:28:09 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-96836f45-9cbe-4835-8472-d1221bbcd662 tempest-GroupSnapshotsTest-1880376477 None] Creating direct copy from snapshot {{(pid=87166) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 14 16:28:09 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e36b690-dda9-4c40-8206-03a3009c74dc]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:28:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-96836f45-9cbe-4835-8472-d1221bbcd662 tempest-GroupSnapshotsTest-1880376477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2f257612-dc56-4a89-af48-a89112430d72 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:09 devstack sudo[93418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2f257612-dc56-4a89-af48-a89112430d72
Jul 14 16:28:09 devstack sudo[93418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:10 devstack sudo[93418]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-96836f45-9cbe-4835-8472-d1221bbcd662 tempest-GroupSnapshotsTest-1880376477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2f257612-dc56-4a89-af48-a89112430d72" returned: 0 in 0.383s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:10 devstack cinder-volume[87166]: DEBUG cinder.utils [None req-96836f45-9cbe-4835-8472-d1221bbcd662 tempest-GroupSnapshotsTest-1880376477 None] Path /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-904c9d05-74c7-426b-9950-de4e6fb261aa not found in is_blk_device check {{(pid=87166) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 14 16:28:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-96836f45-9cbe-4835-8472-d1221bbcd662 tempest-GroupSnapshotsTest-1880376477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2f257612-dc56-4a89-af48-a89112430d72 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-904c9d05-74c7-426b-9950-de4e6fb261aa {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:10 devstack sudo[93423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2f257612-dc56-4a89-af48-a89112430d72 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-904c9d05-74c7-426b-9950-de4e6fb261aa
Jul 14 16:28:10 devstack sudo[93423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:10 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a4d970de-ecff-432c-9dda-766db94165d3 tempest-VolumesCloneTest-1876138912 None] Acquiring lock "cinder-c40bd0b7-c1ac-4438-8095-833b74028757-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:28:10 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a4d970de-ecff-432c-9dda-766db94165d3 tempest-VolumesCloneTest-1876138912 None] Lock "cinder-c40bd0b7-c1ac-4438-8095-833b74028757-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:28:10 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a4d970de-ecff-432c-9dda-766db94165d3 tempest-VolumesCloneTest-1876138912 None] Acquiring lock "cinder-quobyte-c40bd0b7-c1ac-4438-8095-833b74028757" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:28:10 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a4d970de-ecff-432c-9dda-766db94165d3 tempest-VolumesCloneTest-1876138912 None] Lock "cinder-quobyte-c40bd0b7-c1ac-4438-8095-833b74028757" acquired by "delete_volume" :: waited 0.015s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:28:10 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[efea2d71-13ff-4a7d-a53d-5339d9360d50]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:28:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a4d970de-ecff-432c-9dda-766db94165d3 tempest-VolumesCloneTest-1876138912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c40bd0b7-c1ac-4438-8095-833b74028757 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:10 devstack sudo[93431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c40bd0b7-c1ac-4438-8095-833b74028757
Jul 14 16:28:10 devstack sudo[93431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:11 devstack sudo[93431]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a4d970de-ecff-432c-9dda-766db94165d3 tempest-VolumesCloneTest-1876138912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c40bd0b7-c1ac-4438-8095-833b74028757" returned: 0 in 0.998s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a4d970de-ecff-432c-9dda-766db94165d3 tempest-VolumesCloneTest-1876138912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c40bd0b7-c1ac-4438-8095-833b74028757 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:11 devstack sudo[93447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c40bd0b7-c1ac-4438-8095-833b74028757
Jul 14 16:28:11 devstack sudo[93447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:12 devstack sudo[93447]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a4d970de-ecff-432c-9dda-766db94165d3 tempest-VolumesCloneTest-1876138912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c40bd0b7-c1ac-4438-8095-833b74028757" returned: 0 in 0.529s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:12 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a4d970de-ecff-432c-9dda-766db94165d3 tempest-VolumesCloneTest-1876138912 None] Lock "cinder-quobyte-c40bd0b7-c1ac-4438-8095-833b74028757" released by "delete_volume" :: held 1.588s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:28:12 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-a4d970de-ecff-432c-9dda-766db94165d3 tempest-VolumesCloneTest-1876138912 None] Created reservations ['66edaa20-8526-4be3-8651-04d5a670d963', 'fd438781-51b4-41df-8028-fd7890487e5b', '281e5589-6006-4b04-90b0-482b8ed84000', '9f7c7cbb-489e-472a-b71a-96ba42df9ea9'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:28:12 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-fb8ed4b7-03b4-45d0-a9a0-eb1ad1bc8ef6 req-fb14eee1-cf78-4aaf-bb68-d0997c410aea tempest-AttachVolumeNegativeTest-1726980645 None] Terminate volume connection completed successfully.
Jul 14 16:28:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-fb8ed4b7-03b4-45d0-a9a0-eb1ad1bc8ef6 req-fb14eee1-cf78-4aaf-bb68-d0997c410aea tempest-AttachVolumeNegativeTest-1726980645 None] Deleting attachment 65db7a73-4695-4a78-b86c-a2f7a763ef01. {{(pid=87166) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 14 16:28:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a4d970de-ecff-432c-9dda-766db94165d3 tempest-VolumesCloneTest-1876138912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:28:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a4d970de-ecff-432c-9dda-766db94165d3 tempest-VolumesCloneTest-1876138912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:28:12 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a4d970de-ecff-432c-9dda-766db94165d3 tempest-VolumesCloneTest-1876138912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:28:12 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a4d970de-ecff-432c-9dda-766db94165d3 tempest-VolumesCloneTest-1876138912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:28:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a4d970de-ecff-432c-9dda-766db94165d3 tempest-VolumesCloneTest-1876138912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:28:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a4d970de-ecff-432c-9dda-766db94165d3 tempest-VolumesCloneTest-1876138912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:12 devstack sudo[93454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:28:12 devstack sudo[93454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:13 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3e70bad3-0e82-403c-8e29-e11ac5bd1c76 tempest-VolumesCloneTest-1876138912 None] Acquiring lock "cinder-cf2c446c-266a-4e9b-b642-b0ca7e4f6921-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:28:13 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3e70bad3-0e82-403c-8e29-e11ac5bd1c76 tempest-VolumesCloneTest-1876138912 None] Lock "cinder-cf2c446c-266a-4e9b-b642-b0ca7e4f6921-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:28:13 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3e70bad3-0e82-403c-8e29-e11ac5bd1c76 tempest-VolumesCloneTest-1876138912 None] Acquiring lock "cinder-quobyte-cf2c446c-266a-4e9b-b642-b0ca7e4f6921" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:28:13 devstack sudo[93454]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a4d970de-ecff-432c-9dda-766db94165d3 tempest-VolumesCloneTest-1876138912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.744s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:13 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-a4d970de-ecff-432c-9dda-766db94165d3 tempest-VolumesCloneTest-1876138912 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:28:13 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3e70bad3-0e82-403c-8e29-e11ac5bd1c76 tempest-VolumesCloneTest-1876138912 None] Lock "cinder-quobyte-cf2c446c-266a-4e9b-b642-b0ca7e4f6921" acquired by "delete_volume" :: waited 0.036s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:28:13 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-a4d970de-ecff-432c-9dda-766db94165d3 tempest-VolumesCloneTest-1876138912 None] Deleted volume successfully.
Jul 14 16:28:13 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[91020082-c683-45c2-bfa5-95d8195d527c]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:28:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3e70bad3-0e82-403c-8e29-e11ac5bd1c76 tempest-VolumesCloneTest-1876138912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cf2c446c-266a-4e9b-b642-b0ca7e4f6921 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:13 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a4d970de-ecff-432c-9dda-766db94165d3 tempest-VolumesCloneTest-1876138912 None] Lock "cinder-c40bd0b7-c1ac-4438-8095-833b74028757-delete_volume" released by "delete_volume" :: held 3.033s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:28:13 devstack sudo[93457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cf2c446c-266a-4e9b-b642-b0ca7e4f6921
Jul 14 16:28:13 devstack sudo[93457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:14 devstack sudo[93457]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3e70bad3-0e82-403c-8e29-e11ac5bd1c76 tempest-VolumesCloneTest-1876138912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cf2c446c-266a-4e9b-b642-b0ca7e4f6921" returned: 0 in 0.644s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3e70bad3-0e82-403c-8e29-e11ac5bd1c76 tempest-VolumesCloneTest-1876138912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cf2c446c-266a-4e9b-b642-b0ca7e4f6921 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:14 devstack sudo[93463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cf2c446c-266a-4e9b-b642-b0ca7e4f6921
Jul 14 16:28:14 devstack sudo[93463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:14 devstack sudo[93463]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3e70bad3-0e82-403c-8e29-e11ac5bd1c76 tempest-VolumesCloneTest-1876138912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cf2c446c-266a-4e9b-b642-b0ca7e4f6921" returned: 0 in 0.513s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:14 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3e70bad3-0e82-403c-8e29-e11ac5bd1c76 tempest-VolumesCloneTest-1876138912 None] Lock "cinder-quobyte-cf2c446c-266a-4e9b-b642-b0ca7e4f6921" released by "delete_volume" :: held 1.347s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:28:15 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-3e70bad3-0e82-403c-8e29-e11ac5bd1c76 tempest-VolumesCloneTest-1876138912 None] Created reservations ['864c70f9-ad5b-497e-8174-ae07d823a421', '2950aaaf-c933-4d05-9b26-bc1d497f6702', '7808752e-2273-40e7-b9ee-23737c615947', '8879d38d-0379-4849-bb18-58dfadff89e3'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:28:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3e70bad3-0e82-403c-8e29-e11ac5bd1c76 tempest-VolumesCloneTest-1876138912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:28:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3e70bad3-0e82-403c-8e29-e11ac5bd1c76 tempest-VolumesCloneTest-1876138912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:28:15 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-3e70bad3-0e82-403c-8e29-e11ac5bd1c76 tempest-VolumesCloneTest-1876138912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:28:15 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-3e70bad3-0e82-403c-8e29-e11ac5bd1c76 tempest-VolumesCloneTest-1876138912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:28:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3e70bad3-0e82-403c-8e29-e11ac5bd1c76 tempest-VolumesCloneTest-1876138912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:28:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3e70bad3-0e82-403c-8e29-e11ac5bd1c76 tempest-VolumesCloneTest-1876138912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:15 devstack sudo[93481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:28:15 devstack sudo[93481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:16 devstack sudo[93481]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3e70bad3-0e82-403c-8e29-e11ac5bd1c76 tempest-VolumesCloneTest-1876138912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.702s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:16 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-3e70bad3-0e82-403c-8e29-e11ac5bd1c76 tempest-VolumesCloneTest-1876138912 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:28:16 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-3e70bad3-0e82-403c-8e29-e11ac5bd1c76 tempest-VolumesCloneTest-1876138912 None] Deleted volume successfully.
Jul 14 16:28:16 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3e70bad3-0e82-403c-8e29-e11ac5bd1c76 tempest-VolumesCloneTest-1876138912 None] Lock "cinder-cf2c446c-266a-4e9b-b642-b0ca7e4f6921-delete_volume" released by "delete_volume" :: held 2.770s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:28:16 devstack sudo[93423]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-96836f45-9cbe-4835-8472-d1221bbcd662 tempest-GroupSnapshotsTest-1880376477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2f257612-dc56-4a89-af48-a89112430d72 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-904c9d05-74c7-426b-9950-de4e6fb261aa" returned: 0 in 6.097s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:16 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[6737105e-baf0-4468-9de8-2198c413ccb8]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:28:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-96836f45-9cbe-4835-8472-d1221bbcd662 tempest-GroupSnapshotsTest-1880376477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2f257612-dc56-4a89-af48-a89112430d72 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:16 devstack sudo[93491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2f257612-dc56-4a89-af48-a89112430d72
Jul 14 16:28:16 devstack sudo[93491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:17 devstack sudo[93491]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-96836f45-9cbe-4835-8472-d1221bbcd662 tempest-GroupSnapshotsTest-1880376477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2f257612-dc56-4a89-af48-a89112430d72" returned: 0 in 0.659s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:17 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-96836f45-9cbe-4835-8472-d1221bbcd662 tempest-GroupSnapshotsTest-1880376477 None] Image conversion details: src /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2f257612-dc56-4a89-af48-a89112430d72, size 1024.00 MB, duration 6.10 sec, destination /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-904c9d05-74c7-426b-9950-de4e6fb261aa {{(pid=87166) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 14 16:28:17 devstack cinder-volume[87166]: INFO cinder.image.image_utils [None req-96836f45-9cbe-4835-8472-d1221bbcd662 tempest-GroupSnapshotsTest-1880376477 None] Converted 1024.00 MB image at 167.93 MB/s
Jul 14 16:28:17 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-96836f45-9cbe-4835-8472-d1221bbcd662 tempest-GroupSnapshotsTest-1880376477 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-904c9d05-74c7-426b-9950-de4e6fb261aa is being set with open permissions: ugo+rw: NotImplementedError
Jul 14 16:28:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-96836f45-9cbe-4835-8472-d1221bbcd662 tempest-GroupSnapshotsTest-1880376477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-904c9d05-74c7-426b-9950-de4e6fb261aa {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:17 devstack sudo[93499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-904c9d05-74c7-426b-9950-de4e6fb261aa
Jul 14 16:28:17 devstack sudo[93499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:17 devstack sudo[93499]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-96836f45-9cbe-4835-8472-d1221bbcd662 tempest-GroupSnapshotsTest-1880376477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-904c9d05-74c7-426b-9950-de4e6fb261aa" returned: 0 in 0.320s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:17 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-96836f45-9cbe-4835-8472-d1221bbcd662 tempest-GroupSnapshotsTest-1880376477 None] Lock "cinder-quobyte-904c9d05-74c7-426b-9950-de4e6fb261aa" released by "_copy_volume_from_snapshot" :: held 7.954s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:28:17 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-96836f45-9cbe-4835-8472-d1221bbcd662 tempest-GroupSnapshotsTest-1880376477 None] Lock "cinder-quobyte-123f15b4-c97e-4684-a256-9b2c99c45e31-904c9d05-74c7-426b-9950-de4e6fb261aa" released by "_create_volume_from_snapshot" :: held 8.003s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:28:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-96836f45-9cbe-4835-8472-d1221bbcd662 tempest-GroupSnapshotsTest-1880376477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.035s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:28:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d704da86-3243-44a7-8693-0caf5f57fabe tempest-AttachVolumeTestJSON-1037344391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.436s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:28:17 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d704da86-3243-44a7-8693-0caf5f57fabe tempest-AttachVolumeTestJSON-1037344391 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:28:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2126601730',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88a61666-6013-4c47-abae-f04015c3c760,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a48e5fb250034dfbb4de440df0be7961',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:28:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:28:08Z,use_quota=True,user_id='ab1817e4c8eb4dfe8f1a0db1c01094e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:28:17 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-d704da86-3243-44a7-8693-0caf5f57fabe tempest-AttachVolumeTestJSON-1037344391 None] Creating volume 88a61666-6013-4c47-abae-f04015c3c760 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:28:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d704da86-3243-44a7-8693-0caf5f57fabe tempest-AttachVolumeTestJSON-1037344391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:28:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d704da86-3243-44a7-8693-0caf5f57fabe tempest-AttachVolumeTestJSON-1037344391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:28:17 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d704da86-3243-44a7-8693-0caf5f57fabe tempest-AttachVolumeTestJSON-1037344391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:28:17 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d704da86-3243-44a7-8693-0caf5f57fabe tempest-AttachVolumeTestJSON-1037344391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:28:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d704da86-3243-44a7-8693-0caf5f57fabe tempest-AttachVolumeTestJSON-1037344391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:28:17 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d704da86-3243-44a7-8693-0caf5f57fabe tempest-AttachVolumeTestJSON-1037344391 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:28:17 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-d704da86-3243-44a7-8693-0caf5f57fabe tempest-AttachVolumeTestJSON-1037344391 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:28:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d704da86-3243-44a7-8693-0caf5f57fabe tempest-AttachVolumeTestJSON-1037344391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-88a61666-6013-4c47-abae-f04015c3c760 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:17 devstack sudo[93503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-88a61666-6013-4c47-abae-f04015c3c760 1073741824
Jul 14 16:28:17 devstack sudo[93503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:17 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-96836f45-9cbe-4835-8472-d1221bbcd662 tempest-GroupSnapshotsTest-1880376477 None] Create group from source-snapshot-a6283812-e705-4140-9521-725516120dde completed successfully.
Jul 14 16:28:17 devstack sudo[93503]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d704da86-3243-44a7-8693-0caf5f57fabe tempest-AttachVolumeTestJSON-1037344391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-88a61666-6013-4c47-abae-f04015c3c760 1073741824" returned: 0 in 0.613s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d704da86-3243-44a7-8693-0caf5f57fabe tempest-AttachVolumeTestJSON-1037344391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-88a61666-6013-4c47-abae-f04015c3c760 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:18 devstack sudo[93509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-88a61666-6013-4c47-abae-f04015c3c760
Jul 14 16:28:18 devstack sudo[93509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:18 devstack sudo[93509]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d704da86-3243-44a7-8693-0caf5f57fabe tempest-AttachVolumeTestJSON-1037344391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-88a61666-6013-4c47-abae-f04015c3c760" returned: 0 in 0.284s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:18 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d704da86-3243-44a7-8693-0caf5f57fabe tempest-AttachVolumeTestJSON-1037344391 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:28:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d704da86-3243-44a7-8693-0caf5f57fabe tempest-AttachVolumeTestJSON-1037344391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:28:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d704da86-3243-44a7-8693-0caf5f57fabe tempest-AttachVolumeTestJSON-1037344391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0174c77c-d030-4c3d-9eda-c056ef744e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88a61666-6013-4c47-abae-f04015c3c760', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:28:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d704da86-3243-44a7-8693-0caf5f57fabe tempest-AttachVolumeTestJSON-1037344391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54b480b5-3fb1-416a-9b02-08a91667d6d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:28:18 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-d704da86-3243-44a7-8693-0caf5f57fabe tempest-AttachVolumeTestJSON-1037344391 None] Volume volume-88a61666-6013-4c47-abae-f04015c3c760 (88a61666-6013-4c47-abae-f04015c3c760): created successfully
Jul 14 16:28:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d704da86-3243-44a7-8693-0caf5f57fabe tempest-AttachVolumeTestJSON-1037344391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54b480b5-3fb1-416a-9b02-08a91667d6d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:28:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d704da86-3243-44a7-8693-0caf5f57fabe tempest-AttachVolumeTestJSON-1037344391 None] Flow 'volume_create_manager' (db2cb0a1-e84d-463e-a243-be603cffddaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:28:18 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-d704da86-3243-44a7-8693-0caf5f57fabe tempest-AttachVolumeTestJSON-1037344391 None] Created volume successfully.
Jul 14 16:28:19 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-671bf6c6-c4fc-477e-be4b-2932dfc0e46d tempest-GroupSnapshotsTest-1880376477 None] Acquiring lock "cinder-quobyte-904c9d05-74c7-426b-9950-de4e6fb261aa" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:28:19 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-671bf6c6-c4fc-477e-be4b-2932dfc0e46d tempest-GroupSnapshotsTest-1880376477 None] Lock "cinder-quobyte-904c9d05-74c7-426b-9950-de4e6fb261aa" acquired by "delete_volume" :: waited 0.019s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:28:19 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[803a0643-f925-4ac3-9835-500a5a97ba60]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:28:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-671bf6c6-c4fc-477e-be4b-2932dfc0e46d tempest-GroupSnapshotsTest-1880376477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-904c9d05-74c7-426b-9950-de4e6fb261aa {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:19 devstack sudo[93513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-904c9d05-74c7-426b-9950-de4e6fb261aa
Jul 14 16:28:19 devstack sudo[93513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:19 devstack sudo[93513]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-671bf6c6-c4fc-477e-be4b-2932dfc0e46d tempest-GroupSnapshotsTest-1880376477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-904c9d05-74c7-426b-9950-de4e6fb261aa" returned: 0 in 0.535s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-671bf6c6-c4fc-477e-be4b-2932dfc0e46d tempest-GroupSnapshotsTest-1880376477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-904c9d05-74c7-426b-9950-de4e6fb261aa {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:19 devstack sudo[93522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-904c9d05-74c7-426b-9950-de4e6fb261aa
Jul 14 16:28:19 devstack sudo[93522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:20 devstack sudo[93522]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-671bf6c6-c4fc-477e-be4b-2932dfc0e46d tempest-GroupSnapshotsTest-1880376477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-904c9d05-74c7-426b-9950-de4e6fb261aa" returned: 0 in 0.386s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:20 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-671bf6c6-c4fc-477e-be4b-2932dfc0e46d tempest-GroupSnapshotsTest-1880376477 None] Lock "cinder-quobyte-904c9d05-74c7-426b-9950-de4e6fb261aa" released by "delete_volume" :: held 1.017s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:28:20 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-671bf6c6-c4fc-477e-be4b-2932dfc0e46d tempest-GroupSnapshotsTest-1880376477 None] Created reservations ['f27c4b6c-6632-4e37-a116-a1401fbb7fc3'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:28:20 devstack cinder-volume[87166]: WARNING cinder.quota [None req-671bf6c6-c4fc-477e-be4b-2932dfc0e46d tempest-GroupSnapshotsTest-1880376477 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1871177132 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1871177132, it is now deprecated. Please use the default quota class for default quota.
Jul 14 16:28:20 devstack cinder-volume[87166]: WARNING cinder.quota [None req-671bf6c6-c4fc-477e-be4b-2932dfc0e46d tempest-GroupSnapshotsTest-1880376477 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1871177132 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1871177132, it is now deprecated. Please use the default quota class for default quota.
Jul 14 16:28:20 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-671bf6c6-c4fc-477e-be4b-2932dfc0e46d tempest-GroupSnapshotsTest-1880376477 None] Created reservations ['95d8494f-4aa6-4fb0-945e-0112b229a808', '88650b9a-a48c-4a42-a068-fb34830eeb64', 'be79ec3d-1722-4c6c-8247-181cc8b6f123', 'db24c08e-856c-4917-8d05-9fbb32ac4dbc'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:28:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-671bf6c6-c4fc-477e-be4b-2932dfc0e46d tempest-GroupSnapshotsTest-1880376477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:28:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-671bf6c6-c4fc-477e-be4b-2932dfc0e46d tempest-GroupSnapshotsTest-1880376477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:28:20 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-671bf6c6-c4fc-477e-be4b-2932dfc0e46d tempest-GroupSnapshotsTest-1880376477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:28:20 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-671bf6c6-c4fc-477e-be4b-2932dfc0e46d tempest-GroupSnapshotsTest-1880376477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:28:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-671bf6c6-c4fc-477e-be4b-2932dfc0e46d tempest-GroupSnapshotsTest-1880376477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:28:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-671bf6c6-c4fc-477e-be4b-2932dfc0e46d tempest-GroupSnapshotsTest-1880376477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-baddfb07-7c93-4185-a51c-f22c3b5a141b req-a4736220-a313-40cd-b779-6562e7ca716e tempest-AttachVolumeTestJSON-1037344391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:28:20 devstack sudo[93534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:28:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-baddfb07-7c93-4185-a51c-f22c3b5a141b req-a4736220-a313-40cd-b779-6562e7ca716e tempest-AttachVolumeTestJSON-1037344391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:28:20 devstack sudo[93534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:20 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d378eb2-39df-4bbe-878b-36120a9084a8]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:28:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-baddfb07-7c93-4185-a51c-f22c3b5a141b req-a4736220-a313-40cd-b779-6562e7ca716e tempest-AttachVolumeTestJSON-1037344391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-88a61666-6013-4c47-abae-f04015c3c760 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:20 devstack sudo[93536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-88a61666-6013-4c47-abae-f04015c3c760
Jul 14 16:28:20 devstack sudo[93536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:20 devstack sudo[93534]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-671bf6c6-c4fc-477e-be4b-2932dfc0e46d tempest-GroupSnapshotsTest-1880376477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.325s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:20 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-671bf6c6-c4fc-477e-be4b-2932dfc0e46d tempest-GroupSnapshotsTest-1880376477 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:28:20 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-671bf6c6-c4fc-477e-be4b-2932dfc0e46d tempest-GroupSnapshotsTest-1880376477 None] Delete group completed successfully.
Jul 14 16:28:21 devstack sudo[93536]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-baddfb07-7c93-4185-a51c-f22c3b5a141b req-a4736220-a313-40cd-b779-6562e7ca716e tempest-AttachVolumeTestJSON-1037344391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-88a61666-6013-4c47-abae-f04015c3c760" returned: 0 in 0.544s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-baddfb07-7c93-4185-a51c-f22c3b5a141b req-a4736220-a313-40cd-b779-6562e7ca716e tempest-AttachVolumeTestJSON-1037344391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.577s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:28:21 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-baddfb07-7c93-4185-a51c-f22c3b5a141b req-a4736220-a313-40cd-b779-6562e7ca716e tempest-AttachVolumeTestJSON-1037344391 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052', 'name': 'volume-88a61666-6013-4c47-abae-f04015c3c760', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bd601490-819a-4434-8dda-44890b764b32', 'enforce_multipath': True} {{(pid=87166) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 14 16:28:21 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-baddfb07-7c93-4185-a51c-f22c3b5a141b req-a4736220-a313-40cd-b779-6562e7ca716e tempest-AttachVolumeTestJSON-1037344391 None] attachment_update completed successfully.
Jul 14 16:28:21 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-45c7e5a5-ab62-4fe9-b03b-6a4a1702b3af tempest-GroupSnapshotsTest-1880376477 None] group_snapshot a6283812-e705-4140-9521-725516120dde: deleting
Jul 14 16:28:21 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-45c7e5a5-ab62-4fe9-b03b-6a4a1702b3af tempest-GroupSnapshotsTest-1880376477 None] group_snapshot a6283812-e705-4140-9521-725516120dde: deleting {{(pid=87166) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 14 16:28:21 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-45c7e5a5-ab62-4fe9-b03b-6a4a1702b3af tempest-GroupSnapshotsTest-1880376477 None] Acquiring lock "cinder-quobyte-2f257612-dc56-4a89-af48-a89112430d72" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:28:21 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-45c7e5a5-ab62-4fe9-b03b-6a4a1702b3af tempest-GroupSnapshotsTest-1880376477 None] Lock "cinder-quobyte-2f257612-dc56-4a89-af48-a89112430d72" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:28:21 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-45c7e5a5-ab62-4fe9-b03b-6a4a1702b3af tempest-GroupSnapshotsTest-1880376477 None] Acquiring lock "cinder-quobyte-123f15b4-c97e-4684-a256-9b2c99c45e31" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:28:21 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-45c7e5a5-ab62-4fe9-b03b-6a4a1702b3af tempest-GroupSnapshotsTest-1880376477 None] Lock "cinder-quobyte-123f15b4-c97e-4684-a256-9b2c99c45e31" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:28:21 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-45c7e5a5-ab62-4fe9-b03b-6a4a1702b3af tempest-GroupSnapshotsTest-1880376477 None] Deleting offline snapshot 123f15b4-c97e-4684-a256-9b2c99c45e31 of volume 2f257612-dc56-4a89-af48-a89112430d72 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 16:28:21 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-45c7e5a5-ab62-4fe9-b03b-6a4a1702b3af tempest-GroupSnapshotsTest-1880376477 None] snapshot_file for this snap is: volume-2f257612-dc56-4a89-af48-a89112430d72.123f15b4-c97e-4684-a256-9b2c99c45e31 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 16:28:21 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0bf0f71-41f1-487c-892e-adcaa4f0bcd6]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:28:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-45c7e5a5-ab62-4fe9-b03b-6a4a1702b3af tempest-GroupSnapshotsTest-1880376477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2f257612-dc56-4a89-af48-a89112430d72.123f15b4-c97e-4684-a256-9b2c99c45e31 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:21 devstack sudo[93924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2f257612-dc56-4a89-af48-a89112430d72.123f15b4-c97e-4684-a256-9b2c99c45e31
Jul 14 16:28:21 devstack sudo[93924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:22 devstack sudo[93924]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-45c7e5a5-ab62-4fe9-b03b-6a4a1702b3af tempest-GroupSnapshotsTest-1880376477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2f257612-dc56-4a89-af48-a89112430d72.123f15b4-c97e-4684-a256-9b2c99c45e31" returned: 0 in 0.535s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:22 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-45c7e5a5-ab62-4fe9-b03b-6a4a1702b3af tempest-GroupSnapshotsTest-1880376477 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f257612-dc56-4a89-af48-a89112430d72(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 16:28:22 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f1dbc4-a58c-4522-9070-aec6a2e07e48]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:28:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-45c7e5a5-ab62-4fe9-b03b-6a4a1702b3af tempest-GroupSnapshotsTest-1880376477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2f257612-dc56-4a89-af48-a89112430d72 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:22 devstack sudo[93930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2f257612-dc56-4a89-af48-a89112430d72
Jul 14 16:28:22 devstack sudo[93930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:22 devstack sudo[93930]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-45c7e5a5-ab62-4fe9-b03b-6a4a1702b3af tempest-GroupSnapshotsTest-1880376477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2f257612-dc56-4a89-af48-a89112430d72" returned: 0 in 0.428s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-45c7e5a5-ab62-4fe9-b03b-6a4a1702b3af tempest-GroupSnapshotsTest-1880376477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2f257612-dc56-4a89-af48-a89112430d72.123f15b4-c97e-4684-a256-9b2c99c45e31 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:22 devstack sudo[93935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2f257612-dc56-4a89-af48-a89112430d72.123f15b4-c97e-4684-a256-9b2c99c45e31
Jul 14 16:28:22 devstack sudo[93935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:23 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f404eed-3848-492e-8bfc-27f96e1c784d tempest-VolumesSnapshotListTestJSON-857593009 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:28:23 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1f404eed-3848-492e-8bfc-27f96e1c784d tempest-VolumesSnapshotListTestJSON-857593009 None] Flow 'volume_create_manager' (e088749b-88f9-4c78-a83d-dfb424784a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:28:23 devstack sudo[93935]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:23 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1f404eed-3848-492e-8bfc-27f96e1c784d tempest-VolumesSnapshotListTestJSON-857593009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8324c123-824e-414c-a624-66a085ffbf9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:28:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-45c7e5a5-ab62-4fe9-b03b-6a4a1702b3af tempest-GroupSnapshotsTest-1880376477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2f257612-dc56-4a89-af48-a89112430d72.123f15b4-c97e-4684-a256-9b2c99c45e31" returned: 0 in 0.452s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-45c7e5a5-ab62-4fe9-b03b-6a4a1702b3af tempest-GroupSnapshotsTest-1880376477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2f257612-dc56-4a89-af48-a89112430d72.123f15b4-c97e-4684-a256-9b2c99c45e31 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:23 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1f404eed-3848-492e-8bfc-27f96e1c784d tempest-VolumesSnapshotListTestJSON-857593009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8324c123-824e-414c-a624-66a085ffbf9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:28:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-329638027',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7bd1186-6266-42ed-9569-4b9f4a034669,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4efdac7afc234f9798069cd1a2414098',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:28:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:28:23Z,use_quota=True,user_id='cb91fcdcefd74e598f65a7353b311d6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:28:23 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1f404eed-3848-492e-8bfc-27f96e1c784d tempest-VolumesSnapshotListTestJSON-857593009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b60ebb0-646c-451d-9547-633ec261e50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:28:23 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1f404eed-3848-492e-8bfc-27f96e1c784d tempest-VolumesSnapshotListTestJSON-857593009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b60ebb0-646c-451d-9547-633ec261e50b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:28:23 devstack sudo[93940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2f257612-dc56-4a89-af48-a89112430d72.123f15b4-c97e-4684-a256-9b2c99c45e31
Jul 14 16:28:23 devstack sudo[93940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:23 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1f404eed-3848-492e-8bfc-27f96e1c784d tempest-VolumesSnapshotListTestJSON-857593009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f884776-26ca-4ee9-9705-06dab847acbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:28:23 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1f404eed-3848-492e-8bfc-27f96e1c784d tempest-VolumesSnapshotListTestJSON-857593009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f884776-26ca-4ee9-9705-06dab847acbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7bd1186-6266-42ed-9569-4b9f4a034669', 'volume_name': 'volume-d7bd1186-6266-42ed-9569-4b9f4a034669', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:28:23 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1f404eed-3848-492e-8bfc-27f96e1c784d tempest-VolumesSnapshotListTestJSON-857593009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e3ba045-e74e-4b89-9518-efa25f6962dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:28:23 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1f404eed-3848-492e-8bfc-27f96e1c784d tempest-VolumesSnapshotListTestJSON-857593009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e3ba045-e74e-4b89-9518-efa25f6962dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:28:23 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1f404eed-3848-492e-8bfc-27f96e1c784d tempest-VolumesSnapshotListTestJSON-857593009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abb8393b-4a47-4813-857b-57c93e1d0901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:28:23 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-1f404eed-3848-492e-8bfc-27f96e1c784d tempest-VolumesSnapshotListTestJSON-857593009 None] Volume d7bd1186-6266-42ed-9569-4b9f4a034669: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7bd1186-6266-42ed-9569-4b9f4a034669', 'volume_size': 1}
Jul 14 16:28:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1f404eed-3848-492e-8bfc-27f96e1c784d tempest-VolumesSnapshotListTestJSON-857593009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:28:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1f404eed-3848-492e-8bfc-27f96e1c784d tempest-VolumesSnapshotListTestJSON-857593009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:28:23 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-1f404eed-3848-492e-8bfc-27f96e1c784d tempest-VolumesSnapshotListTestJSON-857593009 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:28:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-329638027',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7bd1186-6266-42ed-9569-4b9f4a034669,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4efdac7afc234f9798069cd1a2414098',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:28:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:28:23Z,use_quota=True,user_id='cb91fcdcefd74e598f65a7353b311d6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:28:23 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-1f404eed-3848-492e-8bfc-27f96e1c784d tempest-VolumesSnapshotListTestJSON-857593009 None] Creating volume d7bd1186-6266-42ed-9569-4b9f4a034669 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:28:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1f404eed-3848-492e-8bfc-27f96e1c784d tempest-VolumesSnapshotListTestJSON-857593009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:28:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1f404eed-3848-492e-8bfc-27f96e1c784d tempest-VolumesSnapshotListTestJSON-857593009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:28:23 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-1f404eed-3848-492e-8bfc-27f96e1c784d tempest-VolumesSnapshotListTestJSON-857593009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:28:23 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-1f404eed-3848-492e-8bfc-27f96e1c784d tempest-VolumesSnapshotListTestJSON-857593009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:28:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1f404eed-3848-492e-8bfc-27f96e1c784d tempest-VolumesSnapshotListTestJSON-857593009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:28:23 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-1f404eed-3848-492e-8bfc-27f96e1c784d tempest-VolumesSnapshotListTestJSON-857593009 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:28:23 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-1f404eed-3848-492e-8bfc-27f96e1c784d tempest-VolumesSnapshotListTestJSON-857593009 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:28:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1f404eed-3848-492e-8bfc-27f96e1c784d tempest-VolumesSnapshotListTestJSON-857593009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:23 devstack sudo[93942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669 1073741824
Jul 14 16:28:23 devstack sudo[93942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:23 devstack sudo[93940]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-45c7e5a5-ab62-4fe9-b03b-6a4a1702b3af tempest-GroupSnapshotsTest-1880376477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2f257612-dc56-4a89-af48-a89112430d72.123f15b4-c97e-4684-a256-9b2c99c45e31" returned: 0 in 0.278s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:23 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-45c7e5a5-ab62-4fe9-b03b-6a4a1702b3af tempest-GroupSnapshotsTest-1880376477 None] Lock "cinder-quobyte-123f15b4-c97e-4684-a256-9b2c99c45e31" released by "_delete_snapshot" :: held 1.831s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:28:23 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-45c7e5a5-ab62-4fe9-b03b-6a4a1702b3af tempest-GroupSnapshotsTest-1880376477 None] Lock "cinder-quobyte-2f257612-dc56-4a89-af48-a89112430d72" released by "delete_snapshot" :: held 1.865s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:28:23 devstack cinder-volume[87166]: WARNING cinder.quota [None req-45c7e5a5-ab62-4fe9-b03b-6a4a1702b3af tempest-GroupSnapshotsTest-1880376477 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1871177132 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1871177132, it is now deprecated. Please use the default quota class for default quota.
Jul 14 16:28:23 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-45c7e5a5-ab62-4fe9-b03b-6a4a1702b3af tempest-GroupSnapshotsTest-1880376477 None] Created reservations ['97ec00f9-fd8a-4552-b260-26a455c87300', 'baa08eac-042f-4fc8-90a9-23f3ef1d58c0', 'f3d67a27-08b6-43e9-9a97-965d0a36e58a', '067c9b9a-d38b-4d57-a2ca-d02933423580'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:28:23 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-45c7e5a5-ab62-4fe9-b03b-6a4a1702b3af tempest-GroupSnapshotsTest-1880376477 None] group_snapshot a6283812-e705-4140-9521-725516120dde: deleted successfully
Jul 14 16:28:23 devstack sudo[93942]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1f404eed-3848-492e-8bfc-27f96e1c784d tempest-VolumesSnapshotListTestJSON-857593009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669 1073741824" returned: 0 in 0.617s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1f404eed-3848-492e-8bfc-27f96e1c784d tempest-VolumesSnapshotListTestJSON-857593009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:23 devstack sudo[93955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669
Jul 14 16:28:23 devstack sudo[93955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:24 devstack sudo[93955]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1f404eed-3848-492e-8bfc-27f96e1c784d tempest-VolumesSnapshotListTestJSON-857593009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669" returned: 0 in 0.333s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:24 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-1f404eed-3848-492e-8bfc-27f96e1c784d tempest-VolumesSnapshotListTestJSON-857593009 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:28:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1f404eed-3848-492e-8bfc-27f96e1c784d tempest-VolumesSnapshotListTestJSON-857593009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:28:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1f404eed-3848-492e-8bfc-27f96e1c784d tempest-VolumesSnapshotListTestJSON-857593009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abb8393b-4a47-4813-857b-57c93e1d0901) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7bd1186-6266-42ed-9569-4b9f4a034669', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:28:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1f404eed-3848-492e-8bfc-27f96e1c784d tempest-VolumesSnapshotListTestJSON-857593009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbe307f9-d242-4a06-8cba-dda571a39553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:28:24 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-1f404eed-3848-492e-8bfc-27f96e1c784d tempest-VolumesSnapshotListTestJSON-857593009 None] Volume volume-d7bd1186-6266-42ed-9569-4b9f4a034669 (d7bd1186-6266-42ed-9569-4b9f4a034669): created successfully
Jul 14 16:28:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1f404eed-3848-492e-8bfc-27f96e1c784d tempest-VolumesSnapshotListTestJSON-857593009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbe307f9-d242-4a06-8cba-dda571a39553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:28:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1f404eed-3848-492e-8bfc-27f96e1c784d tempest-VolumesSnapshotListTestJSON-857593009 None] Flow 'volume_create_manager' (e088749b-88f9-4c78-a83d-dfb424784a01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:28:24 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-1f404eed-3848-492e-8bfc-27f96e1c784d tempest-VolumesSnapshotListTestJSON-857593009 None] Created volume successfully.
Jul 14 16:28:24 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2e386387-184c-480d-b1aa-b37898381236 tempest-GroupSnapshotsTest-1880376477 None] Acquiring lock "cinder-quobyte-2f257612-dc56-4a89-af48-a89112430d72" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:28:24 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2e386387-184c-480d-b1aa-b37898381236 tempest-GroupSnapshotsTest-1880376477 None] Lock "cinder-quobyte-2f257612-dc56-4a89-af48-a89112430d72" acquired by "delete_volume" :: waited 0.019s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:28:24 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3749a8d-4a6c-47f2-b258-e3893abdd3b1]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:28:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2e386387-184c-480d-b1aa-b37898381236 tempest-GroupSnapshotsTest-1880376477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2f257612-dc56-4a89-af48-a89112430d72 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:24 devstack sudo[93961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2f257612-dc56-4a89-af48-a89112430d72
Jul 14 16:28:24 devstack sudo[93961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:24 devstack sudo[93961]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2e386387-184c-480d-b1aa-b37898381236 tempest-GroupSnapshotsTest-1880376477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2f257612-dc56-4a89-af48-a89112430d72" returned: 0 in 0.395s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2e386387-184c-480d-b1aa-b37898381236 tempest-GroupSnapshotsTest-1880376477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2f257612-dc56-4a89-af48-a89112430d72 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:24 devstack sudo[93967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2f257612-dc56-4a89-af48-a89112430d72
Jul 14 16:28:24 devstack sudo[93967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:25 devstack sudo[93967]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2e386387-184c-480d-b1aa-b37898381236 tempest-GroupSnapshotsTest-1880376477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2f257612-dc56-4a89-af48-a89112430d72" returned: 0 in 0.277s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:25 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2e386387-184c-480d-b1aa-b37898381236 tempest-GroupSnapshotsTest-1880376477 None] Lock "cinder-quobyte-2f257612-dc56-4a89-af48-a89112430d72" released by "delete_volume" :: held 0.754s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:28:25 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-2e386387-184c-480d-b1aa-b37898381236 tempest-GroupSnapshotsTest-1880376477 None] Created reservations ['528967e4-87c6-4fbe-a8dc-c995db18764e'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:28:25 devstack cinder-volume[87166]: WARNING cinder.db.api [None req-2e386387-184c-480d-b1aa-b37898381236 tempest-GroupSnapshotsTest-1880376477 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1871177132']
Jul 14 16:28:25 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-2e386387-184c-480d-b1aa-b37898381236 tempest-GroupSnapshotsTest-1880376477 None] Created reservations ['92893299-1537-49db-b230-c5b98dc8e251', '074d6f04-a121-4fac-8249-1a1b9be43dd9', '0af9fef8-beb4-42e5-b37e-22c657b8f8dc', '80a92fde-0de7-4627-b12a-f5b68deea5c4'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:28:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2e386387-184c-480d-b1aa-b37898381236 tempest-GroupSnapshotsTest-1880376477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:28:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2e386387-184c-480d-b1aa-b37898381236 tempest-GroupSnapshotsTest-1880376477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:28:25 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2e386387-184c-480d-b1aa-b37898381236 tempest-GroupSnapshotsTest-1880376477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:28:25 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2e386387-184c-480d-b1aa-b37898381236 tempest-GroupSnapshotsTest-1880376477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:28:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2e386387-184c-480d-b1aa-b37898381236 tempest-GroupSnapshotsTest-1880376477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:28:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2e386387-184c-480d-b1aa-b37898381236 tempest-GroupSnapshotsTest-1880376477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:25 devstack sudo[93971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:28:25 devstack sudo[93971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b51b928f-a5a6-44b4-a77c-5e24aa72a61b tempest-VolumesSnapshotListTestJSON-857593009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:28:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b51b928f-a5a6-44b4-a77c-5e24aa72a61b tempest-VolumesSnapshotListTestJSON-857593009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:28:25 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-b51b928f-a5a6-44b4-a77c-5e24aa72a61b tempest-VolumesSnapshotListTestJSON-857593009 None] Creating offline snapshot 58a2dc54-bbef-47e3-8683-d762bba88090 of volume d7bd1186-6266-42ed-9569-4b9f4a034669 {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 16:28:25 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e93c896-cf75-47d2-8b71-85954ffa25f9]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:28:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b51b928f-a5a6-44b4-a77c-5e24aa72a61b tempest-VolumesSnapshotListTestJSON-857593009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:25 devstack sudo[93971]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2e386387-184c-480d-b1aa-b37898381236 tempest-GroupSnapshotsTest-1880376477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.381s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:25 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-2e386387-184c-480d-b1aa-b37898381236 tempest-GroupSnapshotsTest-1880376477 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:28:25 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-2e386387-184c-480d-b1aa-b37898381236 tempest-GroupSnapshotsTest-1880376477 None] Delete group completed successfully.
Jul 14 16:28:26 devstack sudo[93974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669
Jul 14 16:28:26 devstack sudo[93974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:26 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-590a9cc4-7d3f-41f2-b8e6-33d9fac90ea4 tempest-GroupSnapshotsTest-1880376477 None] Group tempest-GroupSnapshotsTest-Group-1715025442: creating
Jul 14 16:28:26 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-590a9cc4-7d3f-41f2-b8e6-33d9fac90ea4 tempest-GroupSnapshotsTest-1880376477 None] Group tempest-GroupSnapshotsTest-Group-1715025442: created successfully
Jul 14 16:28:26 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-590a9cc4-7d3f-41f2-b8e6-33d9fac90ea4 tempest-GroupSnapshotsTest-1880376477 None] Create group completed successfully.
Jul 14 16:28:26 devstack sudo[93974]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b51b928f-a5a6-44b4-a77c-5e24aa72a61b tempest-VolumesSnapshotListTestJSON-857593009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669" returned: 0 in 0.598s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b51b928f-a5a6-44b4-a77c-5e24aa72a61b tempest-VolumesSnapshotListTestJSON-857593009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669.58a2dc54-bbef-47e3-8683-d762bba88090 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:26 devstack sudo[93985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669.58a2dc54-bbef-47e3-8683-d762bba88090 1G
Jul 14 16:28:26 devstack sudo[93985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:27 devstack sudo[93985]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b51b928f-a5a6-44b4-a77c-5e24aa72a61b tempest-VolumesSnapshotListTestJSON-857593009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669.58a2dc54-bbef-47e3-8683-d762bba88090 1G" returned: 0 in 0.816s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b51b928f-a5a6-44b4-a77c-5e24aa72a61b tempest-VolumesSnapshotListTestJSON-857593009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7bd1186-6266-42ed-9569-4b9f4a034669 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669.58a2dc54-bbef-47e3-8683-d762bba88090 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:27 devstack sudo[94045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7bd1186-6266-42ed-9569-4b9f4a034669 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669.58a2dc54-bbef-47e3-8683-d762bba88090
Jul 14 16:28:27 devstack sudo[94045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:27 devstack sudo[94045]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b51b928f-a5a6-44b4-a77c-5e24aa72a61b tempest-VolumesSnapshotListTestJSON-857593009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7bd1186-6266-42ed-9569-4b9f4a034669 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669.58a2dc54-bbef-47e3-8683-d762bba88090" returned: 0 in 0.579s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:27 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-b51b928f-a5a6-44b4-a77c-5e24aa72a61b tempest-VolumesSnapshotListTestJSON-857593009 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669.58a2dc54-bbef-47e3-8683-d762bba88090 is being set with open permissions: ugo+rw
Jul 14 16:28:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b51b928f-a5a6-44b4-a77c-5e24aa72a61b tempest-VolumesSnapshotListTestJSON-857593009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669.58a2dc54-bbef-47e3-8683-d762bba88090 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:27 devstack sudo[94120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669.58a2dc54-bbef-47e3-8683-d762bba88090
Jul 14 16:28:27 devstack sudo[94120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:28 devstack sudo[94120]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b51b928f-a5a6-44b4-a77c-5e24aa72a61b tempest-VolumesSnapshotListTestJSON-857593009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669.58a2dc54-bbef-47e3-8683-d762bba88090" returned: 0 in 0.417s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b51b928f-a5a6-44b4-a77c-5e24aa72a61b tempest-VolumesSnapshotListTestJSON-857593009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:28 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4d6ca4a-ee41-44f4-b651-cd7dbc1364a0 tempest-GroupSnapshotsTest-1880376477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:28:28 devstack sudo[94130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669.info
Jul 14 16:28:28 devstack sudo[94130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:28 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c4d6ca4a-ee41-44f4-b651-cd7dbc1364a0 tempest-GroupSnapshotsTest-1880376477 None] Flow 'volume_create_manager' (0a428eee-0dca-4a64-ba6c-59ae6d9fe693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:28:28 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c4d6ca4a-ee41-44f4-b651-cd7dbc1364a0 tempest-GroupSnapshotsTest-1880376477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c9c33a6-6683-4e1d-97d8-7d82f319ce6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:28:28 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c4d6ca4a-ee41-44f4-b651-cd7dbc1364a0 tempest-GroupSnapshotsTest-1880376477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c9c33a6-6683-4e1d-97d8-7d82f319ce6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:28:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-288337729',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=3f4eccd4-d3d2-476f-85da-71968360be99,host='devstack@QuobyteHD#QuobyteHD',id=6d329737-20a7-45af-8dd3-28fa6339eec8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbdc2b87a94f462c9c15afe22ca87a42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:28:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:28:28Z,use_quota=True,user_id='c4899276ef4a456b979726b690a13ca1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c39f704f-dddb-47d2-b468-9688714d3218),volume_type_id=c39f704f-dddb-47d2-b468-9688714d3218)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:28:28 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c4d6ca4a-ee41-44f4-b651-cd7dbc1364a0 tempest-GroupSnapshotsTest-1880376477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34313f42-092e-4220-a119-0f2b9455a255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:28:28 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c4d6ca4a-ee41-44f4-b651-cd7dbc1364a0 tempest-GroupSnapshotsTest-1880376477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34313f42-092e-4220-a119-0f2b9455a255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:28:28 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c4d6ca4a-ee41-44f4-b651-cd7dbc1364a0 tempest-GroupSnapshotsTest-1880376477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e93285d6-5b24-4a78-a524-d56679163f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:28:28 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c4d6ca4a-ee41-44f4-b651-cd7dbc1364a0 tempest-GroupSnapshotsTest-1880376477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e93285d6-5b24-4a78-a524-d56679163f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d329737-20a7-45af-8dd3-28fa6339eec8', 'volume_name': 'volume-6d329737-20a7-45af-8dd3-28fa6339eec8', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:28:28 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c4d6ca4a-ee41-44f4-b651-cd7dbc1364a0 tempest-GroupSnapshotsTest-1880376477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a349dd4-67ab-4107-a2ce-b1b2e3d49216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:28:28 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c4d6ca4a-ee41-44f4-b651-cd7dbc1364a0 tempest-GroupSnapshotsTest-1880376477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a349dd4-67ab-4107-a2ce-b1b2e3d49216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:28:28 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c4d6ca4a-ee41-44f4-b651-cd7dbc1364a0 tempest-GroupSnapshotsTest-1880376477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33e24083-e8ea-406b-b575-6daa217a51d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:28:28 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-c4d6ca4a-ee41-44f4-b651-cd7dbc1364a0 tempest-GroupSnapshotsTest-1880376477 None] Volume 6d329737-20a7-45af-8dd3-28fa6339eec8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d329737-20a7-45af-8dd3-28fa6339eec8', 'volume_size': 1}
Jul 14 16:28:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c4d6ca4a-ee41-44f4-b651-cd7dbc1364a0 tempest-GroupSnapshotsTest-1880376477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:28:28 devstack sudo[94130]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b51b928f-a5a6-44b4-a77c-5e24aa72a61b tempest-VolumesSnapshotListTestJSON-857593009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669.info" returned: 0 in 0.452s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:28 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-b51b928f-a5a6-44b4-a77c-5e24aa72a61b tempest-VolumesSnapshotListTestJSON-857593009 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669.info is being set with open permissions: ugo+rw
Jul 14 16:28:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b51b928f-a5a6-44b4-a77c-5e24aa72a61b tempest-VolumesSnapshotListTestJSON-857593009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:28 devstack sudo[94327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669.info
Jul 14 16:28:28 devstack sudo[94327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:29 devstack sudo[94327]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b51b928f-a5a6-44b4-a77c-5e24aa72a61b tempest-VolumesSnapshotListTestJSON-857593009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669.info" returned: 0 in 0.339s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b51b928f-a5a6-44b4-a77c-5e24aa72a61b tempest-VolumesSnapshotListTestJSON-857593009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.440s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:28:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c4d6ca4a-ee41-44f4-b651-cd7dbc1364a0 tempest-GroupSnapshotsTest-1880376477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.621s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:28:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-c4d6ca4a-ee41-44f4-b651-cd7dbc1364a0 tempest-GroupSnapshotsTest-1880376477 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=3f4eccd4-d3d2-476f-85da-71968360be99,created_at=2026-07-14T14:28:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-288337729',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=3f4eccd4-d3d2-476f-85da-71968360be99,host='devstack@QuobyteHD#QuobyteHD',id=6d329737-20a7-45af-8dd3-28fa6339eec8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbdc2b87a94f462c9c15afe22ca87a42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:28:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:28:28Z,use_quota=True,user_id='c4899276ef4a456b979726b690a13ca1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c39f704f-dddb-47d2-b468-9688714d3218),volume_type_id=c39f704f-dddb-47d2-b468-9688714d3218)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:28:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-c4d6ca4a-ee41-44f4-b651-cd7dbc1364a0 tempest-GroupSnapshotsTest-1880376477 None] Creating volume 6d329737-20a7-45af-8dd3-28fa6339eec8 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:28:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c4d6ca4a-ee41-44f4-b651-cd7dbc1364a0 tempest-GroupSnapshotsTest-1880376477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:28:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c4d6ca4a-ee41-44f4-b651-cd7dbc1364a0 tempest-GroupSnapshotsTest-1880376477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:28:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-c4d6ca4a-ee41-44f4-b651-cd7dbc1364a0 tempest-GroupSnapshotsTest-1880376477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:28:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-c4d6ca4a-ee41-44f4-b651-cd7dbc1364a0 tempest-GroupSnapshotsTest-1880376477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:28:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c4d6ca4a-ee41-44f4-b651-cd7dbc1364a0 tempest-GroupSnapshotsTest-1880376477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:28:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-c4d6ca4a-ee41-44f4-b651-cd7dbc1364a0 tempest-GroupSnapshotsTest-1880376477 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:28:29 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-c4d6ca4a-ee41-44f4-b651-cd7dbc1364a0 tempest-GroupSnapshotsTest-1880376477 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:28:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c4d6ca4a-ee41-44f4-b651-cd7dbc1364a0 tempest-GroupSnapshotsTest-1880376477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6d329737-20a7-45af-8dd3-28fa6339eec8 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:29 devstack sudo[94503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6d329737-20a7-45af-8dd3-28fa6339eec8 1073741824
Jul 14 16:28:29 devstack sudo[94503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:29 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-b51b928f-a5a6-44b4-a77c-5e24aa72a61b tempest-VolumesSnapshotListTestJSON-857593009 None] Create snapshot completed successfully
Jul 14 16:28:30 devstack sudo[94503]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c4d6ca4a-ee41-44f4-b651-cd7dbc1364a0 tempest-GroupSnapshotsTest-1880376477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6d329737-20a7-45af-8dd3-28fa6339eec8 1073741824" returned: 0 in 0.831s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c4d6ca4a-ee41-44f4-b651-cd7dbc1364a0 tempest-GroupSnapshotsTest-1880376477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6d329737-20a7-45af-8dd3-28fa6339eec8 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:30 devstack sudo[94524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6d329737-20a7-45af-8dd3-28fa6339eec8
Jul 14 16:28:30 devstack sudo[94524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9da211fa-fca4-4e9a-aaaf-3378fabf5e3b tempest-VolumesSnapshotListTestJSON-857593009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:28:30 devstack sudo[94524]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c4d6ca4a-ee41-44f4-b651-cd7dbc1364a0 tempest-GroupSnapshotsTest-1880376477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6d329737-20a7-45af-8dd3-28fa6339eec8" returned: 0 in 0.425s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:30 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-c4d6ca4a-ee41-44f4-b651-cd7dbc1364a0 tempest-GroupSnapshotsTest-1880376477 None] <== create_volume: return (1340ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:28:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c4d6ca4a-ee41-44f4-b651-cd7dbc1364a0 tempest-GroupSnapshotsTest-1880376477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.347s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:28:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9da211fa-fca4-4e9a-aaaf-3378fabf5e3b tempest-VolumesSnapshotListTestJSON-857593009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.204s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:28:30 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c4d6ca4a-ee41-44f4-b651-cd7dbc1364a0 tempest-GroupSnapshotsTest-1880376477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33e24083-e8ea-406b-b575-6daa217a51d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d329737-20a7-45af-8dd3-28fa6339eec8', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:28:30 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c4d6ca4a-ee41-44f4-b651-cd7dbc1364a0 tempest-GroupSnapshotsTest-1880376477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef7ec5c9-9127-44ca-ba13-84f164964444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:28:30 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-9da211fa-fca4-4e9a-aaaf-3378fabf5e3b tempest-VolumesSnapshotListTestJSON-857593009 None] Creating offline snapshot edfb13a5-e07c-4293-9f77-be1bf25741f3 of volume d7bd1186-6266-42ed-9569-4b9f4a034669 {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 16:28:30 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-c4d6ca4a-ee41-44f4-b651-cd7dbc1364a0 tempest-GroupSnapshotsTest-1880376477 None] Volume volume-6d329737-20a7-45af-8dd3-28fa6339eec8 (6d329737-20a7-45af-8dd3-28fa6339eec8): created successfully
Jul 14 16:28:30 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c4d6ca4a-ee41-44f4-b651-cd7dbc1364a0 tempest-GroupSnapshotsTest-1880376477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef7ec5c9-9127-44ca-ba13-84f164964444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:28:30 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c4d6ca4a-ee41-44f4-b651-cd7dbc1364a0 tempest-GroupSnapshotsTest-1880376477 None] Flow 'volume_create_manager' (0a428eee-0dca-4a64-ba6c-59ae6d9fe693) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:28:30 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5ccc3f-8869-4c8f-806c-b65c3a56afeb]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:28:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9da211fa-fca4-4e9a-aaaf-3378fabf5e3b tempest-VolumesSnapshotListTestJSON-857593009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669.58a2dc54-bbef-47e3-8683-d762bba88090 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:30 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-c4d6ca4a-ee41-44f4-b651-cd7dbc1364a0 tempest-GroupSnapshotsTest-1880376477 None] Created volume successfully.
Jul 14 16:28:30 devstack sudo[94530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669.58a2dc54-bbef-47e3-8683-d762bba88090
Jul 14 16:28:30 devstack sudo[94530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:31 devstack sudo[94530]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9da211fa-fca4-4e9a-aaaf-3378fabf5e3b tempest-VolumesSnapshotListTestJSON-857593009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669.58a2dc54-bbef-47e3-8683-d762bba88090" returned: 0 in 0.771s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:31 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-9da211fa-fca4-4e9a-aaaf-3378fabf5e3b tempest-VolumesSnapshotListTestJSON-857593009 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7bd1186-6266-42ed-9569-4b9f4a034669(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 16:28:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9da211fa-fca4-4e9a-aaaf-3378fabf5e3b tempest-VolumesSnapshotListTestJSON-857593009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669.58a2dc54-bbef-47e3-8683-d762bba88090,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669.edfb13a5-e07c-4293-9f77-be1bf25741f3 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:31 devstack sudo[94548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669.58a2dc54-bbef-47e3-8683-d762bba88090,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669.edfb13a5-e07c-4293-9f77-be1bf25741f3 1G
Jul 14 16:28:31 devstack sudo[94548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:32 devstack sudo[94548]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9da211fa-fca4-4e9a-aaaf-3378fabf5e3b tempest-VolumesSnapshotListTestJSON-857593009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669.58a2dc54-bbef-47e3-8683-d762bba88090,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669.edfb13a5-e07c-4293-9f77-be1bf25741f3 1G" returned: 0 in 1.188s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9da211fa-fca4-4e9a-aaaf-3378fabf5e3b tempest-VolumesSnapshotListTestJSON-857593009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7bd1186-6266-42ed-9569-4b9f4a034669.58a2dc54-bbef-47e3-8683-d762bba88090 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669.edfb13a5-e07c-4293-9f77-be1bf25741f3 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:32 devstack sudo[94593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7bd1186-6266-42ed-9569-4b9f4a034669.58a2dc54-bbef-47e3-8683-d762bba88090 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669.edfb13a5-e07c-4293-9f77-be1bf25741f3
Jul 14 16:28:32 devstack sudo[94593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:33 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-d23e4722-e1ed-4fa6-bc40-36d9e01664f8 tempest-GroupSnapshotsTest-1880376477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:28:33 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d23e4722-e1ed-4fa6-bc40-36d9e01664f8 tempest-GroupSnapshotsTest-1880376477 None] Flow 'volume_create_manager' (96a354cb-1238-434a-91d9-e81ee4253fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:28:33 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d23e4722-e1ed-4fa6-bc40-36d9e01664f8 tempest-GroupSnapshotsTest-1880376477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25373fe8-73cd-42f5-b36f-9472b7190a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:28:33 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d23e4722-e1ed-4fa6-bc40-36d9e01664f8 tempest-GroupSnapshotsTest-1880376477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25373fe8-73cd-42f5-b36f-9472b7190a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:28:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1918624864',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=3f4eccd4-d3d2-476f-85da-71968360be99,host='devstack@QuobyteHD#QuobyteHD',id=ec03e3d2-83ad-4f47-9bcd-c3df8a10a839,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbdc2b87a94f462c9c15afe22ca87a42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:28:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:28:33Z,use_quota=True,user_id='c4899276ef4a456b979726b690a13ca1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c39f704f-dddb-47d2-b468-9688714d3218),volume_type_id=c39f704f-dddb-47d2-b468-9688714d3218)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:28:33 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d23e4722-e1ed-4fa6-bc40-36d9e01664f8 tempest-GroupSnapshotsTest-1880376477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf12b904-b1fc-4546-a776-35874ecd9a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:28:33 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d23e4722-e1ed-4fa6-bc40-36d9e01664f8 tempest-GroupSnapshotsTest-1880376477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf12b904-b1fc-4546-a776-35874ecd9a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:28:33 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d23e4722-e1ed-4fa6-bc40-36d9e01664f8 tempest-GroupSnapshotsTest-1880376477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cccc4631-a8a0-4d8e-9e47-b85f0a3c2175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:28:33 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d23e4722-e1ed-4fa6-bc40-36d9e01664f8 tempest-GroupSnapshotsTest-1880376477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cccc4631-a8a0-4d8e-9e47-b85f0a3c2175) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec03e3d2-83ad-4f47-9bcd-c3df8a10a839', 'volume_name': 'volume-ec03e3d2-83ad-4f47-9bcd-c3df8a10a839', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:28:33 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d23e4722-e1ed-4fa6-bc40-36d9e01664f8 tempest-GroupSnapshotsTest-1880376477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e94e632-75ec-4dab-8c9a-d26e03d5575b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:28:33 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d23e4722-e1ed-4fa6-bc40-36d9e01664f8 tempest-GroupSnapshotsTest-1880376477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e94e632-75ec-4dab-8c9a-d26e03d5575b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:28:33 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d23e4722-e1ed-4fa6-bc40-36d9e01664f8 tempest-GroupSnapshotsTest-1880376477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f4dd420-9d62-424e-be3f-94ebc81270b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:28:33 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-d23e4722-e1ed-4fa6-bc40-36d9e01664f8 tempest-GroupSnapshotsTest-1880376477 None] Volume ec03e3d2-83ad-4f47-9bcd-c3df8a10a839: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec03e3d2-83ad-4f47-9bcd-c3df8a10a839', 'volume_size': 1}
Jul 14 16:28:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d23e4722-e1ed-4fa6-bc40-36d9e01664f8 tempest-GroupSnapshotsTest-1880376477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:28:33 devstack sudo[94593]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9da211fa-fca4-4e9a-aaaf-3378fabf5e3b tempest-VolumesSnapshotListTestJSON-857593009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7bd1186-6266-42ed-9569-4b9f4a034669.58a2dc54-bbef-47e3-8683-d762bba88090 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669.edfb13a5-e07c-4293-9f77-be1bf25741f3" returned: 0 in 0.747s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:33 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-9da211fa-fca4-4e9a-aaaf-3378fabf5e3b tempest-VolumesSnapshotListTestJSON-857593009 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669.edfb13a5-e07c-4293-9f77-be1bf25741f3 is being set with open permissions: ugo+rw
Jul 14 16:28:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9da211fa-fca4-4e9a-aaaf-3378fabf5e3b tempest-VolumesSnapshotListTestJSON-857593009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669.edfb13a5-e07c-4293-9f77-be1bf25741f3 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:33 devstack sudo[94604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669.edfb13a5-e07c-4293-9f77-be1bf25741f3
Jul 14 16:28:33 devstack sudo[94604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:33 devstack sudo[94604]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9da211fa-fca4-4e9a-aaaf-3378fabf5e3b tempest-VolumesSnapshotListTestJSON-857593009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669.edfb13a5-e07c-4293-9f77-be1bf25741f3" returned: 0 in 0.445s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9da211fa-fca4-4e9a-aaaf-3378fabf5e3b tempest-VolumesSnapshotListTestJSON-857593009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.371s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:28:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d23e4722-e1ed-4fa6-bc40-36d9e01664f8 tempest-GroupSnapshotsTest-1880376477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.637s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:28:33 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d23e4722-e1ed-4fa6-bc40-36d9e01664f8 tempest-GroupSnapshotsTest-1880376477 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=3f4eccd4-d3d2-476f-85da-71968360be99,created_at=2026-07-14T14:28:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1918624864',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=3f4eccd4-d3d2-476f-85da-71968360be99,host='devstack@QuobyteHD#QuobyteHD',id=ec03e3d2-83ad-4f47-9bcd-c3df8a10a839,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbdc2b87a94f462c9c15afe22ca87a42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:28:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:28:33Z,use_quota=True,user_id='c4899276ef4a456b979726b690a13ca1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c39f704f-dddb-47d2-b468-9688714d3218),volume_type_id=c39f704f-dddb-47d2-b468-9688714d3218)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:28:33 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-d23e4722-e1ed-4fa6-bc40-36d9e01664f8 tempest-GroupSnapshotsTest-1880376477 None] Creating volume ec03e3d2-83ad-4f47-9bcd-c3df8a10a839 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:28:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d23e4722-e1ed-4fa6-bc40-36d9e01664f8 tempest-GroupSnapshotsTest-1880376477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:28:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d23e4722-e1ed-4fa6-bc40-36d9e01664f8 tempest-GroupSnapshotsTest-1880376477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:28:33 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d23e4722-e1ed-4fa6-bc40-36d9e01664f8 tempest-GroupSnapshotsTest-1880376477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:28:33 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d23e4722-e1ed-4fa6-bc40-36d9e01664f8 tempest-GroupSnapshotsTest-1880376477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:28:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d23e4722-e1ed-4fa6-bc40-36d9e01664f8 tempest-GroupSnapshotsTest-1880376477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:28:33 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d23e4722-e1ed-4fa6-bc40-36d9e01664f8 tempest-GroupSnapshotsTest-1880376477 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:28:33 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-d23e4722-e1ed-4fa6-bc40-36d9e01664f8 tempest-GroupSnapshotsTest-1880376477 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:28:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d23e4722-e1ed-4fa6-bc40-36d9e01664f8 tempest-GroupSnapshotsTest-1880376477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ec03e3d2-83ad-4f47-9bcd-c3df8a10a839 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:34 devstack sudo[94612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ec03e3d2-83ad-4f47-9bcd-c3df8a10a839 1073741824
Jul 14 16:28:34 devstack sudo[94612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:34 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-9da211fa-fca4-4e9a-aaaf-3378fabf5e3b tempest-VolumesSnapshotListTestJSON-857593009 None] Create snapshot completed successfully
Jul 14 16:28:34 devstack sudo[94612]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d23e4722-e1ed-4fa6-bc40-36d9e01664f8 tempest-GroupSnapshotsTest-1880376477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ec03e3d2-83ad-4f47-9bcd-c3df8a10a839 1073741824" returned: 0 in 0.557s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d23e4722-e1ed-4fa6-bc40-36d9e01664f8 tempest-GroupSnapshotsTest-1880376477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ec03e3d2-83ad-4f47-9bcd-c3df8a10a839 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:34 devstack sudo[94618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ec03e3d2-83ad-4f47-9bcd-c3df8a10a839
Jul 14 16:28:34 devstack sudo[94618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9954ebb6-43eb-40e7-a205-0ba131e74749 tempest-VolumesSnapshotListTestJSON-857593009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:28:35 devstack sudo[94618]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d23e4722-e1ed-4fa6-bc40-36d9e01664f8 tempest-GroupSnapshotsTest-1880376477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ec03e3d2-83ad-4f47-9bcd-c3df8a10a839" returned: 0 in 0.483s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d23e4722-e1ed-4fa6-bc40-36d9e01664f8 tempest-GroupSnapshotsTest-1880376477 None] <== create_volume: return (1130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:28:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d23e4722-e1ed-4fa6-bc40-36d9e01664f8 tempest-GroupSnapshotsTest-1880376477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:28:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9954ebb6-43eb-40e7-a205-0ba131e74749 tempest-VolumesSnapshotListTestJSON-857593009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.112s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:28:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-9954ebb6-43eb-40e7-a205-0ba131e74749 tempest-VolumesSnapshotListTestJSON-857593009 None] Creating offline snapshot 12519929-5a86-40e9-8552-3171cdd81aad of volume d7bd1186-6266-42ed-9569-4b9f4a034669 {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 16:28:35 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d23e4722-e1ed-4fa6-bc40-36d9e01664f8 tempest-GroupSnapshotsTest-1880376477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f4dd420-9d62-424e-be3f-94ebc81270b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec03e3d2-83ad-4f47-9bcd-c3df8a10a839', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:28:35 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d23e4722-e1ed-4fa6-bc40-36d9e01664f8 tempest-GroupSnapshotsTest-1880376477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ca84b35-758c-4a29-a24b-e1e8413cb50a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:28:35 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0078025-e6ec-4b5f-8c2b-154c399d501c]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:28:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9954ebb6-43eb-40e7-a205-0ba131e74749 tempest-VolumesSnapshotListTestJSON-857593009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669.edfb13a5-e07c-4293-9f77-be1bf25741f3 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:35 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-d23e4722-e1ed-4fa6-bc40-36d9e01664f8 tempest-GroupSnapshotsTest-1880376477 None] Volume volume-ec03e3d2-83ad-4f47-9bcd-c3df8a10a839 (ec03e3d2-83ad-4f47-9bcd-c3df8a10a839): created successfully
Jul 14 16:28:35 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d23e4722-e1ed-4fa6-bc40-36d9e01664f8 tempest-GroupSnapshotsTest-1880376477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ca84b35-758c-4a29-a24b-e1e8413cb50a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:28:35 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d23e4722-e1ed-4fa6-bc40-36d9e01664f8 tempest-GroupSnapshotsTest-1880376477 None] Flow 'volume_create_manager' (96a354cb-1238-434a-91d9-e81ee4253fd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:28:35 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-d23e4722-e1ed-4fa6-bc40-36d9e01664f8 tempest-GroupSnapshotsTest-1880376477 None] Created volume successfully.
Jul 14 16:28:35 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 16:28:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:28:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:28:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:28:35 devstack sudo[94621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669.edfb13a5-e07c-4293-9f77-be1bf25741f3
Jul 14 16:28:35 devstack sudo[94621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:28:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:28:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:35 devstack sudo[94623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:28:35 devstack sudo[94623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:35 devstack sudo[94623]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.422s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:35 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:28:35 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Running periodic task VolumeManager._thread_info {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 16:28:35 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] thread count: 8 {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 14 16:28:35 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] thread info: [<_MainThread(MainThread, started 128606490927232)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128606415432960)>, <Thread(Thread-3 (stat_writer), started daemon 128606378859328)>, <Thread(Rabbit-heartbeat, started daemon 128606379646144)>, <Thread(Thread-5 (_runner), started daemon 128606377685824)>, <Thread(Thread-7 (_runner), started daemon 128606377701888)>, <Thread(fd_logger, started daemon 128606377091392)>, <Thread(privsep_reader, started daemon 128606375782080)>] {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 14 16:28:36 devstack sudo[94621]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9954ebb6-43eb-40e7-a205-0ba131e74749 tempest-VolumesSnapshotListTestJSON-857593009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669.edfb13a5-e07c-4293-9f77-be1bf25741f3" returned: 0 in 0.822s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:36 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-9954ebb6-43eb-40e7-a205-0ba131e74749 tempest-VolumesSnapshotListTestJSON-857593009 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7bd1186-6266-42ed-9569-4b9f4a034669(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 16:28:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9954ebb6-43eb-40e7-a205-0ba131e74749 tempest-VolumesSnapshotListTestJSON-857593009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669.edfb13a5-e07c-4293-9f77-be1bf25741f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669.12519929-5a86-40e9-8552-3171cdd81aad 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:36 devstack sudo[94629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669.edfb13a5-e07c-4293-9f77-be1bf25741f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669.12519929-5a86-40e9-8552-3171cdd81aad 1G
Jul 14 16:28:36 devstack sudo[94629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:36 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-10065ad8-d94f-48f9-ada8-eb42db6da550 tempest-GroupSnapshotsTest-1880376477 None] Update group completed successfully.
Jul 14 16:28:36 devstack sudo[94629]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9954ebb6-43eb-40e7-a205-0ba131e74749 tempest-VolumesSnapshotListTestJSON-857593009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669.edfb13a5-e07c-4293-9f77-be1bf25741f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669.12519929-5a86-40e9-8552-3171cdd81aad 1G" returned: 0 in 0.858s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9954ebb6-43eb-40e7-a205-0ba131e74749 tempest-VolumesSnapshotListTestJSON-857593009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7bd1186-6266-42ed-9569-4b9f4a034669.edfb13a5-e07c-4293-9f77-be1bf25741f3 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669.12519929-5a86-40e9-8552-3171cdd81aad {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:36 devstack sudo[94638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7bd1186-6266-42ed-9569-4b9f4a034669.edfb13a5-e07c-4293-9f77-be1bf25741f3 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669.12519929-5a86-40e9-8552-3171cdd81aad
Jul 14 16:28:36 devstack sudo[94638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:37 devstack sudo[94638]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9954ebb6-43eb-40e7-a205-0ba131e74749 tempest-VolumesSnapshotListTestJSON-857593009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7bd1186-6266-42ed-9569-4b9f4a034669.edfb13a5-e07c-4293-9f77-be1bf25741f3 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669.12519929-5a86-40e9-8552-3171cdd81aad" returned: 0 in 0.427s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:37 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-9954ebb6-43eb-40e7-a205-0ba131e74749 tempest-VolumesSnapshotListTestJSON-857593009 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669.12519929-5a86-40e9-8552-3171cdd81aad is being set with open permissions: ugo+rw
Jul 14 16:28:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9954ebb6-43eb-40e7-a205-0ba131e74749 tempest-VolumesSnapshotListTestJSON-857593009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669.12519929-5a86-40e9-8552-3171cdd81aad {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:37 devstack sudo[94644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669.12519929-5a86-40e9-8552-3171cdd81aad
Jul 14 16:28:37 devstack sudo[94644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:37 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-05078540-4ae0-4227-9264-f1b9263da560 tempest-GroupSnapshotsTest-1880376477 None] Update group completed successfully.
Jul 14 16:28:37 devstack sudo[94644]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9954ebb6-43eb-40e7-a205-0ba131e74749 tempest-VolumesSnapshotListTestJSON-857593009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669.12519929-5a86-40e9-8552-3171cdd81aad" returned: 0 in 0.485s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9954ebb6-43eb-40e7-a205-0ba131e74749 tempest-VolumesSnapshotListTestJSON-857593009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.754s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:28:37 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-9954ebb6-43eb-40e7-a205-0ba131e74749 tempest-VolumesSnapshotListTestJSON-857593009 None] Create snapshot completed successfully
Jul 14 16:28:38 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-828010d9-95a3-46c5-a11b-677a2f6116b6 tempest-GroupSnapshotsTest-1880376477 None] Update group completed successfully.
Jul 14 16:28:39 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3a432ccb-bee5-45c8-b0eb-5d39d2d514cd tempest-VolumesSnapshotListTestJSON-857593009 None] Acquiring lock "cinder-12519929-5a86-40e9-8552-3171cdd81aad-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:28:39 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3a432ccb-bee5-45c8-b0eb-5d39d2d514cd tempest-VolumesSnapshotListTestJSON-857593009 None] Lock "cinder-12519929-5a86-40e9-8552-3171cdd81aad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:28:39 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3a432ccb-bee5-45c8-b0eb-5d39d2d514cd tempest-VolumesSnapshotListTestJSON-857593009 None] Acquiring lock "cinder-quobyte-d7bd1186-6266-42ed-9569-4b9f4a034669" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:28:39 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3a432ccb-bee5-45c8-b0eb-5d39d2d514cd tempest-VolumesSnapshotListTestJSON-857593009 None] Lock "cinder-quobyte-d7bd1186-6266-42ed-9569-4b9f4a034669" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:28:39 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3a432ccb-bee5-45c8-b0eb-5d39d2d514cd tempest-VolumesSnapshotListTestJSON-857593009 None] Acquiring lock "cinder-quobyte-12519929-5a86-40e9-8552-3171cdd81aad" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:28:39 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3a432ccb-bee5-45c8-b0eb-5d39d2d514cd tempest-VolumesSnapshotListTestJSON-857593009 None] Lock "cinder-quobyte-12519929-5a86-40e9-8552-3171cdd81aad" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:28:39 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-3a432ccb-bee5-45c8-b0eb-5d39d2d514cd tempest-VolumesSnapshotListTestJSON-857593009 None] Deleting offline snapshot 12519929-5a86-40e9-8552-3171cdd81aad of volume d7bd1186-6266-42ed-9569-4b9f4a034669 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 16:28:39 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-3a432ccb-bee5-45c8-b0eb-5d39d2d514cd tempest-VolumesSnapshotListTestJSON-857593009 None] snapshot_file for this snap is: volume-d7bd1186-6266-42ed-9569-4b9f4a034669.12519929-5a86-40e9-8552-3171cdd81aad {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 16:28:39 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc7d447-ce04-4e9c-873a-4da42679d379]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:28:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3a432ccb-bee5-45c8-b0eb-5d39d2d514cd tempest-VolumesSnapshotListTestJSON-857593009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669.12519929-5a86-40e9-8552-3171cdd81aad {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:39 devstack sudo[94648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669.12519929-5a86-40e9-8552-3171cdd81aad
Jul 14 16:28:39 devstack sudo[94648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:39 devstack sudo[94648]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3a432ccb-bee5-45c8-b0eb-5d39d2d514cd tempest-VolumesSnapshotListTestJSON-857593009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669.12519929-5a86-40e9-8552-3171cdd81aad" returned: 0 in 0.369s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:39 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-3a432ccb-bee5-45c8-b0eb-5d39d2d514cd tempest-VolumesSnapshotListTestJSON-857593009 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7bd1186-6266-42ed-9569-4b9f4a034669(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 16:28:39 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[da19ce53-9d1b-4803-85c1-3cdaaa41c3f8]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:28:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3a432ccb-bee5-45c8-b0eb-5d39d2d514cd tempest-VolumesSnapshotListTestJSON-857593009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669.edfb13a5-e07c-4293-9f77-be1bf25741f3 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:39 devstack sudo[94653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669.edfb13a5-e07c-4293-9f77-be1bf25741f3
Jul 14 16:28:39 devstack sudo[94653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:40 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-7e27475b-061a-49ba-aa87-3527420f6e12 tempest-GroupSnapshotsTest-1880376477 None] Update group completed successfully.
Jul 14 16:28:40 devstack sudo[94653]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3a432ccb-bee5-45c8-b0eb-5d39d2d514cd tempest-VolumesSnapshotListTestJSON-857593009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669.edfb13a5-e07c-4293-9f77-be1bf25741f3" returned: 0 in 0.496s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:40 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-3a432ccb-bee5-45c8-b0eb-5d39d2d514cd tempest-VolumesSnapshotListTestJSON-857593009 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7bd1186-6266-42ed-9569-4b9f4a034669(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 16:28:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3a432ccb-bee5-45c8-b0eb-5d39d2d514cd tempest-VolumesSnapshotListTestJSON-857593009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669.12519929-5a86-40e9-8552-3171cdd81aad {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:40 devstack sudo[94658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669.12519929-5a86-40e9-8552-3171cdd81aad
Jul 14 16:28:40 devstack sudo[94658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:40 devstack sudo[94658]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3a432ccb-bee5-45c8-b0eb-5d39d2d514cd tempest-VolumesSnapshotListTestJSON-857593009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669.12519929-5a86-40e9-8552-3171cdd81aad" returned: 0 in 0.429s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3a432ccb-bee5-45c8-b0eb-5d39d2d514cd tempest-VolumesSnapshotListTestJSON-857593009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669.12519929-5a86-40e9-8552-3171cdd81aad {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:40 devstack sudo[94663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669.12519929-5a86-40e9-8552-3171cdd81aad
Jul 14 16:28:40 devstack sudo[94663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:40 devstack sudo[94663]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3a432ccb-bee5-45c8-b0eb-5d39d2d514cd tempest-VolumesSnapshotListTestJSON-857593009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669.12519929-5a86-40e9-8552-3171cdd81aad" returned: 0 in 0.256s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:40 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3a432ccb-bee5-45c8-b0eb-5d39d2d514cd tempest-VolumesSnapshotListTestJSON-857593009 None] Lock "cinder-quobyte-12519929-5a86-40e9-8552-3171cdd81aad" released by "_delete_snapshot" :: held 1.636s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:28:40 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3a432ccb-bee5-45c8-b0eb-5d39d2d514cd tempest-VolumesSnapshotListTestJSON-857593009 None] Lock "cinder-quobyte-d7bd1186-6266-42ed-9569-4b9f4a034669" released by "delete_snapshot" :: held 1.668s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:28:40 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:UPDATE=92,cinder:SELECT=105,cinder:DELETE=7,cinder:INSERT=15 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 16:28:40 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:SELECT=85,cinder:INSERT=23,cinder:UPDATE=90,cinder:DELETE=7 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 16:28:40 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-3a432ccb-bee5-45c8-b0eb-5d39d2d514cd tempest-VolumesSnapshotListTestJSON-857593009 None] Created reservations ['3f2a55c1-86d2-4daf-8a1e-e0a2544f3b12', '8d9d67e8-9538-41fb-bc61-9637c3609280', 'b2acf470-77c4-42c4-a1fd-60ac8515ccd8', '6e194e4b-de5a-4c6f-8909-e2d559bb191b'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:28:40 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-3a432ccb-bee5-45c8-b0eb-5d39d2d514cd tempest-VolumesSnapshotListTestJSON-857593009 None] Delete snapshot completed successfully.
Jul 14 16:28:41 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3a432ccb-bee5-45c8-b0eb-5d39d2d514cd tempest-VolumesSnapshotListTestJSON-857593009 None] Lock "cinder-12519929-5a86-40e9-8552-3171cdd81aad-delete_snapshot" released by "delete_snapshot" :: held 1.859s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:28:41 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-1e580894-e491-49ed-be27-911ab9d42bb8 tempest-VolumesSnapshotListTestJSON-857593009 None] Acquiring lock "cinder-edfb13a5-e07c-4293-9f77-be1bf25741f3-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:28:41 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-1e580894-e491-49ed-be27-911ab9d42bb8 tempest-VolumesSnapshotListTestJSON-857593009 None] Lock "cinder-edfb13a5-e07c-4293-9f77-be1bf25741f3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:28:41 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-1e580894-e491-49ed-be27-911ab9d42bb8 tempest-VolumesSnapshotListTestJSON-857593009 None] Acquiring lock "cinder-quobyte-d7bd1186-6266-42ed-9569-4b9f4a034669" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:28:41 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-1e580894-e491-49ed-be27-911ab9d42bb8 tempest-VolumesSnapshotListTestJSON-857593009 None] Lock "cinder-quobyte-d7bd1186-6266-42ed-9569-4b9f4a034669" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:28:41 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-1e580894-e491-49ed-be27-911ab9d42bb8 tempest-VolumesSnapshotListTestJSON-857593009 None] Acquiring lock "cinder-quobyte-edfb13a5-e07c-4293-9f77-be1bf25741f3" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:28:41 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-1e580894-e491-49ed-be27-911ab9d42bb8 tempest-VolumesSnapshotListTestJSON-857593009 None] Lock "cinder-quobyte-edfb13a5-e07c-4293-9f77-be1bf25741f3" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:28:41 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-1e580894-e491-49ed-be27-911ab9d42bb8 tempest-VolumesSnapshotListTestJSON-857593009 None] Deleting offline snapshot edfb13a5-e07c-4293-9f77-be1bf25741f3 of volume d7bd1186-6266-42ed-9569-4b9f4a034669 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 16:28:41 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-1e580894-e491-49ed-be27-911ab9d42bb8 tempest-VolumesSnapshotListTestJSON-857593009 None] snapshot_file for this snap is: volume-d7bd1186-6266-42ed-9569-4b9f4a034669.edfb13a5-e07c-4293-9f77-be1bf25741f3 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 16:28:41 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[16748b2e-c7dc-4769-b9df-e20bf51f1215]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:28:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1e580894-e491-49ed-be27-911ab9d42bb8 tempest-VolumesSnapshotListTestJSON-857593009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669.edfb13a5-e07c-4293-9f77-be1bf25741f3 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:41 devstack sudo[94666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669.edfb13a5-e07c-4293-9f77-be1bf25741f3
Jul 14 16:28:41 devstack sudo[94666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:41 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-49ff7fb8-c1b5-4cb0-a4bb-d182b39f326c tempest-GroupSnapshotsTest-1880376477 None] GroupSnapshot b1ce61bc-ea2d-4832-920c-b16fd22392ca: creating.
Jul 14 16:28:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-49ff7fb8-c1b5-4cb0-a4bb-d182b39f326c tempest-GroupSnapshotsTest-1880376477 None] Group snapshot b1ce61bc-ea2d-4832-920c-b16fd22392ca: creating. {{(pid=87166) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 14 16:28:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-49ff7fb8-c1b5-4cb0-a4bb-d182b39f326c tempest-GroupSnapshotsTest-1880376477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:28:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-49ff7fb8-c1b5-4cb0-a4bb-d182b39f326c tempest-GroupSnapshotsTest-1880376477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:28:41 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-49ff7fb8-c1b5-4cb0-a4bb-d182b39f326c tempest-GroupSnapshotsTest-1880376477 None] Creating offline snapshot 70a433f4-c89d-4ed6-bea0-48a5bb502a75 of volume ec03e3d2-83ad-4f47-9bcd-c3df8a10a839 {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 16:28:41 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[56490e9b-148d-42f9-9931-2b3a3daae512]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:28:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-49ff7fb8-c1b5-4cb0-a4bb-d182b39f326c tempest-GroupSnapshotsTest-1880376477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ec03e3d2-83ad-4f47-9bcd-c3df8a10a839 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:41 devstack sudo[94666]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1e580894-e491-49ed-be27-911ab9d42bb8 tempest-VolumesSnapshotListTestJSON-857593009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669.edfb13a5-e07c-4293-9f77-be1bf25741f3" returned: 0 in 0.524s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:41 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-1e580894-e491-49ed-be27-911ab9d42bb8 tempest-VolumesSnapshotListTestJSON-857593009 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7bd1186-6266-42ed-9569-4b9f4a034669(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 16:28:42 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a9b6b2-a53a-4e54-9eb9-67c8afefd476]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:28:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1e580894-e491-49ed-be27-911ab9d42bb8 tempest-VolumesSnapshotListTestJSON-857593009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669.58a2dc54-bbef-47e3-8683-d762bba88090 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:42 devstack sudo[94671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ec03e3d2-83ad-4f47-9bcd-c3df8a10a839
Jul 14 16:28:42 devstack sudo[94671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:42 devstack sudo[94672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669.58a2dc54-bbef-47e3-8683-d762bba88090
Jul 14 16:28:42 devstack sudo[94672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:42 devstack sudo[94671]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-49ff7fb8-c1b5-4cb0-a4bb-d182b39f326c tempest-GroupSnapshotsTest-1880376477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ec03e3d2-83ad-4f47-9bcd-c3df8a10a839" returned: 0 in 0.415s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-49ff7fb8-c1b5-4cb0-a4bb-d182b39f326c tempest-GroupSnapshotsTest-1880376477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ec03e3d2-83ad-4f47-9bcd-c3df8a10a839,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ec03e3d2-83ad-4f47-9bcd-c3df8a10a839.70a433f4-c89d-4ed6-bea0-48a5bb502a75 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:42 devstack sudo[94679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ec03e3d2-83ad-4f47-9bcd-c3df8a10a839,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ec03e3d2-83ad-4f47-9bcd-c3df8a10a839.70a433f4-c89d-4ed6-bea0-48a5bb502a75 1G
Jul 14 16:28:42 devstack sudo[94679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:42 devstack sudo[94672]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1e580894-e491-49ed-be27-911ab9d42bb8 tempest-VolumesSnapshotListTestJSON-857593009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669.58a2dc54-bbef-47e3-8683-d762bba88090" returned: 0 in 0.495s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:42 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-1e580894-e491-49ed-be27-911ab9d42bb8 tempest-VolumesSnapshotListTestJSON-857593009 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7bd1186-6266-42ed-9569-4b9f4a034669(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 16:28:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1e580894-e491-49ed-be27-911ab9d42bb8 tempest-VolumesSnapshotListTestJSON-857593009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669.edfb13a5-e07c-4293-9f77-be1bf25741f3 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:42 devstack sudo[94684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669.edfb13a5-e07c-4293-9f77-be1bf25741f3
Jul 14 16:28:42 devstack sudo[94684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:42 devstack sudo[94679]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-49ff7fb8-c1b5-4cb0-a4bb-d182b39f326c tempest-GroupSnapshotsTest-1880376477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ec03e3d2-83ad-4f47-9bcd-c3df8a10a839,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ec03e3d2-83ad-4f47-9bcd-c3df8a10a839.70a433f4-c89d-4ed6-bea0-48a5bb502a75 1G" returned: 0 in 0.478s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-49ff7fb8-c1b5-4cb0-a4bb-d182b39f326c tempest-GroupSnapshotsTest-1880376477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec03e3d2-83ad-4f47-9bcd-c3df8a10a839 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ec03e3d2-83ad-4f47-9bcd-c3df8a10a839.70a433f4-c89d-4ed6-bea0-48a5bb502a75 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:42 devstack sudo[94691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec03e3d2-83ad-4f47-9bcd-c3df8a10a839 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ec03e3d2-83ad-4f47-9bcd-c3df8a10a839.70a433f4-c89d-4ed6-bea0-48a5bb502a75
Jul 14 16:28:42 devstack sudo[94691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:43 devstack sudo[94684]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1e580894-e491-49ed-be27-911ab9d42bb8 tempest-VolumesSnapshotListTestJSON-857593009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669.edfb13a5-e07c-4293-9f77-be1bf25741f3" returned: 0 in 0.507s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1e580894-e491-49ed-be27-911ab9d42bb8 tempest-VolumesSnapshotListTestJSON-857593009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669.edfb13a5-e07c-4293-9f77-be1bf25741f3 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:43 devstack sudo[94694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669.edfb13a5-e07c-4293-9f77-be1bf25741f3
Jul 14 16:28:43 devstack sudo[94694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:43 devstack sudo[94691]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-49ff7fb8-c1b5-4cb0-a4bb-d182b39f326c tempest-GroupSnapshotsTest-1880376477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec03e3d2-83ad-4f47-9bcd-c3df8a10a839 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ec03e3d2-83ad-4f47-9bcd-c3df8a10a839.70a433f4-c89d-4ed6-bea0-48a5bb502a75" returned: 0 in 0.344s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:43 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-49ff7fb8-c1b5-4cb0-a4bb-d182b39f326c tempest-GroupSnapshotsTest-1880376477 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ec03e3d2-83ad-4f47-9bcd-c3df8a10a839.70a433f4-c89d-4ed6-bea0-48a5bb502a75 is being set with open permissions: ugo+rw: NotImplementedError
Jul 14 16:28:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-49ff7fb8-c1b5-4cb0-a4bb-d182b39f326c tempest-GroupSnapshotsTest-1880376477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ec03e3d2-83ad-4f47-9bcd-c3df8a10a839.70a433f4-c89d-4ed6-bea0-48a5bb502a75 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:43 devstack sudo[94700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ec03e3d2-83ad-4f47-9bcd-c3df8a10a839.70a433f4-c89d-4ed6-bea0-48a5bb502a75
Jul 14 16:28:43 devstack sudo[94700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:43 devstack sudo[94694]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1e580894-e491-49ed-be27-911ab9d42bb8 tempest-VolumesSnapshotListTestJSON-857593009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669.edfb13a5-e07c-4293-9f77-be1bf25741f3" returned: 0 in 0.369s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:43 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-1e580894-e491-49ed-be27-911ab9d42bb8 tempest-VolumesSnapshotListTestJSON-857593009 None] Lock "cinder-quobyte-edfb13a5-e07c-4293-9f77-be1bf25741f3" released by "_delete_snapshot" :: held 2.014s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:28:43 devstack sudo[94700]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:43 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-1e580894-e491-49ed-be27-911ab9d42bb8 tempest-VolumesSnapshotListTestJSON-857593009 None] Lock "cinder-quobyte-d7bd1186-6266-42ed-9569-4b9f4a034669" released by "delete_snapshot" :: held 2.044s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:28:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-49ff7fb8-c1b5-4cb0-a4bb-d182b39f326c tempest-GroupSnapshotsTest-1880376477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ec03e3d2-83ad-4f47-9bcd-c3df8a10a839.70a433f4-c89d-4ed6-bea0-48a5bb502a75" returned: 0 in 0.290s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-49ff7fb8-c1b5-4cb0-a4bb-d182b39f326c tempest-GroupSnapshotsTest-1880376477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ec03e3d2-83ad-4f47-9bcd-c3df8a10a839.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:43 devstack sudo[94704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ec03e3d2-83ad-4f47-9bcd-c3df8a10a839.info
Jul 14 16:28:43 devstack sudo[94704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:43 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-1e580894-e491-49ed-be27-911ab9d42bb8 tempest-VolumesSnapshotListTestJSON-857593009 None] Created reservations ['cd439423-7c4d-4f1f-8478-938f82ea78b1', 'a59c3153-09ca-4755-b2fe-b7689ae885ce', '0eb33228-8882-4aef-afda-c67a1b214354', '05626767-8f62-4332-a4cf-7374a8672b6b'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:28:43 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-1e580894-e491-49ed-be27-911ab9d42bb8 tempest-VolumesSnapshotListTestJSON-857593009 None] Delete snapshot completed successfully.
Jul 14 16:28:43 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-1e580894-e491-49ed-be27-911ab9d42bb8 tempest-VolumesSnapshotListTestJSON-857593009 None] Lock "cinder-edfb13a5-e07c-4293-9f77-be1bf25741f3-delete_snapshot" released by "delete_snapshot" :: held 2.256s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:28:43 devstack sudo[94704]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-49ff7fb8-c1b5-4cb0-a4bb-d182b39f326c tempest-GroupSnapshotsTest-1880376477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ec03e3d2-83ad-4f47-9bcd-c3df8a10a839.info" returned: 0 in 0.325s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:43 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-49ff7fb8-c1b5-4cb0-a4bb-d182b39f326c tempest-GroupSnapshotsTest-1880376477 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ec03e3d2-83ad-4f47-9bcd-c3df8a10a839.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 14 16:28:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-49ff7fb8-c1b5-4cb0-a4bb-d182b39f326c tempest-GroupSnapshotsTest-1880376477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ec03e3d2-83ad-4f47-9bcd-c3df8a10a839.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:43 devstack sudo[94707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ec03e3d2-83ad-4f47-9bcd-c3df8a10a839.info
Jul 14 16:28:43 devstack sudo[94707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:44 devstack sudo[94707]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-49ff7fb8-c1b5-4cb0-a4bb-d182b39f326c tempest-GroupSnapshotsTest-1880376477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ec03e3d2-83ad-4f47-9bcd-c3df8a10a839.info" returned: 0 in 0.291s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-49ff7fb8-c1b5-4cb0-a4bb-d182b39f326c tempest-GroupSnapshotsTest-1880376477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.254s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:28:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-49ff7fb8-c1b5-4cb0-a4bb-d182b39f326c tempest-GroupSnapshotsTest-1880376477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:28:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-49ff7fb8-c1b5-4cb0-a4bb-d182b39f326c tempest-GroupSnapshotsTest-1880376477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:28:44 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-49ff7fb8-c1b5-4cb0-a4bb-d182b39f326c tempest-GroupSnapshotsTest-1880376477 None] Creating offline snapshot ef9a83ce-8205-4591-a7f1-acc356dff7a6 of volume 6d329737-20a7-45af-8dd3-28fa6339eec8 {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 16:28:44 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd6a88b-6f43-40ea-a655-a89e0a385e42]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:28:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-49ff7fb8-c1b5-4cb0-a4bb-d182b39f326c tempest-GroupSnapshotsTest-1880376477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6d329737-20a7-45af-8dd3-28fa6339eec8 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:44 devstack sudo[94718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6d329737-20a7-45af-8dd3-28fa6339eec8
Jul 14 16:28:44 devstack sudo[94718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:44 devstack sudo[94718]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-49ff7fb8-c1b5-4cb0-a4bb-d182b39f326c tempest-GroupSnapshotsTest-1880376477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6d329737-20a7-45af-8dd3-28fa6339eec8" returned: 0 in 0.425s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-49ff7fb8-c1b5-4cb0-a4bb-d182b39f326c tempest-GroupSnapshotsTest-1880376477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6d329737-20a7-45af-8dd3-28fa6339eec8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6d329737-20a7-45af-8dd3-28fa6339eec8.ef9a83ce-8205-4591-a7f1-acc356dff7a6 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:44 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f6426c4d-dbb1-4914-9c95-05c2b76b8924 tempest-VolumesSnapshotListTestJSON-857593009 None] Acquiring lock "cinder-58a2dc54-bbef-47e3-8683-d762bba88090-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:28:44 devstack sudo[94725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6d329737-20a7-45af-8dd3-28fa6339eec8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6d329737-20a7-45af-8dd3-28fa6339eec8.ef9a83ce-8205-4591-a7f1-acc356dff7a6 1G
Jul 14 16:28:44 devstack sudo[94725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:44 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f6426c4d-dbb1-4914-9c95-05c2b76b8924 tempest-VolumesSnapshotListTestJSON-857593009 None] Lock "cinder-58a2dc54-bbef-47e3-8683-d762bba88090-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:28:44 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f6426c4d-dbb1-4914-9c95-05c2b76b8924 tempest-VolumesSnapshotListTestJSON-857593009 None] Acquiring lock "cinder-quobyte-d7bd1186-6266-42ed-9569-4b9f4a034669" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:28:44 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f6426c4d-dbb1-4914-9c95-05c2b76b8924 tempest-VolumesSnapshotListTestJSON-857593009 None] Lock "cinder-quobyte-d7bd1186-6266-42ed-9569-4b9f4a034669" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:28:44 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f6426c4d-dbb1-4914-9c95-05c2b76b8924 tempest-VolumesSnapshotListTestJSON-857593009 None] Acquiring lock "cinder-quobyte-58a2dc54-bbef-47e3-8683-d762bba88090" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:28:44 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f6426c4d-dbb1-4914-9c95-05c2b76b8924 tempest-VolumesSnapshotListTestJSON-857593009 None] Lock "cinder-quobyte-58a2dc54-bbef-47e3-8683-d762bba88090" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:28:44 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-f6426c4d-dbb1-4914-9c95-05c2b76b8924 tempest-VolumesSnapshotListTestJSON-857593009 None] Deleting offline snapshot 58a2dc54-bbef-47e3-8683-d762bba88090 of volume d7bd1186-6266-42ed-9569-4b9f4a034669 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 16:28:44 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-f6426c4d-dbb1-4914-9c95-05c2b76b8924 tempest-VolumesSnapshotListTestJSON-857593009 None] snapshot_file for this snap is: volume-d7bd1186-6266-42ed-9569-4b9f4a034669.58a2dc54-bbef-47e3-8683-d762bba88090 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 16:28:44 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f18946-0f62-4106-87bc-def85d878df5]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:28:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f6426c4d-dbb1-4914-9c95-05c2b76b8924 tempest-VolumesSnapshotListTestJSON-857593009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669.58a2dc54-bbef-47e3-8683-d762bba88090 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:44 devstack sudo[94727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669.58a2dc54-bbef-47e3-8683-d762bba88090
Jul 14 16:28:44 devstack sudo[94727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:45 devstack sudo[94725]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-49ff7fb8-c1b5-4cb0-a4bb-d182b39f326c tempest-GroupSnapshotsTest-1880376477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6d329737-20a7-45af-8dd3-28fa6339eec8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6d329737-20a7-45af-8dd3-28fa6339eec8.ef9a83ce-8205-4591-a7f1-acc356dff7a6 1G" returned: 0 in 0.509s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-49ff7fb8-c1b5-4cb0-a4bb-d182b39f326c tempest-GroupSnapshotsTest-1880376477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d329737-20a7-45af-8dd3-28fa6339eec8 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6d329737-20a7-45af-8dd3-28fa6339eec8.ef9a83ce-8205-4591-a7f1-acc356dff7a6 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:45 devstack sudo[94732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d329737-20a7-45af-8dd3-28fa6339eec8 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6d329737-20a7-45af-8dd3-28fa6339eec8.ef9a83ce-8205-4591-a7f1-acc356dff7a6
Jul 14 16:28:45 devstack sudo[94732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:45 devstack sudo[94727]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f6426c4d-dbb1-4914-9c95-05c2b76b8924 tempest-VolumesSnapshotListTestJSON-857593009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669.58a2dc54-bbef-47e3-8683-d762bba88090" returned: 0 in 0.418s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:45 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-f6426c4d-dbb1-4914-9c95-05c2b76b8924 tempest-VolumesSnapshotListTestJSON-857593009 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7bd1186-6266-42ed-9569-4b9f4a034669(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 16:28:45 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e66906-ec6b-4ae9-99e5-0f9595ee05ca]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:28:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f6426c4d-dbb1-4914-9c95-05c2b76b8924 tempest-VolumesSnapshotListTestJSON-857593009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:45 devstack sudo[94738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669
Jul 14 16:28:45 devstack sudo[94738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:45 devstack sudo[94732]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-49ff7fb8-c1b5-4cb0-a4bb-d182b39f326c tempest-GroupSnapshotsTest-1880376477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d329737-20a7-45af-8dd3-28fa6339eec8 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6d329737-20a7-45af-8dd3-28fa6339eec8.ef9a83ce-8205-4591-a7f1-acc356dff7a6" returned: 0 in 0.327s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:45 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-49ff7fb8-c1b5-4cb0-a4bb-d182b39f326c tempest-GroupSnapshotsTest-1880376477 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6d329737-20a7-45af-8dd3-28fa6339eec8.ef9a83ce-8205-4591-a7f1-acc356dff7a6 is being set with open permissions: ugo+rw: NotImplementedError
Jul 14 16:28:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-49ff7fb8-c1b5-4cb0-a4bb-d182b39f326c tempest-GroupSnapshotsTest-1880376477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6d329737-20a7-45af-8dd3-28fa6339eec8.ef9a83ce-8205-4591-a7f1-acc356dff7a6 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:45 devstack sudo[94744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6d329737-20a7-45af-8dd3-28fa6339eec8.ef9a83ce-8205-4591-a7f1-acc356dff7a6
Jul 14 16:28:45 devstack sudo[94744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:45 devstack sudo[94738]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f6426c4d-dbb1-4914-9c95-05c2b76b8924 tempest-VolumesSnapshotListTestJSON-857593009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669" returned: 0 in 0.393s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f6426c4d-dbb1-4914-9c95-05c2b76b8924 tempest-VolumesSnapshotListTestJSON-857593009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669.58a2dc54-bbef-47e3-8683-d762bba88090 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:45 devstack sudo[94749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669.58a2dc54-bbef-47e3-8683-d762bba88090
Jul 14 16:28:45 devstack sudo[94749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:45 devstack sudo[94744]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-49ff7fb8-c1b5-4cb0-a4bb-d182b39f326c tempest-GroupSnapshotsTest-1880376477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6d329737-20a7-45af-8dd3-28fa6339eec8.ef9a83ce-8205-4591-a7f1-acc356dff7a6" returned: 0 in 0.288s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-49ff7fb8-c1b5-4cb0-a4bb-d182b39f326c tempest-GroupSnapshotsTest-1880376477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6d329737-20a7-45af-8dd3-28fa6339eec8.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:45 devstack sudo[94752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6d329737-20a7-45af-8dd3-28fa6339eec8.info
Jul 14 16:28:45 devstack sudo[94752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:45 devstack sudo[94749]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f6426c4d-dbb1-4914-9c95-05c2b76b8924 tempest-VolumesSnapshotListTestJSON-857593009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669.58a2dc54-bbef-47e3-8683-d762bba88090" returned: 0 in 0.334s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f6426c4d-dbb1-4914-9c95-05c2b76b8924 tempest-VolumesSnapshotListTestJSON-857593009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669.58a2dc54-bbef-47e3-8683-d762bba88090 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:45 devstack sudo[94758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669.58a2dc54-bbef-47e3-8683-d762bba88090
Jul 14 16:28:45 devstack sudo[94758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:46 devstack sudo[94752]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-49ff7fb8-c1b5-4cb0-a4bb-d182b39f326c tempest-GroupSnapshotsTest-1880376477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6d329737-20a7-45af-8dd3-28fa6339eec8.info" returned: 0 in 0.264s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:46 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-49ff7fb8-c1b5-4cb0-a4bb-d182b39f326c tempest-GroupSnapshotsTest-1880376477 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6d329737-20a7-45af-8dd3-28fa6339eec8.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 14 16:28:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-49ff7fb8-c1b5-4cb0-a4bb-d182b39f326c tempest-GroupSnapshotsTest-1880376477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6d329737-20a7-45af-8dd3-28fa6339eec8.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:46 devstack sudo[94761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6d329737-20a7-45af-8dd3-28fa6339eec8.info
Jul 14 16:28:46 devstack sudo[94761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:46 devstack sudo[94758]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f6426c4d-dbb1-4914-9c95-05c2b76b8924 tempest-VolumesSnapshotListTestJSON-857593009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669.58a2dc54-bbef-47e3-8683-d762bba88090" returned: 0 in 0.254s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:46 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f6426c4d-dbb1-4914-9c95-05c2b76b8924 tempest-VolumesSnapshotListTestJSON-857593009 None] Lock "cinder-quobyte-58a2dc54-bbef-47e3-8683-d762bba88090" released by "_delete_snapshot" :: held 1.543s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:28:46 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f6426c4d-dbb1-4914-9c95-05c2b76b8924 tempest-VolumesSnapshotListTestJSON-857593009 None] Lock "cinder-quobyte-d7bd1186-6266-42ed-9569-4b9f4a034669" released by "delete_snapshot" :: held 1.572s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:28:46 devstack sudo[94761]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-49ff7fb8-c1b5-4cb0-a4bb-d182b39f326c tempest-GroupSnapshotsTest-1880376477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6d329737-20a7-45af-8dd3-28fa6339eec8.info" returned: 0 in 0.246s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-49ff7fb8-c1b5-4cb0-a4bb-d182b39f326c tempest-GroupSnapshotsTest-1880376477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.145s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:28:46 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-f6426c4d-dbb1-4914-9c95-05c2b76b8924 tempest-VolumesSnapshotListTestJSON-857593009 None] Created reservations ['7da6d7db-4667-485d-b346-11f327ef37e3', '6ab444e6-e237-4f44-9cac-17c2153dcddc', '988c4ee9-47fc-4a3b-a155-83f85b4d4340', '341a9aff-1d2b-4bc3-8e86-db827ebfc583'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:28:46 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-f6426c4d-dbb1-4914-9c95-05c2b76b8924 tempest-VolumesSnapshotListTestJSON-857593009 None] Delete snapshot completed successfully.
Jul 14 16:28:46 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-49ff7fb8-c1b5-4cb0-a4bb-d182b39f326c tempest-GroupSnapshotsTest-1880376477 None] group_snapshot b1ce61bc-ea2d-4832-920c-b16fd22392ca: created successfully
Jul 14 16:28:46 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f6426c4d-dbb1-4914-9c95-05c2b76b8924 tempest-VolumesSnapshotListTestJSON-857593009 None] Lock "cinder-58a2dc54-bbef-47e3-8683-d762bba88090-delete_snapshot" released by "delete_snapshot" :: held 1.774s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:28:46 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-095a42a8-61a5-43bf-b4ea-c6b24ef7ea09 tempest-VolumesSnapshotListTestJSON-857593009 None] Acquiring lock "cinder-d7bd1186-6266-42ed-9569-4b9f4a034669-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:28:46 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-095a42a8-61a5-43bf-b4ea-c6b24ef7ea09 tempest-VolumesSnapshotListTestJSON-857593009 None] Lock "cinder-d7bd1186-6266-42ed-9569-4b9f4a034669-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:28:46 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-095a42a8-61a5-43bf-b4ea-c6b24ef7ea09 tempest-VolumesSnapshotListTestJSON-857593009 None] Acquiring lock "cinder-quobyte-d7bd1186-6266-42ed-9569-4b9f4a034669" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:28:46 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-095a42a8-61a5-43bf-b4ea-c6b24ef7ea09 tempest-VolumesSnapshotListTestJSON-857593009 None] Lock "cinder-quobyte-d7bd1186-6266-42ed-9569-4b9f4a034669" acquired by "delete_volume" :: waited 0.022s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:28:47 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[2338b6a6-3456-46d7-b65c-0e1a36964386]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:28:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-095a42a8-61a5-43bf-b4ea-c6b24ef7ea09 tempest-VolumesSnapshotListTestJSON-857593009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:47 devstack sudo[94765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669
Jul 14 16:28:47 devstack sudo[94765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:47 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-7e782cac-e31d-4bdc-a101-86ab8f36db5a tempest-GroupSnapshotsTest-1880376477 None] group_snapshot b1ce61bc-ea2d-4832-920c-b16fd22392ca: deleting
Jul 14 16:28:47 devstack sudo[94765]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-095a42a8-61a5-43bf-b4ea-c6b24ef7ea09 tempest-VolumesSnapshotListTestJSON-857593009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669" returned: 0 in 0.436s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-095a42a8-61a5-43bf-b4ea-c6b24ef7ea09 tempest-VolumesSnapshotListTestJSON-857593009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:47 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-7e782cac-e31d-4bdc-a101-86ab8f36db5a tempest-GroupSnapshotsTest-1880376477 None] group_snapshot b1ce61bc-ea2d-4832-920c-b16fd22392ca: deleting {{(pid=87166) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 14 16:28:47 devstack sudo[94807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669
Jul 14 16:28:47 devstack sudo[94807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:47 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7e782cac-e31d-4bdc-a101-86ab8f36db5a tempest-GroupSnapshotsTest-1880376477 None] Acquiring lock "cinder-quobyte-ec03e3d2-83ad-4f47-9bcd-c3df8a10a839" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:28:47 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7e782cac-e31d-4bdc-a101-86ab8f36db5a tempest-GroupSnapshotsTest-1880376477 None] Lock "cinder-quobyte-ec03e3d2-83ad-4f47-9bcd-c3df8a10a839" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:28:47 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7e782cac-e31d-4bdc-a101-86ab8f36db5a tempest-GroupSnapshotsTest-1880376477 None] Acquiring lock "cinder-quobyte-70a433f4-c89d-4ed6-bea0-48a5bb502a75" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:28:47 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7e782cac-e31d-4bdc-a101-86ab8f36db5a tempest-GroupSnapshotsTest-1880376477 None] Lock "cinder-quobyte-70a433f4-c89d-4ed6-bea0-48a5bb502a75" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:28:47 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-7e782cac-e31d-4bdc-a101-86ab8f36db5a tempest-GroupSnapshotsTest-1880376477 None] Deleting offline snapshot 70a433f4-c89d-4ed6-bea0-48a5bb502a75 of volume ec03e3d2-83ad-4f47-9bcd-c3df8a10a839 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 16:28:47 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-7e782cac-e31d-4bdc-a101-86ab8f36db5a tempest-GroupSnapshotsTest-1880376477 None] snapshot_file for this snap is: volume-ec03e3d2-83ad-4f47-9bcd-c3df8a10a839.70a433f4-c89d-4ed6-bea0-48a5bb502a75 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 16:28:47 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0118fb-91e9-459b-a8fb-3996c03bae16]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:28:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7e782cac-e31d-4bdc-a101-86ab8f36db5a tempest-GroupSnapshotsTest-1880376477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ec03e3d2-83ad-4f47-9bcd-c3df8a10a839.70a433f4-c89d-4ed6-bea0-48a5bb502a75 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:47 devstack sudo[94809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ec03e3d2-83ad-4f47-9bcd-c3df8a10a839.70a433f4-c89d-4ed6-bea0-48a5bb502a75
Jul 14 16:28:47 devstack sudo[94809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:47 devstack sudo[94807]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-095a42a8-61a5-43bf-b4ea-c6b24ef7ea09 tempest-VolumesSnapshotListTestJSON-857593009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d7bd1186-6266-42ed-9569-4b9f4a034669" returned: 0 in 0.361s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:47 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-095a42a8-61a5-43bf-b4ea-c6b24ef7ea09 tempest-VolumesSnapshotListTestJSON-857593009 None] Lock "cinder-quobyte-d7bd1186-6266-42ed-9569-4b9f4a034669" released by "delete_volume" :: held 0.864s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:28:47 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-095a42a8-61a5-43bf-b4ea-c6b24ef7ea09 tempest-VolumesSnapshotListTestJSON-857593009 None] Created reservations ['9b062d24-9445-4307-9368-bfc7f60bdbe5', '59d17b16-19ec-447a-a4ff-d8a3e155bbd8', '12211efd-3dac-4f10-946f-78ef079707dd', 'a2efef39-5b7e-4716-ae46-aa582f46e43a'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:28:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-095a42a8-61a5-43bf-b4ea-c6b24ef7ea09 tempest-VolumesSnapshotListTestJSON-857593009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:28:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-095a42a8-61a5-43bf-b4ea-c6b24ef7ea09 tempest-VolumesSnapshotListTestJSON-857593009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:28:47 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-095a42a8-61a5-43bf-b4ea-c6b24ef7ea09 tempest-VolumesSnapshotListTestJSON-857593009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:28:47 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-095a42a8-61a5-43bf-b4ea-c6b24ef7ea09 tempest-VolumesSnapshotListTestJSON-857593009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:28:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-095a42a8-61a5-43bf-b4ea-c6b24ef7ea09 tempest-VolumesSnapshotListTestJSON-857593009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:28:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-095a42a8-61a5-43bf-b4ea-c6b24ef7ea09 tempest-VolumesSnapshotListTestJSON-857593009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:47 devstack sudo[94812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:28:47 devstack sudo[94812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:48 devstack sudo[94809]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7e782cac-e31d-4bdc-a101-86ab8f36db5a tempest-GroupSnapshotsTest-1880376477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ec03e3d2-83ad-4f47-9bcd-c3df8a10a839.70a433f4-c89d-4ed6-bea0-48a5bb502a75" returned: 0 in 0.462s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:48 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-7e782cac-e31d-4bdc-a101-86ab8f36db5a tempest-GroupSnapshotsTest-1880376477 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec03e3d2-83ad-4f47-9bcd-c3df8a10a839(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 16:28:48 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7e1ac8-9e17-4d48-94bf-f4f12ce5c4cf]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:28:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7e782cac-e31d-4bdc-a101-86ab8f36db5a tempest-GroupSnapshotsTest-1880376477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ec03e3d2-83ad-4f47-9bcd-c3df8a10a839 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:48 devstack sudo[94812]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-095a42a8-61a5-43bf-b4ea-c6b24ef7ea09 tempest-VolumesSnapshotListTestJSON-857593009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.281s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:48 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-095a42a8-61a5-43bf-b4ea-c6b24ef7ea09 tempest-VolumesSnapshotListTestJSON-857593009 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:28:48 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-095a42a8-61a5-43bf-b4ea-c6b24ef7ea09 tempest-VolumesSnapshotListTestJSON-857593009 None] Deleted volume successfully.
Jul 14 16:28:48 devstack sudo[94818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ec03e3d2-83ad-4f47-9bcd-c3df8a10a839
Jul 14 16:28:48 devstack sudo[94818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:48 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-095a42a8-61a5-43bf-b4ea-c6b24ef7ea09 tempest-VolumesSnapshotListTestJSON-857593009 None] Lock "cinder-d7bd1186-6266-42ed-9569-4b9f4a034669-delete_volume" released by "delete_volume" :: held 1.352s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:28:48 devstack sudo[94818]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7e782cac-e31d-4bdc-a101-86ab8f36db5a tempest-GroupSnapshotsTest-1880376477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ec03e3d2-83ad-4f47-9bcd-c3df8a10a839" returned: 0 in 0.390s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7e782cac-e31d-4bdc-a101-86ab8f36db5a tempest-GroupSnapshotsTest-1880376477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ec03e3d2-83ad-4f47-9bcd-c3df8a10a839.70a433f4-c89d-4ed6-bea0-48a5bb502a75 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:48 devstack sudo[94825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ec03e3d2-83ad-4f47-9bcd-c3df8a10a839.70a433f4-c89d-4ed6-bea0-48a5bb502a75
Jul 14 16:28:48 devstack sudo[94825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:48 devstack sudo[94825]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7e782cac-e31d-4bdc-a101-86ab8f36db5a tempest-GroupSnapshotsTest-1880376477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ec03e3d2-83ad-4f47-9bcd-c3df8a10a839.70a433f4-c89d-4ed6-bea0-48a5bb502a75" returned: 0 in 0.369s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7e782cac-e31d-4bdc-a101-86ab8f36db5a tempest-GroupSnapshotsTest-1880376477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ec03e3d2-83ad-4f47-9bcd-c3df8a10a839.70a433f4-c89d-4ed6-bea0-48a5bb502a75 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:48 devstack sudo[94833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ec03e3d2-83ad-4f47-9bcd-c3df8a10a839.70a433f4-c89d-4ed6-bea0-48a5bb502a75
Jul 14 16:28:48 devstack sudo[94833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:49 devstack sudo[94833]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7e782cac-e31d-4bdc-a101-86ab8f36db5a tempest-GroupSnapshotsTest-1880376477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ec03e3d2-83ad-4f47-9bcd-c3df8a10a839.70a433f4-c89d-4ed6-bea0-48a5bb502a75" returned: 0 in 0.237s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:49 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7e782cac-e31d-4bdc-a101-86ab8f36db5a tempest-GroupSnapshotsTest-1880376477 None] Lock "cinder-quobyte-70a433f4-c89d-4ed6-bea0-48a5bb502a75" released by "_delete_snapshot" :: held 1.585s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:28:49 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7e782cac-e31d-4bdc-a101-86ab8f36db5a tempest-GroupSnapshotsTest-1880376477 None] Lock "cinder-quobyte-ec03e3d2-83ad-4f47-9bcd-c3df8a10a839" released by "delete_snapshot" :: held 1.620s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:28:49 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7e782cac-e31d-4bdc-a101-86ab8f36db5a tempest-GroupSnapshotsTest-1880376477 None] Acquiring lock "cinder-quobyte-6d329737-20a7-45af-8dd3-28fa6339eec8" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:28:49 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7e782cac-e31d-4bdc-a101-86ab8f36db5a tempest-GroupSnapshotsTest-1880376477 None] Lock "cinder-quobyte-6d329737-20a7-45af-8dd3-28fa6339eec8" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:28:49 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7e782cac-e31d-4bdc-a101-86ab8f36db5a tempest-GroupSnapshotsTest-1880376477 None] Acquiring lock "cinder-quobyte-ef9a83ce-8205-4591-a7f1-acc356dff7a6" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:28:49 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7e782cac-e31d-4bdc-a101-86ab8f36db5a tempest-GroupSnapshotsTest-1880376477 None] Lock "cinder-quobyte-ef9a83ce-8205-4591-a7f1-acc356dff7a6" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:28:49 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-7e782cac-e31d-4bdc-a101-86ab8f36db5a tempest-GroupSnapshotsTest-1880376477 None] Deleting offline snapshot ef9a83ce-8205-4591-a7f1-acc356dff7a6 of volume 6d329737-20a7-45af-8dd3-28fa6339eec8 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 16:28:49 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-7e782cac-e31d-4bdc-a101-86ab8f36db5a tempest-GroupSnapshotsTest-1880376477 None] snapshot_file for this snap is: volume-6d329737-20a7-45af-8dd3-28fa6339eec8.ef9a83ce-8205-4591-a7f1-acc356dff7a6 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 16:28:49 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f78ee3-91cb-48da-9df8-42a88f7ea662]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:28:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7e782cac-e31d-4bdc-a101-86ab8f36db5a tempest-GroupSnapshotsTest-1880376477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6d329737-20a7-45af-8dd3-28fa6339eec8.ef9a83ce-8205-4591-a7f1-acc356dff7a6 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:49 devstack sudo[94836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6d329737-20a7-45af-8dd3-28fa6339eec8.ef9a83ce-8205-4591-a7f1-acc356dff7a6
Jul 14 16:28:49 devstack sudo[94836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:49 devstack sudo[94836]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7e782cac-e31d-4bdc-a101-86ab8f36db5a tempest-GroupSnapshotsTest-1880376477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6d329737-20a7-45af-8dd3-28fa6339eec8.ef9a83ce-8205-4591-a7f1-acc356dff7a6" returned: 0 in 0.412s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:49 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-7e782cac-e31d-4bdc-a101-86ab8f36db5a tempest-GroupSnapshotsTest-1880376477 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d329737-20a7-45af-8dd3-28fa6339eec8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 16:28:49 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[df0c8273-5570-43cd-a872-76c761182644]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:28:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7e782cac-e31d-4bdc-a101-86ab8f36db5a tempest-GroupSnapshotsTest-1880376477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6d329737-20a7-45af-8dd3-28fa6339eec8 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:49 devstack sudo[94841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6d329737-20a7-45af-8dd3-28fa6339eec8
Jul 14 16:28:49 devstack sudo[94841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:50 devstack sudo[94841]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7e782cac-e31d-4bdc-a101-86ab8f36db5a tempest-GroupSnapshotsTest-1880376477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6d329737-20a7-45af-8dd3-28fa6339eec8" returned: 0 in 0.431s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7e782cac-e31d-4bdc-a101-86ab8f36db5a tempest-GroupSnapshotsTest-1880376477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6d329737-20a7-45af-8dd3-28fa6339eec8.ef9a83ce-8205-4591-a7f1-acc356dff7a6 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:50 devstack sudo[94846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6d329737-20a7-45af-8dd3-28fa6339eec8.ef9a83ce-8205-4591-a7f1-acc356dff7a6
Jul 14 16:28:50 devstack sudo[94846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:50 devstack sudo[94846]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7e782cac-e31d-4bdc-a101-86ab8f36db5a tempest-GroupSnapshotsTest-1880376477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6d329737-20a7-45af-8dd3-28fa6339eec8.ef9a83ce-8205-4591-a7f1-acc356dff7a6" returned: 0 in 0.403s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7e782cac-e31d-4bdc-a101-86ab8f36db5a tempest-GroupSnapshotsTest-1880376477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6d329737-20a7-45af-8dd3-28fa6339eec8.ef9a83ce-8205-4591-a7f1-acc356dff7a6 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:50 devstack sudo[94851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6d329737-20a7-45af-8dd3-28fa6339eec8.ef9a83ce-8205-4591-a7f1-acc356dff7a6
Jul 14 16:28:50 devstack sudo[94851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:50 devstack sudo[94851]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7e782cac-e31d-4bdc-a101-86ab8f36db5a tempest-GroupSnapshotsTest-1880376477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6d329737-20a7-45af-8dd3-28fa6339eec8.ef9a83ce-8205-4591-a7f1-acc356dff7a6" returned: 0 in 0.297s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:50 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7e782cac-e31d-4bdc-a101-86ab8f36db5a tempest-GroupSnapshotsTest-1880376477 None] Lock "cinder-quobyte-ef9a83ce-8205-4591-a7f1-acc356dff7a6" released by "_delete_snapshot" :: held 1.658s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:28:50 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7e782cac-e31d-4bdc-a101-86ab8f36db5a tempest-GroupSnapshotsTest-1880376477 None] Lock "cinder-quobyte-6d329737-20a7-45af-8dd3-28fa6339eec8" released by "delete_snapshot" :: held 1.683s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:28:50 devstack cinder-volume[87166]: WARNING cinder.quota [None req-7e782cac-e31d-4bdc-a101-86ab8f36db5a tempest-GroupSnapshotsTest-1880376477 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2108063612 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2108063612, it is now deprecated. Please use the default quota class for default quota.
Jul 14 16:28:50 devstack cinder-volume[87166]: WARNING cinder.quota [None req-7e782cac-e31d-4bdc-a101-86ab8f36db5a tempest-GroupSnapshotsTest-1880376477 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2108063612 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2108063612, it is now deprecated. Please use the default quota class for default quota.
Jul 14 16:28:51 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-7e782cac-e31d-4bdc-a101-86ab8f36db5a tempest-GroupSnapshotsTest-1880376477 None] Created reservations ['81206f87-7c75-487b-94ba-7555d16826e4', '0fc247e5-bd92-41da-8d4e-22a129b6a8f7', '33461cf7-8527-449c-b408-f07fe0efac0b', '29bee7ec-aa6e-465c-85b0-681c652f3458'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:28:51 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-7e782cac-e31d-4bdc-a101-86ab8f36db5a tempest-GroupSnapshotsTest-1880376477 None] Created reservations ['e5c02fd9-aa23-4e9e-a065-55a216d20c6c', '11a9edef-62e8-4048-8821-ccea71a0cce6', '63640b63-166f-44c6-900f-1e9feefc4c72', 'a2a7734b-6c54-420c-b474-9509818120e6'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:28:51 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-7e782cac-e31d-4bdc-a101-86ab8f36db5a tempest-GroupSnapshotsTest-1880376477 None] group_snapshot b1ce61bc-ea2d-4832-920c-b16fd22392ca: deleted successfully
Jul 14 16:28:52 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d1741eae-bfe8-4eb1-ab46-3f76a36850a8 tempest-GroupSnapshotsTest-1880376477 None] Acquiring lock "cinder-quobyte-6d329737-20a7-45af-8dd3-28fa6339eec8" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:28:52 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d1741eae-bfe8-4eb1-ab46-3f76a36850a8 tempest-GroupSnapshotsTest-1880376477 None] Lock "cinder-quobyte-6d329737-20a7-45af-8dd3-28fa6339eec8" acquired by "delete_volume" :: waited 0.029s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:28:52 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da0ba19-c683-4a54-ac5c-f5b304814e86]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:28:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d1741eae-bfe8-4eb1-ab46-3f76a36850a8 tempest-GroupSnapshotsTest-1880376477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6d329737-20a7-45af-8dd3-28fa6339eec8 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:52 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-1990f4bc-d32e-4220-8098-4cef6e339d52 req-32a4b2be-315a-4106-af3a-f7ede8397dd9 tempest-AttachVolumeTestJSON-1037344391 None] Terminate volume connection completed successfully.
Jul 14 16:28:52 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-1990f4bc-d32e-4220-8098-4cef6e339d52 req-32a4b2be-315a-4106-af3a-f7ede8397dd9 tempest-AttachVolumeTestJSON-1037344391 None] Deleting attachment bd601490-819a-4434-8dda-44890b764b32. {{(pid=87166) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 14 16:28:52 devstack sudo[94860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6d329737-20a7-45af-8dd3-28fa6339eec8
Jul 14 16:28:52 devstack sudo[94860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:53 devstack sudo[94860]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d1741eae-bfe8-4eb1-ab46-3f76a36850a8 tempest-GroupSnapshotsTest-1880376477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6d329737-20a7-45af-8dd3-28fa6339eec8" returned: 0 in 0.433s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d1741eae-bfe8-4eb1-ab46-3f76a36850a8 tempest-GroupSnapshotsTest-1880376477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6d329737-20a7-45af-8dd3-28fa6339eec8 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:53 devstack sudo[94865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6d329737-20a7-45af-8dd3-28fa6339eec8
Jul 14 16:28:53 devstack sudo[94865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:53 devstack sudo[94865]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d1741eae-bfe8-4eb1-ab46-3f76a36850a8 tempest-GroupSnapshotsTest-1880376477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6d329737-20a7-45af-8dd3-28fa6339eec8" returned: 0 in 0.307s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:53 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d1741eae-bfe8-4eb1-ab46-3f76a36850a8 tempest-GroupSnapshotsTest-1880376477 None] Lock "cinder-quobyte-6d329737-20a7-45af-8dd3-28fa6339eec8" released by "delete_volume" :: held 0.830s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:28:53 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d1741eae-bfe8-4eb1-ab46-3f76a36850a8 tempest-GroupSnapshotsTest-1880376477 None] Acquiring lock "cinder-quobyte-ec03e3d2-83ad-4f47-9bcd-c3df8a10a839" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:28:53 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d1741eae-bfe8-4eb1-ab46-3f76a36850a8 tempest-GroupSnapshotsTest-1880376477 None] Lock "cinder-quobyte-ec03e3d2-83ad-4f47-9bcd-c3df8a10a839" acquired by "delete_volume" :: waited 0.022s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:28:53 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[63914ddc-227f-496c-ae0d-52f71a2c77c0]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:28:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d1741eae-bfe8-4eb1-ab46-3f76a36850a8 tempest-GroupSnapshotsTest-1880376477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ec03e3d2-83ad-4f47-9bcd-c3df8a10a839 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:53 devstack sudo[94869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ec03e3d2-83ad-4f47-9bcd-c3df8a10a839
Jul 14 16:28:53 devstack sudo[94869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:53 devstack sudo[94869]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d1741eae-bfe8-4eb1-ab46-3f76a36850a8 tempest-GroupSnapshotsTest-1880376477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ec03e3d2-83ad-4f47-9bcd-c3df8a10a839" returned: 0 in 0.543s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d1741eae-bfe8-4eb1-ab46-3f76a36850a8 tempest-GroupSnapshotsTest-1880376477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ec03e3d2-83ad-4f47-9bcd-c3df8a10a839 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:54 devstack sudo[94879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ec03e3d2-83ad-4f47-9bcd-c3df8a10a839
Jul 14 16:28:54 devstack sudo[94879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:54 devstack sudo[94879]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d1741eae-bfe8-4eb1-ab46-3f76a36850a8 tempest-GroupSnapshotsTest-1880376477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ec03e3d2-83ad-4f47-9bcd-c3df8a10a839" returned: 0 in 0.328s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:54 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d1741eae-bfe8-4eb1-ab46-3f76a36850a8 tempest-GroupSnapshotsTest-1880376477 None] Lock "cinder-quobyte-ec03e3d2-83ad-4f47-9bcd-c3df8a10a839" released by "delete_volume" :: held 0.985s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:28:54 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-d1741eae-bfe8-4eb1-ab46-3f76a36850a8 tempest-GroupSnapshotsTest-1880376477 None] Created reservations ['9f7e4751-a88f-481b-a281-a4070298774e'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:28:54 devstack cinder-volume[87166]: WARNING cinder.quota [None req-d1741eae-bfe8-4eb1-ab46-3f76a36850a8 tempest-GroupSnapshotsTest-1880376477 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2108063612 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2108063612, it is now deprecated. Please use the default quota class for default quota.
Jul 14 16:28:54 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-d1741eae-bfe8-4eb1-ab46-3f76a36850a8 tempest-GroupSnapshotsTest-1880376477 None] Created reservations ['f7f9b4d0-73a4-468d-a211-5f10baeaa632', 'e2d259ba-fc78-4d6f-9f73-456ed2ba2c14', '310ed886-d07b-4cac-93d7-4e6132887fdf', '786db1dc-1f5f-4a86-b59c-c0fed42852b2'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:28:54 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-d1741eae-bfe8-4eb1-ab46-3f76a36850a8 tempest-GroupSnapshotsTest-1880376477 None] Created reservations ['2b7d8bf4-5984-4f28-97fc-d96a055e1d2f', 'a5242ab3-c5b0-4ed3-8cd0-e33fd8e56574', 'de5bfc4a-e9f6-4155-879e-a94a7256bf2d', '615f0286-1d42-41cb-bd07-0450c205033c'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:28:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d1741eae-bfe8-4eb1-ab46-3f76a36850a8 tempest-GroupSnapshotsTest-1880376477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:28:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d1741eae-bfe8-4eb1-ab46-3f76a36850a8 tempest-GroupSnapshotsTest-1880376477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:28:54 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d1741eae-bfe8-4eb1-ab46-3f76a36850a8 tempest-GroupSnapshotsTest-1880376477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:28:54 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d1741eae-bfe8-4eb1-ab46-3f76a36850a8 tempest-GroupSnapshotsTest-1880376477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:28:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d1741eae-bfe8-4eb1-ab46-3f76a36850a8 tempest-GroupSnapshotsTest-1880376477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:28:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d1741eae-bfe8-4eb1-ab46-3f76a36850a8 tempest-GroupSnapshotsTest-1880376477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:54 devstack sudo[94882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:28:54 devstack sudo[94882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:55 devstack sudo[94882]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d1741eae-bfe8-4eb1-ab46-3f76a36850a8 tempest-GroupSnapshotsTest-1880376477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.399s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:55 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-d1741eae-bfe8-4eb1-ab46-3f76a36850a8 tempest-GroupSnapshotsTest-1880376477 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:28:55 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-d1741eae-bfe8-4eb1-ab46-3f76a36850a8 tempest-GroupSnapshotsTest-1880376477 None] Delete group completed successfully.
Jul 14 16:28:55 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-f62afd79-430a-44b8-b977-f0f4d732e92f tempest-GroupSnapshotsTest-1880376477 None] Group tempest-GroupSnapshotsTest-Group-2132064987: creating
Jul 14 16:28:55 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-f62afd79-430a-44b8-b977-f0f4d732e92f tempest-GroupSnapshotsTest-1880376477 None] Group tempest-GroupSnapshotsTest-Group-2132064987: created successfully
Jul 14 16:28:55 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-f62afd79-430a-44b8-b977-f0f4d732e92f tempest-GroupSnapshotsTest-1880376477 None] Create group completed successfully.
Jul 14 16:28:57 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bdd8a03-df6d-4cac-9939-9916c7f46ea9 tempest-AttachVolumeNegativeTest-1726980645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:28:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8bdd8a03-df6d-4cac-9939-9916c7f46ea9 tempest-AttachVolumeNegativeTest-1726980645 None] Flow 'volume_create_manager' (871baa19-cb61-496f-ac0f-2520215e63ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:28:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8bdd8a03-df6d-4cac-9939-9916c7f46ea9 tempest-AttachVolumeNegativeTest-1726980645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b38e4cd1-6306-4e32-a434-516dba15aeef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:28:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8bdd8a03-df6d-4cac-9939-9916c7f46ea9 tempest-AttachVolumeNegativeTest-1726980645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b38e4cd1-6306-4e32-a434-516dba15aeef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:28:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2138749386',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26db40c2-ebe0-477d-8f97-c5cb02fac3bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cf84256246844f789857d186f14522c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:28:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:28:57Z,use_quota=True,user_id='4409e01f79d64f8eab1c43653e9d8333',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:28:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8bdd8a03-df6d-4cac-9939-9916c7f46ea9 tempest-AttachVolumeNegativeTest-1726980645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dad8248-3557-4033-b2d6-37315c4ffab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:28:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8bdd8a03-df6d-4cac-9939-9916c7f46ea9 tempest-AttachVolumeNegativeTest-1726980645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dad8248-3557-4033-b2d6-37315c4ffab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:28:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8bdd8a03-df6d-4cac-9939-9916c7f46ea9 tempest-AttachVolumeNegativeTest-1726980645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a64e7b6-0558-4d4b-9c6b-7612c925166b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:28:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8bdd8a03-df6d-4cac-9939-9916c7f46ea9 tempest-AttachVolumeNegativeTest-1726980645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a64e7b6-0558-4d4b-9c6b-7612c925166b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26db40c2-ebe0-477d-8f97-c5cb02fac3bc', 'volume_name': 'volume-26db40c2-ebe0-477d-8f97-c5cb02fac3bc', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:28:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8bdd8a03-df6d-4cac-9939-9916c7f46ea9 tempest-AttachVolumeNegativeTest-1726980645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ef0ea87-699b-41f1-b8c2-024e77c570a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:28:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8bdd8a03-df6d-4cac-9939-9916c7f46ea9 tempest-AttachVolumeNegativeTest-1726980645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ef0ea87-699b-41f1-b8c2-024e77c570a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:28:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8bdd8a03-df6d-4cac-9939-9916c7f46ea9 tempest-AttachVolumeNegativeTest-1726980645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c648113-1e75-4d47-8f08-346254793c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:28:57 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-8bdd8a03-df6d-4cac-9939-9916c7f46ea9 tempest-AttachVolumeNegativeTest-1726980645 None] Volume 26db40c2-ebe0-477d-8f97-c5cb02fac3bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26db40c2-ebe0-477d-8f97-c5cb02fac3bc', 'volume_size': 1}
Jul 14 16:28:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-8bdd8a03-df6d-4cac-9939-9916c7f46ea9 tempest-AttachVolumeNegativeTest-1726980645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:28:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-8bdd8a03-df6d-4cac-9939-9916c7f46ea9 tempest-AttachVolumeNegativeTest-1726980645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:28:57 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-8bdd8a03-df6d-4cac-9939-9916c7f46ea9 tempest-AttachVolumeNegativeTest-1726980645 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:28:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2138749386',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26db40c2-ebe0-477d-8f97-c5cb02fac3bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cf84256246844f789857d186f14522c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:28:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:28:57Z,use_quota=True,user_id='4409e01f79d64f8eab1c43653e9d8333',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:28:57 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-8bdd8a03-df6d-4cac-9939-9916c7f46ea9 tempest-AttachVolumeNegativeTest-1726980645 None] Creating volume 26db40c2-ebe0-477d-8f97-c5cb02fac3bc {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:28:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-8bdd8a03-df6d-4cac-9939-9916c7f46ea9 tempest-AttachVolumeNegativeTest-1726980645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:28:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-8bdd8a03-df6d-4cac-9939-9916c7f46ea9 tempest-AttachVolumeNegativeTest-1726980645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:28:57 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-8bdd8a03-df6d-4cac-9939-9916c7f46ea9 tempest-AttachVolumeNegativeTest-1726980645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:28:57 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-8bdd8a03-df6d-4cac-9939-9916c7f46ea9 tempest-AttachVolumeNegativeTest-1726980645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:28:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-8bdd8a03-df6d-4cac-9939-9916c7f46ea9 tempest-AttachVolumeNegativeTest-1726980645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:28:57 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-8bdd8a03-df6d-4cac-9939-9916c7f46ea9 tempest-AttachVolumeNegativeTest-1726980645 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:28:57 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-8bdd8a03-df6d-4cac-9939-9916c7f46ea9 tempest-AttachVolumeNegativeTest-1726980645 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:28:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-8bdd8a03-df6d-4cac-9939-9916c7f46ea9 tempest-AttachVolumeNegativeTest-1726980645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-26db40c2-ebe0-477d-8f97-c5cb02fac3bc 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:57 devstack sudo[94923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-26db40c2-ebe0-477d-8f97-c5cb02fac3bc 1073741824
Jul 14 16:28:57 devstack sudo[94923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:57 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-16563921-a55d-411b-961c-55bdf3759335 tempest-GroupSnapshotsTest-1880376477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:28:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-16563921-a55d-411b-961c-55bdf3759335 tempest-GroupSnapshotsTest-1880376477 None] Flow 'volume_create_manager' (9bae4aee-b4b1-4a7a-9c32-fccfec8fc10d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:28:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-16563921-a55d-411b-961c-55bdf3759335 tempest-GroupSnapshotsTest-1880376477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3df86cb-e787-414b-90cd-0d9a43f56acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:28:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-16563921-a55d-411b-961c-55bdf3759335 tempest-GroupSnapshotsTest-1880376477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3df86cb-e787-414b-90cd-0d9a43f56acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:28:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-331967166',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=1575080f-b98d-40bd-a6e0-6024817f3001,host='devstack@QuobyteHD#QuobyteHD',id=4e603b45-5f6f-4c01-99ca-4b693c6a6630,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbdc2b87a94f462c9c15afe22ca87a42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:28:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:28:58Z,use_quota=True,user_id='c4899276ef4a456b979726b690a13ca1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cb16751-cbd3-4b62-81de-88f6857546a5),volume_type_id=4cb16751-cbd3-4b62-81de-88f6857546a5)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:28:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-16563921-a55d-411b-961c-55bdf3759335 tempest-GroupSnapshotsTest-1880376477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (264ed0a3-9a2a-406b-aa36-340e77ac2542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:28:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-16563921-a55d-411b-961c-55bdf3759335 tempest-GroupSnapshotsTest-1880376477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (264ed0a3-9a2a-406b-aa36-340e77ac2542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:28:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-16563921-a55d-411b-961c-55bdf3759335 tempest-GroupSnapshotsTest-1880376477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08f3cd55-20b6-476c-9741-1cda25e2d839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:28:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-16563921-a55d-411b-961c-55bdf3759335 tempest-GroupSnapshotsTest-1880376477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08f3cd55-20b6-476c-9741-1cda25e2d839) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e603b45-5f6f-4c01-99ca-4b693c6a6630', 'volume_name': 'volume-4e603b45-5f6f-4c01-99ca-4b693c6a6630', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:28:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-16563921-a55d-411b-961c-55bdf3759335 tempest-GroupSnapshotsTest-1880376477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (062b3cad-ee98-4761-be9e-f2f6ac9cef7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:28:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-16563921-a55d-411b-961c-55bdf3759335 tempest-GroupSnapshotsTest-1880376477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (062b3cad-ee98-4761-be9e-f2f6ac9cef7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:28:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-16563921-a55d-411b-961c-55bdf3759335 tempest-GroupSnapshotsTest-1880376477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc9cc675-4986-4cda-a0b0-a36d7354b4a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:28:57 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-16563921-a55d-411b-961c-55bdf3759335 tempest-GroupSnapshotsTest-1880376477 None] Volume 4e603b45-5f6f-4c01-99ca-4b693c6a6630: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e603b45-5f6f-4c01-99ca-4b693c6a6630', 'volume_size': 1}
Jul 14 16:28:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-16563921-a55d-411b-961c-55bdf3759335 tempest-GroupSnapshotsTest-1880376477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:28:58 devstack sudo[94923]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-8bdd8a03-df6d-4cac-9939-9916c7f46ea9 tempest-AttachVolumeNegativeTest-1726980645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-26db40c2-ebe0-477d-8f97-c5cb02fac3bc 1073741824" returned: 0 in 0.593s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-8bdd8a03-df6d-4cac-9939-9916c7f46ea9 tempest-AttachVolumeNegativeTest-1726980645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-26db40c2-ebe0-477d-8f97-c5cb02fac3bc {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:58 devstack sudo[94943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-26db40c2-ebe0-477d-8f97-c5cb02fac3bc
Jul 14 16:28:58 devstack sudo[94943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:58 devstack sudo[94943]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-8bdd8a03-df6d-4cac-9939-9916c7f46ea9 tempest-AttachVolumeNegativeTest-1726980645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-26db40c2-ebe0-477d-8f97-c5cb02fac3bc" returned: 0 in 0.665s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:58 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-8bdd8a03-df6d-4cac-9939-9916c7f46ea9 tempest-AttachVolumeNegativeTest-1726980645 None] <== create_volume: return (1323ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:28:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-8bdd8a03-df6d-4cac-9939-9916c7f46ea9 tempest-AttachVolumeNegativeTest-1726980645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.326s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:28:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-16563921-a55d-411b-961c-55bdf3759335 tempest-GroupSnapshotsTest-1880376477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.825s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:28:58 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-16563921-a55d-411b-961c-55bdf3759335 tempest-GroupSnapshotsTest-1880376477 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=1575080f-b98d-40bd-a6e0-6024817f3001,created_at=2026-07-14T14:28:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-331967166',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=1575080f-b98d-40bd-a6e0-6024817f3001,host='devstack@QuobyteHD#QuobyteHD',id=4e603b45-5f6f-4c01-99ca-4b693c6a6630,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbdc2b87a94f462c9c15afe22ca87a42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:28:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:28:58Z,use_quota=True,user_id='c4899276ef4a456b979726b690a13ca1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cb16751-cbd3-4b62-81de-88f6857546a5),volume_type_id=4cb16751-cbd3-4b62-81de-88f6857546a5)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:28:58 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-16563921-a55d-411b-961c-55bdf3759335 tempest-GroupSnapshotsTest-1880376477 None] Creating volume 4e603b45-5f6f-4c01-99ca-4b693c6a6630 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:28:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-16563921-a55d-411b-961c-55bdf3759335 tempest-GroupSnapshotsTest-1880376477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:28:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-16563921-a55d-411b-961c-55bdf3759335 tempest-GroupSnapshotsTest-1880376477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:28:58 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-16563921-a55d-411b-961c-55bdf3759335 tempest-GroupSnapshotsTest-1880376477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:28:58 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-16563921-a55d-411b-961c-55bdf3759335 tempest-GroupSnapshotsTest-1880376477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:28:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-16563921-a55d-411b-961c-55bdf3759335 tempest-GroupSnapshotsTest-1880376477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:28:58 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-16563921-a55d-411b-961c-55bdf3759335 tempest-GroupSnapshotsTest-1880376477 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:28:58 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-16563921-a55d-411b-961c-55bdf3759335 tempest-GroupSnapshotsTest-1880376477 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:28:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-16563921-a55d-411b-961c-55bdf3759335 tempest-GroupSnapshotsTest-1880376477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4e603b45-5f6f-4c01-99ca-4b693c6a6630 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:58 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8bdd8a03-df6d-4cac-9939-9916c7f46ea9 tempest-AttachVolumeNegativeTest-1726980645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c648113-1e75-4d47-8f08-346254793c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26db40c2-ebe0-477d-8f97-c5cb02fac3bc', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:28:58 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8bdd8a03-df6d-4cac-9939-9916c7f46ea9 tempest-AttachVolumeNegativeTest-1726980645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d7e0095-8b7c-495c-adfe-1bc680c25ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:28:58 devstack sudo[95030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4e603b45-5f6f-4c01-99ca-4b693c6a6630 1073741824
Jul 14 16:28:58 devstack sudo[95030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:28:58 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-8bdd8a03-df6d-4cac-9939-9916c7f46ea9 tempest-AttachVolumeNegativeTest-1726980645 None] Volume volume-26db40c2-ebe0-477d-8f97-c5cb02fac3bc (26db40c2-ebe0-477d-8f97-c5cb02fac3bc): created successfully
Jul 14 16:28:58 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8bdd8a03-df6d-4cac-9939-9916c7f46ea9 tempest-AttachVolumeNegativeTest-1726980645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d7e0095-8b7c-495c-adfe-1bc680c25ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:28:58 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8bdd8a03-df6d-4cac-9939-9916c7f46ea9 tempest-AttachVolumeNegativeTest-1726980645 None] Flow 'volume_create_manager' (871baa19-cb61-496f-ac0f-2520215e63ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:28:59 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-8bdd8a03-df6d-4cac-9939-9916c7f46ea9 tempest-AttachVolumeNegativeTest-1726980645 None] Created volume successfully.
Jul 14 16:28:59 devstack sudo[95030]: pam_unix(sudo:session): session closed for user root
Jul 14 16:28:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-16563921-a55d-411b-961c-55bdf3759335 tempest-GroupSnapshotsTest-1880376477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4e603b45-5f6f-4c01-99ca-4b693c6a6630 1073741824" returned: 0 in 0.848s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:28:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-16563921-a55d-411b-961c-55bdf3759335 tempest-GroupSnapshotsTest-1880376477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4e603b45-5f6f-4c01-99ca-4b693c6a6630 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:28:59 devstack sudo[95046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4e603b45-5f6f-4c01-99ca-4b693c6a6630
Jul 14 16:28:59 devstack sudo[95046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:29:00 devstack sudo[95046]: pam_unix(sudo:session): session closed for user root
Jul 14 16:29:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-16563921-a55d-411b-961c-55bdf3759335 tempest-GroupSnapshotsTest-1880376477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4e603b45-5f6f-4c01-99ca-4b693c6a6630" returned: 0 in 0.494s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:29:00 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-16563921-a55d-411b-961c-55bdf3759335 tempest-GroupSnapshotsTest-1880376477 None] <== create_volume: return (1429ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:29:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-16563921-a55d-411b-961c-55bdf3759335 tempest-GroupSnapshotsTest-1880376477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.449s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:29:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-16563921-a55d-411b-961c-55bdf3759335 tempest-GroupSnapshotsTest-1880376477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc9cc675-4986-4cda-a0b0-a36d7354b4a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e603b45-5f6f-4c01-99ca-4b693c6a6630', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:29:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-16563921-a55d-411b-961c-55bdf3759335 tempest-GroupSnapshotsTest-1880376477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5e6284f-7412-46e4-bfd9-95cd2d9dee12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:29:00 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-16563921-a55d-411b-961c-55bdf3759335 tempest-GroupSnapshotsTest-1880376477 None] Volume volume-4e603b45-5f6f-4c01-99ca-4b693c6a6630 (4e603b45-5f6f-4c01-99ca-4b693c6a6630): created successfully
Jul 14 16:29:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-16563921-a55d-411b-961c-55bdf3759335 tempest-GroupSnapshotsTest-1880376477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5e6284f-7412-46e4-bfd9-95cd2d9dee12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:29:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-16563921-a55d-411b-961c-55bdf3759335 tempest-GroupSnapshotsTest-1880376477 None] Flow 'volume_create_manager' (9bae4aee-b4b1-4a7a-9c32-fccfec8fc10d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:29:00 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-16563921-a55d-411b-961c-55bdf3759335 tempest-GroupSnapshotsTest-1880376477 None] Created volume successfully.
Jul 14 16:29:01 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-4ca2196e-6034-4405-bccb-5e9f1ec76c93 tempest-GroupSnapshotsTest-1880376477 None] GroupSnapshot fab00886-35f1-4608-9500-809e07a7d29d: creating.
Jul 14 16:29:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4ca2196e-6034-4405-bccb-5e9f1ec76c93 tempest-GroupSnapshotsTest-1880376477 None] Group snapshot fab00886-35f1-4608-9500-809e07a7d29d: creating. {{(pid=87166) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 14 16:29:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-4ca2196e-6034-4405-bccb-5e9f1ec76c93 tempest-GroupSnapshotsTest-1880376477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:29:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-4ca2196e-6034-4405-bccb-5e9f1ec76c93 tempest-GroupSnapshotsTest-1880376477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:29:01 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-4ca2196e-6034-4405-bccb-5e9f1ec76c93 tempest-GroupSnapshotsTest-1880376477 None] Creating offline snapshot 6bcfee20-6035-467f-8994-925157a641bb of volume 4e603b45-5f6f-4c01-99ca-4b693c6a6630 {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 16:29:01 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[677ed7ea-10db-4a13-86ce-803bbfac18f0]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:29:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4ca2196e-6034-4405-bccb-5e9f1ec76c93 tempest-GroupSnapshotsTest-1880376477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4e603b45-5f6f-4c01-99ca-4b693c6a6630 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:29:01 devstack sudo[95059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4e603b45-5f6f-4c01-99ca-4b693c6a6630
Jul 14 16:29:01 devstack sudo[95059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:29:01 devstack sudo[95059]: pam_unix(sudo:session): session closed for user root
Jul 14 16:29:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4ca2196e-6034-4405-bccb-5e9f1ec76c93 tempest-GroupSnapshotsTest-1880376477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4e603b45-5f6f-4c01-99ca-4b693c6a6630" returned: 0 in 0.482s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:29:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4ca2196e-6034-4405-bccb-5e9f1ec76c93 tempest-GroupSnapshotsTest-1880376477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4e603b45-5f6f-4c01-99ca-4b693c6a6630,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4e603b45-5f6f-4c01-99ca-4b693c6a6630.6bcfee20-6035-467f-8994-925157a641bb 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:29:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-f09c2c09-ad6a-4928-a15e-1032ee6af94c req-4e5d0c41-2d8a-4284-ad47-4bbbd85319fa tempest-AttachVolumeNegativeTest-1726980645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:29:01 devstack sudo[95073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4e603b45-5f6f-4c01-99ca-4b693c6a6630,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4e603b45-5f6f-4c01-99ca-4b693c6a6630.6bcfee20-6035-467f-8994-925157a641bb 1G
Jul 14 16:29:01 devstack sudo[95073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:29:02 devstack sudo[95073]: pam_unix(sudo:session): session closed for user root
Jul 14 16:29:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4ca2196e-6034-4405-bccb-5e9f1ec76c93 tempest-GroupSnapshotsTest-1880376477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4e603b45-5f6f-4c01-99ca-4b693c6a6630,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4e603b45-5f6f-4c01-99ca-4b693c6a6630.6bcfee20-6035-467f-8994-925157a641bb 1G" returned: 0 in 0.665s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:29:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4ca2196e-6034-4405-bccb-5e9f1ec76c93 tempest-GroupSnapshotsTest-1880376477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e603b45-5f6f-4c01-99ca-4b693c6a6630 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4e603b45-5f6f-4c01-99ca-4b693c6a6630.6bcfee20-6035-467f-8994-925157a641bb {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:29:02 devstack sudo[95079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e603b45-5f6f-4c01-99ca-4b693c6a6630 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4e603b45-5f6f-4c01-99ca-4b693c6a6630.6bcfee20-6035-467f-8994-925157a641bb
Jul 14 16:29:02 devstack sudo[95079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:29:02 devstack sudo[95079]: pam_unix(sudo:session): session closed for user root
Jul 14 16:29:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4ca2196e-6034-4405-bccb-5e9f1ec76c93 tempest-GroupSnapshotsTest-1880376477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e603b45-5f6f-4c01-99ca-4b693c6a6630 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4e603b45-5f6f-4c01-99ca-4b693c6a6630.6bcfee20-6035-467f-8994-925157a641bb" returned: 0 in 0.349s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:29:02 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-4ca2196e-6034-4405-bccb-5e9f1ec76c93 tempest-GroupSnapshotsTest-1880376477 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4e603b45-5f6f-4c01-99ca-4b693c6a6630.6bcfee20-6035-467f-8994-925157a641bb is being set with open permissions: ugo+rw: NotImplementedError
Jul 14 16:29:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4ca2196e-6034-4405-bccb-5e9f1ec76c93 tempest-GroupSnapshotsTest-1880376477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4e603b45-5f6f-4c01-99ca-4b693c6a6630.6bcfee20-6035-467f-8994-925157a641bb {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:29:02 devstack sudo[95084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4e603b45-5f6f-4c01-99ca-4b693c6a6630.6bcfee20-6035-467f-8994-925157a641bb
Jul 14 16:29:02 devstack sudo[95084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:29:03 devstack sudo[95084]: pam_unix(sudo:session): session closed for user root
Jul 14 16:29:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4ca2196e-6034-4405-bccb-5e9f1ec76c93 tempest-GroupSnapshotsTest-1880376477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4e603b45-5f6f-4c01-99ca-4b693c6a6630.6bcfee20-6035-467f-8994-925157a641bb" returned: 0 in 0.302s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:29:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4ca2196e-6034-4405-bccb-5e9f1ec76c93 tempest-GroupSnapshotsTest-1880376477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4e603b45-5f6f-4c01-99ca-4b693c6a6630.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:29:03 devstack sudo[95087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4e603b45-5f6f-4c01-99ca-4b693c6a6630.info
Jul 14 16:29:03 devstack sudo[95087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:29:03 devstack sudo[95087]: pam_unix(sudo:session): session closed for user root
Jul 14 16:29:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4ca2196e-6034-4405-bccb-5e9f1ec76c93 tempest-GroupSnapshotsTest-1880376477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4e603b45-5f6f-4c01-99ca-4b693c6a6630.info" returned: 0 in 0.300s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:29:03 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-4ca2196e-6034-4405-bccb-5e9f1ec76c93 tempest-GroupSnapshotsTest-1880376477 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4e603b45-5f6f-4c01-99ca-4b693c6a6630.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 14 16:29:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4ca2196e-6034-4405-bccb-5e9f1ec76c93 tempest-GroupSnapshotsTest-1880376477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4e603b45-5f6f-4c01-99ca-4b693c6a6630.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:29:03 devstack sudo[95090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4e603b45-5f6f-4c01-99ca-4b693c6a6630.info
Jul 14 16:29:03 devstack sudo[95090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:29:03 devstack sudo[95090]: pam_unix(sudo:session): session closed for user root
Jul 14 16:29:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4ca2196e-6034-4405-bccb-5e9f1ec76c93 tempest-GroupSnapshotsTest-1880376477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4e603b45-5f6f-4c01-99ca-4b693c6a6630.info" returned: 0 in 0.400s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:29:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-4ca2196e-6034-4405-bccb-5e9f1ec76c93 tempest-GroupSnapshotsTest-1880376477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.642s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:29:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-f09c2c09-ad6a-4928-a15e-1032ee6af94c req-4e5d0c41-2d8a-4284-ad47-4bbbd85319fa tempest-AttachVolumeNegativeTest-1726980645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.065s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:29:04 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[5822dd57-4c38-4425-8d9c-a487382505bb]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:29:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-f09c2c09-ad6a-4928-a15e-1032ee6af94c req-4e5d0c41-2d8a-4284-ad47-4bbbd85319fa tempest-AttachVolumeNegativeTest-1726980645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-26db40c2-ebe0-477d-8f97-c5cb02fac3bc {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:29:04 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-4ca2196e-6034-4405-bccb-5e9f1ec76c93 tempest-GroupSnapshotsTest-1880376477 None] group_snapshot fab00886-35f1-4608-9500-809e07a7d29d: created successfully
Jul 14 16:29:04 devstack sudo[95093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-26db40c2-ebe0-477d-8f97-c5cb02fac3bc
Jul 14 16:29:04 devstack sudo[95093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:29:04 devstack sudo[95093]: pam_unix(sudo:session): session closed for user root
Jul 14 16:29:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-f09c2c09-ad6a-4928-a15e-1032ee6af94c req-4e5d0c41-2d8a-4284-ad47-4bbbd85319fa tempest-AttachVolumeNegativeTest-1726980645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-26db40c2-ebe0-477d-8f97-c5cb02fac3bc" returned: 0 in 0.569s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:29:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-f09c2c09-ad6a-4928-a15e-1032ee6af94c req-4e5d0c41-2d8a-4284-ad47-4bbbd85319fa tempest-AttachVolumeNegativeTest-1726980645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.604s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:29:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-f09c2c09-ad6a-4928-a15e-1032ee6af94c req-4e5d0c41-2d8a-4284-ad47-4bbbd85319fa tempest-AttachVolumeNegativeTest-1726980645 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052', 'name': 'volume-26db40c2-ebe0-477d-8f97-c5cb02fac3bc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '63776b1c-bfd4-403d-b0ca-043543230133', 'enforce_multipath': True} {{(pid=87166) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 14 16:29:04 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-872c7df5-29fb-4d66-89c7-4dbf0b85a93a tempest-GroupSnapshotsTest-1880376477 None] group_snapshot fab00886-35f1-4608-9500-809e07a7d29d: deleting
Jul 14 16:29:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-872c7df5-29fb-4d66-89c7-4dbf0b85a93a tempest-GroupSnapshotsTest-1880376477 None] group_snapshot fab00886-35f1-4608-9500-809e07a7d29d: deleting {{(pid=87166) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 14 16:29:04 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-f09c2c09-ad6a-4928-a15e-1032ee6af94c req-4e5d0c41-2d8a-4284-ad47-4bbbd85319fa tempest-AttachVolumeNegativeTest-1726980645 None] attachment_update completed successfully.
Jul 14 16:29:04 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-872c7df5-29fb-4d66-89c7-4dbf0b85a93a tempest-GroupSnapshotsTest-1880376477 None] Acquiring lock "cinder-quobyte-4e603b45-5f6f-4c01-99ca-4b693c6a6630" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:29:04 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-872c7df5-29fb-4d66-89c7-4dbf0b85a93a tempest-GroupSnapshotsTest-1880376477 None] Lock "cinder-quobyte-4e603b45-5f6f-4c01-99ca-4b693c6a6630" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:29:04 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-872c7df5-29fb-4d66-89c7-4dbf0b85a93a tempest-GroupSnapshotsTest-1880376477 None] Acquiring lock "cinder-quobyte-6bcfee20-6035-467f-8994-925157a641bb" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:29:04 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-872c7df5-29fb-4d66-89c7-4dbf0b85a93a tempest-GroupSnapshotsTest-1880376477 None] Lock "cinder-quobyte-6bcfee20-6035-467f-8994-925157a641bb" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:29:04 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-872c7df5-29fb-4d66-89c7-4dbf0b85a93a tempest-GroupSnapshotsTest-1880376477 None] Deleting offline snapshot 6bcfee20-6035-467f-8994-925157a641bb of volume 4e603b45-5f6f-4c01-99ca-4b693c6a6630 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 16:29:04 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-872c7df5-29fb-4d66-89c7-4dbf0b85a93a tempest-GroupSnapshotsTest-1880376477 None] snapshot_file for this snap is: volume-4e603b45-5f6f-4c01-99ca-4b693c6a6630.6bcfee20-6035-467f-8994-925157a641bb {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 16:29:04 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[a09facdf-cb34-4731-95ee-2e5c0ba0fb37]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:29:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-872c7df5-29fb-4d66-89c7-4dbf0b85a93a tempest-GroupSnapshotsTest-1880376477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4e603b45-5f6f-4c01-99ca-4b693c6a6630.6bcfee20-6035-467f-8994-925157a641bb {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:29:05 devstack sudo[95099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4e603b45-5f6f-4c01-99ca-4b693c6a6630.6bcfee20-6035-467f-8994-925157a641bb
Jul 14 16:29:05 devstack sudo[95099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:29:05 devstack sudo[95099]: pam_unix(sudo:session): session closed for user root
Jul 14 16:29:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-872c7df5-29fb-4d66-89c7-4dbf0b85a93a tempest-GroupSnapshotsTest-1880376477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4e603b45-5f6f-4c01-99ca-4b693c6a6630.6bcfee20-6035-467f-8994-925157a641bb" returned: 0 in 0.733s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:29:05 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-872c7df5-29fb-4d66-89c7-4dbf0b85a93a tempest-GroupSnapshotsTest-1880376477 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e603b45-5f6f-4c01-99ca-4b693c6a6630(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 16:29:05 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc8e050c-7433-4654-95b6-82220f181bca]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:29:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-872c7df5-29fb-4d66-89c7-4dbf0b85a93a tempest-GroupSnapshotsTest-1880376477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4e603b45-5f6f-4c01-99ca-4b693c6a6630 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:29:05 devstack sudo[95486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4e603b45-5f6f-4c01-99ca-4b693c6a6630
Jul 14 16:29:05 devstack sudo[95486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:29:06 devstack sudo[95486]: pam_unix(sudo:session): session closed for user root
Jul 14 16:29:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-872c7df5-29fb-4d66-89c7-4dbf0b85a93a tempest-GroupSnapshotsTest-1880376477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4e603b45-5f6f-4c01-99ca-4b693c6a6630" returned: 0 in 0.568s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:29:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-872c7df5-29fb-4d66-89c7-4dbf0b85a93a tempest-GroupSnapshotsTest-1880376477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4e603b45-5f6f-4c01-99ca-4b693c6a6630.6bcfee20-6035-467f-8994-925157a641bb {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:29:06 devstack sudo[95491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4e603b45-5f6f-4c01-99ca-4b693c6a6630.6bcfee20-6035-467f-8994-925157a641bb
Jul 14 16:29:06 devstack sudo[95491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:29:06 devstack sudo[95491]: pam_unix(sudo:session): session closed for user root
Jul 14 16:29:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-872c7df5-29fb-4d66-89c7-4dbf0b85a93a tempest-GroupSnapshotsTest-1880376477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4e603b45-5f6f-4c01-99ca-4b693c6a6630.6bcfee20-6035-467f-8994-925157a641bb" returned: 0 in 0.414s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:29:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-872c7df5-29fb-4d66-89c7-4dbf0b85a93a tempest-GroupSnapshotsTest-1880376477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4e603b45-5f6f-4c01-99ca-4b693c6a6630.6bcfee20-6035-467f-8994-925157a641bb {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:29:06 devstack sudo[95496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4e603b45-5f6f-4c01-99ca-4b693c6a6630.6bcfee20-6035-467f-8994-925157a641bb
Jul 14 16:29:06 devstack sudo[95496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:29:07 devstack sudo[95496]: pam_unix(sudo:session): session closed for user root
Jul 14 16:29:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-872c7df5-29fb-4d66-89c7-4dbf0b85a93a tempest-GroupSnapshotsTest-1880376477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4e603b45-5f6f-4c01-99ca-4b693c6a6630.6bcfee20-6035-467f-8994-925157a641bb" returned: 0 in 0.270s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:29:07 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-872c7df5-29fb-4d66-89c7-4dbf0b85a93a tempest-GroupSnapshotsTest-1880376477 None] Lock "cinder-quobyte-6bcfee20-6035-467f-8994-925157a641bb" released by "_delete_snapshot" :: held 2.159s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:29:07 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-872c7df5-29fb-4d66-89c7-4dbf0b85a93a tempest-GroupSnapshotsTest-1880376477 None] Lock "cinder-quobyte-4e603b45-5f6f-4c01-99ca-4b693c6a6630" released by "delete_snapshot" :: held 2.208s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:29:07 devstack cinder-volume[87166]: WARNING cinder.quota [None req-872c7df5-29fb-4d66-89c7-4dbf0b85a93a tempest-GroupSnapshotsTest-1880376477 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-802074767 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-802074767, it is now deprecated. Please use the default quota class for default quota.
Jul 14 16:29:07 devstack cinder-volume[87166]: WARNING cinder.quota [None req-872c7df5-29fb-4d66-89c7-4dbf0b85a93a tempest-GroupSnapshotsTest-1880376477 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-802074767 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-802074767, it is now deprecated. Please use the default quota class for default quota.
Jul 14 16:29:07 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-872c7df5-29fb-4d66-89c7-4dbf0b85a93a tempest-GroupSnapshotsTest-1880376477 None] Created reservations ['9329ec11-4cb9-48d1-9cef-3c1bc85c396f', '49c8e23c-cc33-4cae-ace4-6f23881f71e5', 'd72cfbb0-999a-468e-b483-93496442404c', '12d0c889-1060-4005-9f8d-a1d057fc4b6a'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:29:07 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-872c7df5-29fb-4d66-89c7-4dbf0b85a93a tempest-GroupSnapshotsTest-1880376477 None] group_snapshot fab00886-35f1-4608-9500-809e07a7d29d: deleted successfully
Jul 14 16:29:08 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-ea1227f7-ead4-457b-ba9d-a18559d20630 req-3df09a80-c676-4eaf-b947-7c95173e8875 tempest-AttachVolumeNegativeTest-1726980645 None] Terminate volume connection completed successfully.
Jul 14 16:29:08 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-ea1227f7-ead4-457b-ba9d-a18559d20630 req-3df09a80-c676-4eaf-b947-7c95173e8875 tempest-AttachVolumeNegativeTest-1726980645 None] Deleting attachment 63776b1c-bfd4-403d-b0ca-043543230133. {{(pid=87166) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 14 16:29:08 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-221487a5-0d0f-46f1-80f0-1764ecafe0df tempest-GroupSnapshotsTest-1880376477 None] Acquiring lock "cinder-quobyte-4e603b45-5f6f-4c01-99ca-4b693c6a6630" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:29:08 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-221487a5-0d0f-46f1-80f0-1764ecafe0df tempest-GroupSnapshotsTest-1880376477 None] Lock "cinder-quobyte-4e603b45-5f6f-4c01-99ca-4b693c6a6630" acquired by "delete_volume" :: waited 0.022s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:29:08 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[2352fbd3-ab11-4347-b849-53a7d923f310]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:29:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-221487a5-0d0f-46f1-80f0-1764ecafe0df tempest-GroupSnapshotsTest-1880376477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4e603b45-5f6f-4c01-99ca-4b693c6a6630 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:29:09 devstack sudo[95527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4e603b45-5f6f-4c01-99ca-4b693c6a6630
Jul 14 16:29:09 devstack sudo[95527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:29:09 devstack sudo[95527]: pam_unix(sudo:session): session closed for user root
Jul 14 16:29:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-221487a5-0d0f-46f1-80f0-1764ecafe0df tempest-GroupSnapshotsTest-1880376477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4e603b45-5f6f-4c01-99ca-4b693c6a6630" returned: 0 in 0.577s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:29:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-221487a5-0d0f-46f1-80f0-1764ecafe0df tempest-GroupSnapshotsTest-1880376477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4e603b45-5f6f-4c01-99ca-4b693c6a6630 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:29:09 devstack sudo[95534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4e603b45-5f6f-4c01-99ca-4b693c6a6630
Jul 14 16:29:09 devstack sudo[95534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:29:10 devstack sudo[95534]: pam_unix(sudo:session): session closed for user root
Jul 14 16:29:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-221487a5-0d0f-46f1-80f0-1764ecafe0df tempest-GroupSnapshotsTest-1880376477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4e603b45-5f6f-4c01-99ca-4b693c6a6630" returned: 0 in 0.646s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:29:10 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-221487a5-0d0f-46f1-80f0-1764ecafe0df tempest-GroupSnapshotsTest-1880376477 None] Lock "cinder-quobyte-4e603b45-5f6f-4c01-99ca-4b693c6a6630" released by "delete_volume" :: held 1.365s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:29:10 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-221487a5-0d0f-46f1-80f0-1764ecafe0df tempest-GroupSnapshotsTest-1880376477 None] Created reservations ['fe4a853e-b10c-4a8c-a9b2-c11b6b04e11f'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:29:10 devstack cinder-volume[87166]: WARNING cinder.quota [None req-221487a5-0d0f-46f1-80f0-1764ecafe0df tempest-GroupSnapshotsTest-1880376477 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-802074767 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-802074767, it is now deprecated. Please use the default quota class for default quota.
Jul 14 16:29:10 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-221487a5-0d0f-46f1-80f0-1764ecafe0df tempest-GroupSnapshotsTest-1880376477 None] Created reservations ['7060a9d8-8bfa-440f-8bb2-0ee76d665ac3', '61e90863-2d6c-4ee5-bb5c-86e495976ba7', 'cbb9f098-a3c7-4a2c-8fd7-c6f5ccb3f18d', '611986fb-a9c4-4f49-adad-2d350a4e3d84'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:29:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-221487a5-0d0f-46f1-80f0-1764ecafe0df tempest-GroupSnapshotsTest-1880376477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:29:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-221487a5-0d0f-46f1-80f0-1764ecafe0df tempest-GroupSnapshotsTest-1880376477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:29:10 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-221487a5-0d0f-46f1-80f0-1764ecafe0df tempest-GroupSnapshotsTest-1880376477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:29:10 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-221487a5-0d0f-46f1-80f0-1764ecafe0df tempest-GroupSnapshotsTest-1880376477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:29:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-221487a5-0d0f-46f1-80f0-1764ecafe0df tempest-GroupSnapshotsTest-1880376477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:29:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-221487a5-0d0f-46f1-80f0-1764ecafe0df tempest-GroupSnapshotsTest-1880376477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:29:10 devstack sudo[95557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:29:10 devstack sudo[95557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:29:10 devstack sudo[95557]: pam_unix(sudo:session): session closed for user root
Jul 14 16:29:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-221487a5-0d0f-46f1-80f0-1764ecafe0df tempest-GroupSnapshotsTest-1880376477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.424s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:29:10 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-221487a5-0d0f-46f1-80f0-1764ecafe0df tempest-GroupSnapshotsTest-1880376477 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:29:10 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-221487a5-0d0f-46f1-80f0-1764ecafe0df tempest-GroupSnapshotsTest-1880376477 None] Delete group completed successfully.
Jul 14 16:29:18 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-b932d667-3d0a-46db-ac93-f7d091853811 tempest-GroupsV314Test-1382985782 None] Group tempest-GroupsV314Test-Group-1251035976: creating
Jul 14 16:29:18 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-b932d667-3d0a-46db-ac93-f7d091853811 tempest-GroupsV314Test-1382985782 None] Group tempest-GroupsV314Test-Group-1251035976: created successfully
Jul 14 16:29:18 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-b932d667-3d0a-46db-ac93-f7d091853811 tempest-GroupsV314Test-1382985782 None] Create group completed successfully.
Jul 14 16:29:20 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cec9bb9-9d53-44e8-be97-d1795356aa92 tempest-GroupsV314Test-1382985782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:29:20 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3cec9bb9-9d53-44e8-be97-d1795356aa92 tempest-GroupsV314Test-1382985782 None] Flow 'volume_create_manager' (c84ad16e-412d-4763-9f5a-fd10a94021d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:29:20 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3cec9bb9-9d53-44e8-be97-d1795356aa92 tempest-GroupsV314Test-1382985782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84f61776-c512-4462-b037-9a8abdf3035d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:29:20 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3cec9bb9-9d53-44e8-be97-d1795356aa92 tempest-GroupsV314Test-1382985782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84f61776-c512-4462-b037-9a8abdf3035d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:29:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2056322208',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=07d90aaa-0a72-4d3e-958c-4a57549ff9bd,host='devstack@QuobyteHD#QuobyteHD',id=808f1fbe-ed65-41e4-aef2-8acea03bd332,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7986c9870cb42a59a4996e8eb570824',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:29:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:29:20Z,use_quota=True,user_id='ccfa09352edb4ad4822c5fb4ac3ea72b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(452963ae-5b93-40f9-b1b6-112ed13b2d3f),volume_type_id=452963ae-5b93-40f9-b1b6-112ed13b2d3f)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:29:20 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3cec9bb9-9d53-44e8-be97-d1795356aa92 tempest-GroupsV314Test-1382985782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09e53133-7079-4456-a6d0-2912db05e240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:29:20 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3cec9bb9-9d53-44e8-be97-d1795356aa92 tempest-GroupsV314Test-1382985782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09e53133-7079-4456-a6d0-2912db05e240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:29:20 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3cec9bb9-9d53-44e8-be97-d1795356aa92 tempest-GroupsV314Test-1382985782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba70ebd9-4468-4ffb-bcc6-a5ba9fed209b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:29:20 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3cec9bb9-9d53-44e8-be97-d1795356aa92 tempest-GroupsV314Test-1382985782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba70ebd9-4468-4ffb-bcc6-a5ba9fed209b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '808f1fbe-ed65-41e4-aef2-8acea03bd332', 'volume_name': 'volume-808f1fbe-ed65-41e4-aef2-8acea03bd332', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:29:20 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3cec9bb9-9d53-44e8-be97-d1795356aa92 tempest-GroupsV314Test-1382985782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a0be2aa-0f1e-4d7a-9aa3-3e184029c66b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:29:20 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3cec9bb9-9d53-44e8-be97-d1795356aa92 tempest-GroupsV314Test-1382985782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a0be2aa-0f1e-4d7a-9aa3-3e184029c66b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:29:20 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3cec9bb9-9d53-44e8-be97-d1795356aa92 tempest-GroupsV314Test-1382985782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05f94ffa-bde6-4543-9bd1-8df36f8817ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:29:20 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-3cec9bb9-9d53-44e8-be97-d1795356aa92 tempest-GroupsV314Test-1382985782 None] Volume 808f1fbe-ed65-41e4-aef2-8acea03bd332: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-808f1fbe-ed65-41e4-aef2-8acea03bd332', 'volume_size': 1}
Jul 14 16:29:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3cec9bb9-9d53-44e8-be97-d1795356aa92 tempest-GroupsV314Test-1382985782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:29:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3cec9bb9-9d53-44e8-be97-d1795356aa92 tempest-GroupsV314Test-1382985782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:29:20 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-3cec9bb9-9d53-44e8-be97-d1795356aa92 tempest-GroupsV314Test-1382985782 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=07d90aaa-0a72-4d3e-958c-4a57549ff9bd,created_at=2026-07-14T14:29:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2056322208',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=07d90aaa-0a72-4d3e-958c-4a57549ff9bd,host='devstack@QuobyteHD#QuobyteHD',id=808f1fbe-ed65-41e4-aef2-8acea03bd332,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7986c9870cb42a59a4996e8eb570824',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:29:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:29:20Z,use_quota=True,user_id='ccfa09352edb4ad4822c5fb4ac3ea72b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(452963ae-5b93-40f9-b1b6-112ed13b2d3f),volume_type_id=452963ae-5b93-40f9-b1b6-112ed13b2d3f)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:29:20 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-3cec9bb9-9d53-44e8-be97-d1795356aa92 tempest-GroupsV314Test-1382985782 None] Creating volume 808f1fbe-ed65-41e4-aef2-8acea03bd332 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:29:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3cec9bb9-9d53-44e8-be97-d1795356aa92 tempest-GroupsV314Test-1382985782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:29:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3cec9bb9-9d53-44e8-be97-d1795356aa92 tempest-GroupsV314Test-1382985782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:29:20 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-3cec9bb9-9d53-44e8-be97-d1795356aa92 tempest-GroupsV314Test-1382985782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:29:20 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-3cec9bb9-9d53-44e8-be97-d1795356aa92 tempest-GroupsV314Test-1382985782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:29:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3cec9bb9-9d53-44e8-be97-d1795356aa92 tempest-GroupsV314Test-1382985782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:29:20 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-3cec9bb9-9d53-44e8-be97-d1795356aa92 tempest-GroupsV314Test-1382985782 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:29:20 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-3cec9bb9-9d53-44e8-be97-d1795356aa92 tempest-GroupsV314Test-1382985782 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:29:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3cec9bb9-9d53-44e8-be97-d1795356aa92 tempest-GroupsV314Test-1382985782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-808f1fbe-ed65-41e4-aef2-8acea03bd332 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:29:20 devstack sudo[95591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-808f1fbe-ed65-41e4-aef2-8acea03bd332 1073741824
Jul 14 16:29:20 devstack sudo[95591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:29:21 devstack sudo[95591]: pam_unix(sudo:session): session closed for user root
Jul 14 16:29:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3cec9bb9-9d53-44e8-be97-d1795356aa92 tempest-GroupsV314Test-1382985782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-808f1fbe-ed65-41e4-aef2-8acea03bd332 1073741824" returned: 0 in 0.657s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:29:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3cec9bb9-9d53-44e8-be97-d1795356aa92 tempest-GroupsV314Test-1382985782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-808f1fbe-ed65-41e4-aef2-8acea03bd332 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:29:21 devstack sudo[95603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-808f1fbe-ed65-41e4-aef2-8acea03bd332
Jul 14 16:29:21 devstack sudo[95603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:29:21 devstack sudo[95603]: pam_unix(sudo:session): session closed for user root
Jul 14 16:29:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3cec9bb9-9d53-44e8-be97-d1795356aa92 tempest-GroupsV314Test-1382985782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-808f1fbe-ed65-41e4-aef2-8acea03bd332" returned: 0 in 0.290s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:29:21 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-3cec9bb9-9d53-44e8-be97-d1795356aa92 tempest-GroupsV314Test-1382985782 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:29:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3cec9bb9-9d53-44e8-be97-d1795356aa92 tempest-GroupsV314Test-1382985782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:29:21 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3cec9bb9-9d53-44e8-be97-d1795356aa92 tempest-GroupsV314Test-1382985782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05f94ffa-bde6-4543-9bd1-8df36f8817ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-808f1fbe-ed65-41e4-aef2-8acea03bd332', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:29:21 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3cec9bb9-9d53-44e8-be97-d1795356aa92 tempest-GroupsV314Test-1382985782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9d6e8a2-8cb0-46d8-9803-8747ad24908d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:29:21 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-3cec9bb9-9d53-44e8-be97-d1795356aa92 tempest-GroupsV314Test-1382985782 None] Volume volume-808f1fbe-ed65-41e4-aef2-8acea03bd332 (808f1fbe-ed65-41e4-aef2-8acea03bd332): created successfully
Jul 14 16:29:21 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3cec9bb9-9d53-44e8-be97-d1795356aa92 tempest-GroupsV314Test-1382985782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9d6e8a2-8cb0-46d8-9803-8747ad24908d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:29:21 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3cec9bb9-9d53-44e8-be97-d1795356aa92 tempest-GroupsV314Test-1382985782 None] Flow 'volume_create_manager' (c84ad16e-412d-4763-9f5a-fd10a94021d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:29:21 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-3cec9bb9-9d53-44e8-be97-d1795356aa92 tempest-GroupsV314Test-1382985782 None] Created volume successfully.
Jul 14 16:29:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6a9d0c5e-732f-4d24-a50b-5690e635a45c tempest-GroupsV314Test-1382985782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:29:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6a9d0c5e-732f-4d24-a50b-5690e635a45c tempest-GroupsV314Test-1382985782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.002s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:29:24 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-6a9d0c5e-732f-4d24-a50b-5690e635a45c tempest-GroupsV314Test-1382985782 None] Cloning volume 808f1fbe-ed65-41e4-aef2-8acea03bd332 to volume 8dee0f2a-74e4-4e61-ab44-bebe64edd5f2
Jul 14 16:29:24 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-6a9d0c5e-732f-4d24-a50b-5690e635a45c tempest-GroupsV314Test-1382985782 None] Creating offline snapshot ff7977ed-2b1f-4766-b0d1-3f8cb71a8897 of volume 808f1fbe-ed65-41e4-aef2-8acea03bd332 {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 16:29:24 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ddcfe2-6bb8-473e-8740-672bca14ecc0]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:29:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6a9d0c5e-732f-4d24-a50b-5690e635a45c tempest-GroupsV314Test-1382985782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-808f1fbe-ed65-41e4-aef2-8acea03bd332 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:29:24 devstack sudo[95696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-808f1fbe-ed65-41e4-aef2-8acea03bd332
Jul 14 16:29:24 devstack sudo[95696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:29:25 devstack sudo[95696]: pam_unix(sudo:session): session closed for user root
Jul 14 16:29:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6a9d0c5e-732f-4d24-a50b-5690e635a45c tempest-GroupsV314Test-1382985782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-808f1fbe-ed65-41e4-aef2-8acea03bd332" returned: 0 in 0.663s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:29:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6a9d0c5e-732f-4d24-a50b-5690e635a45c tempest-GroupsV314Test-1382985782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-808f1fbe-ed65-41e4-aef2-8acea03bd332,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-808f1fbe-ed65-41e4-aef2-8acea03bd332.ff7977ed-2b1f-4766-b0d1-3f8cb71a8897 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:29:25 devstack sudo[95706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-808f1fbe-ed65-41e4-aef2-8acea03bd332,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-808f1fbe-ed65-41e4-aef2-8acea03bd332.ff7977ed-2b1f-4766-b0d1-3f8cb71a8897 1G
Jul 14 16:29:25 devstack sudo[95706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:29:25 devstack sudo[95706]: pam_unix(sudo:session): session closed for user root
Jul 14 16:29:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6a9d0c5e-732f-4d24-a50b-5690e635a45c tempest-GroupsV314Test-1382985782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-808f1fbe-ed65-41e4-aef2-8acea03bd332,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-808f1fbe-ed65-41e4-aef2-8acea03bd332.ff7977ed-2b1f-4766-b0d1-3f8cb71a8897 1G" returned: 0 in 0.723s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:29:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6a9d0c5e-732f-4d24-a50b-5690e635a45c tempest-GroupsV314Test-1382985782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-808f1fbe-ed65-41e4-aef2-8acea03bd332 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-808f1fbe-ed65-41e4-aef2-8acea03bd332.ff7977ed-2b1f-4766-b0d1-3f8cb71a8897 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:29:25 devstack sudo[95714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-808f1fbe-ed65-41e4-aef2-8acea03bd332 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-808f1fbe-ed65-41e4-aef2-8acea03bd332.ff7977ed-2b1f-4766-b0d1-3f8cb71a8897
Jul 14 16:29:25 devstack sudo[95714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:29:26 devstack sudo[95714]: pam_unix(sudo:session): session closed for user root
Jul 14 16:29:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6a9d0c5e-732f-4d24-a50b-5690e635a45c tempest-GroupsV314Test-1382985782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-808f1fbe-ed65-41e4-aef2-8acea03bd332 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-808f1fbe-ed65-41e4-aef2-8acea03bd332.ff7977ed-2b1f-4766-b0d1-3f8cb71a8897" returned: 0 in 0.604s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:29:26 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-6a9d0c5e-732f-4d24-a50b-5690e635a45c tempest-GroupsV314Test-1382985782 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-808f1fbe-ed65-41e4-aef2-8acea03bd332.ff7977ed-2b1f-4766-b0d1-3f8cb71a8897 is being set with open permissions: ugo+rw: NotImplementedError
Jul 14 16:29:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6a9d0c5e-732f-4d24-a50b-5690e635a45c tempest-GroupsV314Test-1382985782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-808f1fbe-ed65-41e4-aef2-8acea03bd332.ff7977ed-2b1f-4766-b0d1-3f8cb71a8897 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:29:26 devstack sudo[95721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-808f1fbe-ed65-41e4-aef2-8acea03bd332.ff7977ed-2b1f-4766-b0d1-3f8cb71a8897
Jul 14 16:29:26 devstack sudo[95721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:29:27 devstack sudo[95721]: pam_unix(sudo:session): session closed for user root
Jul 14 16:29:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6a9d0c5e-732f-4d24-a50b-5690e635a45c tempest-GroupsV314Test-1382985782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-808f1fbe-ed65-41e4-aef2-8acea03bd332.ff7977ed-2b1f-4766-b0d1-3f8cb71a8897" returned: 0 in 0.650s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:29:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6a9d0c5e-732f-4d24-a50b-5690e635a45c tempest-GroupsV314Test-1382985782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-808f1fbe-ed65-41e4-aef2-8acea03bd332.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:29:27 devstack sudo[95727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-808f1fbe-ed65-41e4-aef2-8acea03bd332.info
Jul 14 16:29:27 devstack sudo[95727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:29:27 devstack sudo[95727]: pam_unix(sudo:session): session closed for user root
Jul 14 16:29:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6a9d0c5e-732f-4d24-a50b-5690e635a45c tempest-GroupsV314Test-1382985782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-808f1fbe-ed65-41e4-aef2-8acea03bd332.info" returned: 0 in 0.340s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:29:27 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-6a9d0c5e-732f-4d24-a50b-5690e635a45c tempest-GroupsV314Test-1382985782 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-808f1fbe-ed65-41e4-aef2-8acea03bd332.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 14 16:29:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6a9d0c5e-732f-4d24-a50b-5690e635a45c tempest-GroupsV314Test-1382985782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-808f1fbe-ed65-41e4-aef2-8acea03bd332.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:29:27 devstack sudo[95730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-808f1fbe-ed65-41e4-aef2-8acea03bd332.info
Jul 14 16:29:27 devstack sudo[95730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:29:27 devstack sudo[95730]: pam_unix(sudo:session): session closed for user root
Jul 14 16:29:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6a9d0c5e-732f-4d24-a50b-5690e635a45c tempest-GroupsV314Test-1382985782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-808f1fbe-ed65-41e4-aef2-8acea03bd332.info" returned: 0 in 0.352s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:29:27 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6a9d0c5e-732f-4d24-a50b-5690e635a45c tempest-GroupsV314Test-1382985782 None] Acquiring lock "cinder-quobyte-8dee0f2a-74e4-4e61-ab44-bebe64edd5f2" by "_copy_volume_from_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:29:27 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6a9d0c5e-732f-4d24-a50b-5690e635a45c tempest-GroupsV314Test-1382985782 None] Lock "cinder-quobyte-8dee0f2a-74e4-4e61-ab44-bebe64edd5f2" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:29:27 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6a9d0c5e-732f-4d24-a50b-5690e635a45c tempest-GroupsV314Test-1382985782 None] snapshot: ff7977ed-2b1f-4766-b0d1-3f8cb71a8897, volume: 8dee0f2a-74e4-4e61-ab44-bebe64edd5f2,  {{(pid=87166) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 14 16:29:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6a9d0c5e-732f-4d24-a50b-5690e635a45c tempest-GroupsV314Test-1382985782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:29:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6a9d0c5e-732f-4d24-a50b-5690e635a45c tempest-GroupsV314Test-1382985782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:29:27 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6a9d0c5e-732f-4d24-a50b-5690e635a45c tempest-GroupsV314Test-1382985782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:29:27 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6a9d0c5e-732f-4d24-a50b-5690e635a45c tempest-GroupsV314Test-1382985782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:29:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6a9d0c5e-732f-4d24-a50b-5690e635a45c tempest-GroupsV314Test-1382985782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:29:27 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9fcd700-c47a-4cf1-88ef-fc6aba681c6c]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:29:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6a9d0c5e-732f-4d24-a50b-5690e635a45c tempest-GroupsV314Test-1382985782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-808f1fbe-ed65-41e4-aef2-8acea03bd332.ff7977ed-2b1f-4766-b0d1-3f8cb71a8897 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:29:28 devstack sudo[95734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-808f1fbe-ed65-41e4-aef2-8acea03bd332.ff7977ed-2b1f-4766-b0d1-3f8cb71a8897
Jul 14 16:29:28 devstack sudo[95734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:29:28 devstack sudo[95734]: pam_unix(sudo:session): session closed for user root
Jul 14 16:29:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6a9d0c5e-732f-4d24-a50b-5690e635a45c tempest-GroupsV314Test-1382985782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-808f1fbe-ed65-41e4-aef2-8acea03bd332.ff7977ed-2b1f-4766-b0d1-3f8cb71a8897" returned: 0 in 0.571s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:29:28 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-6a9d0c5e-732f-4d24-a50b-5690e635a45c tempest-GroupsV314Test-1382985782 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-808f1fbe-ed65-41e4-aef2-8acea03bd332(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 16:29:28 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6a9d0c5e-732f-4d24-a50b-5690e635a45c tempest-GroupsV314Test-1382985782 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-808f1fbe-ed65-41e4-aef2-8acea03bd332 {{(pid=87166) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 14 16:29:28 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6a9d0c5e-732f-4d24-a50b-5690e635a45c tempest-GroupsV314Test-1382985782 None] Creating direct copy from snapshot {{(pid=87166) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 14 16:29:28 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6a47bf-972d-4d16-833e-493c4dd64049]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:29:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6a9d0c5e-732f-4d24-a50b-5690e635a45c tempest-GroupsV314Test-1382985782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-808f1fbe-ed65-41e4-aef2-8acea03bd332 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:29:28 devstack sudo[95739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-808f1fbe-ed65-41e4-aef2-8acea03bd332
Jul 14 16:29:28 devstack sudo[95739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:29:29 devstack sudo[95739]: pam_unix(sudo:session): session closed for user root
Jul 14 16:29:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6a9d0c5e-732f-4d24-a50b-5690e635a45c tempest-GroupsV314Test-1382985782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-808f1fbe-ed65-41e4-aef2-8acea03bd332" returned: 0 in 0.649s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:29:29 devstack cinder-volume[87166]: DEBUG cinder.utils [None req-6a9d0c5e-732f-4d24-a50b-5690e635a45c tempest-GroupsV314Test-1382985782 None] Path /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8dee0f2a-74e4-4e61-ab44-bebe64edd5f2 not found in is_blk_device check {{(pid=87166) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 14 16:29:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6a9d0c5e-732f-4d24-a50b-5690e635a45c tempest-GroupsV314Test-1382985782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-808f1fbe-ed65-41e4-aef2-8acea03bd332 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8dee0f2a-74e4-4e61-ab44-bebe64edd5f2 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:29:29 devstack sudo[95747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-808f1fbe-ed65-41e4-aef2-8acea03bd332 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8dee0f2a-74e4-4e61-ab44-bebe64edd5f2
Jul 14 16:29:29 devstack sudo[95747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:29:35 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 16:29:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:29:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:29:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:29:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:29:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:29:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:29:35 devstack sudo[95794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:29:35 devstack sudo[95794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:29:36 devstack sudo[95794]: pam_unix(sudo:session): session closed for user root
Jul 14 16:29:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 1.195s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:29:36 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:29:36 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Running periodic task VolumeManager._thread_info {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 16:29:36 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] thread count: 8 {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 14 16:29:36 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] thread info: [<_MainThread(MainThread, started 128606490927232)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128606415432960)>, <Thread(Thread-3 (stat_writer), started daemon 128606378859328)>, <Thread(Rabbit-heartbeat, started daemon 128606379646144)>, <Thread(Thread-5 (_runner), started daemon 128606377685824)>, <Thread(Thread-7 (_runner), started daemon 128606377701888)>, <Thread(fd_logger, started daemon 128606377091392)>, <Thread(privsep_reader, started daemon 128606375782080)>] {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 14 16:29:37 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:SELECT=93,cinder:INSERT=27,cinder:UPDATE=89,cinder:DELETE=1 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 16:29:37 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:INSERT=23,cinder:UPDATE=93,cinder:SELECT=96,cinder:DELETE=3 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 16:29:37 devstack sudo[95747]: pam_unix(sudo:session): session closed for user root
Jul 14 16:29:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6a9d0c5e-732f-4d24-a50b-5690e635a45c tempest-GroupsV314Test-1382985782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-808f1fbe-ed65-41e4-aef2-8acea03bd332 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8dee0f2a-74e4-4e61-ab44-bebe64edd5f2" returned: 0 in 8.548s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:29:37 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[96db6b3a-7fd8-4f5c-8126-4991991820c2]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:29:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6a9d0c5e-732f-4d24-a50b-5690e635a45c tempest-GroupsV314Test-1382985782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-808f1fbe-ed65-41e4-aef2-8acea03bd332 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:29:37 devstack sudo[95819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-808f1fbe-ed65-41e4-aef2-8acea03bd332
Jul 14 16:29:37 devstack sudo[95819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:29:38 devstack sudo[95819]: pam_unix(sudo:session): session closed for user root
Jul 14 16:29:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6a9d0c5e-732f-4d24-a50b-5690e635a45c tempest-GroupsV314Test-1382985782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-808f1fbe-ed65-41e4-aef2-8acea03bd332" returned: 0 in 0.782s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:29:38 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-6a9d0c5e-732f-4d24-a50b-5690e635a45c tempest-GroupsV314Test-1382985782 None] Image conversion details: src /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-808f1fbe-ed65-41e4-aef2-8acea03bd332, size 1024.00 MB, duration 8.55 sec, destination /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8dee0f2a-74e4-4e61-ab44-bebe64edd5f2 {{(pid=87166) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 14 16:29:38 devstack cinder-volume[87166]: INFO cinder.image.image_utils [None req-6a9d0c5e-732f-4d24-a50b-5690e635a45c tempest-GroupsV314Test-1382985782 None] Converted 1024.00 MB image at 119.78 MB/s
Jul 14 16:29:38 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-6a9d0c5e-732f-4d24-a50b-5690e635a45c tempest-GroupsV314Test-1382985782 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8dee0f2a-74e4-4e61-ab44-bebe64edd5f2 is being set with open permissions: ugo+rw: NotImplementedError
Jul 14 16:29:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6a9d0c5e-732f-4d24-a50b-5690e635a45c tempest-GroupsV314Test-1382985782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8dee0f2a-74e4-4e61-ab44-bebe64edd5f2 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:29:38 devstack sudo[95836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8dee0f2a-74e4-4e61-ab44-bebe64edd5f2
Jul 14 16:29:38 devstack sudo[95836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:29:39 devstack sudo[95836]: pam_unix(sudo:session): session closed for user root
Jul 14 16:29:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6a9d0c5e-732f-4d24-a50b-5690e635a45c tempest-GroupsV314Test-1382985782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8dee0f2a-74e4-4e61-ab44-bebe64edd5f2" returned: 0 in 0.486s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:29:39 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6a9d0c5e-732f-4d24-a50b-5690e635a45c tempest-GroupsV314Test-1382985782 None] Lock "cinder-quobyte-8dee0f2a-74e4-4e61-ab44-bebe64edd5f2" released by "_copy_volume_from_snapshot" :: held 11.211s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:29:39 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6a9d0c5e-732f-4d24-a50b-5690e635a45c tempest-GroupsV314Test-1382985782 None] Acquiring lock "cinder-quobyte-ff7977ed-2b1f-4766-b0d1-3f8cb71a8897" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:29:39 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6a9d0c5e-732f-4d24-a50b-5690e635a45c tempest-GroupsV314Test-1382985782 None] Lock "cinder-quobyte-ff7977ed-2b1f-4766-b0d1-3f8cb71a8897" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:29:39 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-6a9d0c5e-732f-4d24-a50b-5690e635a45c tempest-GroupsV314Test-1382985782 None] Deleting offline snapshot ff7977ed-2b1f-4766-b0d1-3f8cb71a8897 of volume 808f1fbe-ed65-41e4-aef2-8acea03bd332 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 16:29:39 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-6a9d0c5e-732f-4d24-a50b-5690e635a45c tempest-GroupsV314Test-1382985782 None] snapshot_file for this snap is: volume-808f1fbe-ed65-41e4-aef2-8acea03bd332.ff7977ed-2b1f-4766-b0d1-3f8cb71a8897 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 16:29:39 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[f65549e1-4559-43bc-bdc6-332e4474bbfe]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:29:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6a9d0c5e-732f-4d24-a50b-5690e635a45c tempest-GroupsV314Test-1382985782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-808f1fbe-ed65-41e4-aef2-8acea03bd332.ff7977ed-2b1f-4766-b0d1-3f8cb71a8897 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:29:39 devstack sudo[95883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-808f1fbe-ed65-41e4-aef2-8acea03bd332.ff7977ed-2b1f-4766-b0d1-3f8cb71a8897
Jul 14 16:29:39 devstack sudo[95883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:29:39 devstack sudo[95883]: pam_unix(sudo:session): session closed for user root
Jul 14 16:29:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6a9d0c5e-732f-4d24-a50b-5690e635a45c tempest-GroupsV314Test-1382985782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-808f1fbe-ed65-41e4-aef2-8acea03bd332.ff7977ed-2b1f-4766-b0d1-3f8cb71a8897" returned: 0 in 0.763s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:29:39 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-6a9d0c5e-732f-4d24-a50b-5690e635a45c tempest-GroupsV314Test-1382985782 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-808f1fbe-ed65-41e4-aef2-8acea03bd332(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 16:29:40 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6f87061-1839-4abc-b703-849a360e5c43]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:29:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6a9d0c5e-732f-4d24-a50b-5690e635a45c tempest-GroupsV314Test-1382985782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-808f1fbe-ed65-41e4-aef2-8acea03bd332 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:29:40 devstack sudo[95900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-808f1fbe-ed65-41e4-aef2-8acea03bd332
Jul 14 16:29:40 devstack sudo[95900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:29:40 devstack sudo[95900]: pam_unix(sudo:session): session closed for user root
Jul 14 16:29:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6a9d0c5e-732f-4d24-a50b-5690e635a45c tempest-GroupsV314Test-1382985782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-808f1fbe-ed65-41e4-aef2-8acea03bd332" returned: 0 in 0.623s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:29:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6a9d0c5e-732f-4d24-a50b-5690e635a45c tempest-GroupsV314Test-1382985782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-808f1fbe-ed65-41e4-aef2-8acea03bd332.ff7977ed-2b1f-4766-b0d1-3f8cb71a8897 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:29:40 devstack sudo[95908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-808f1fbe-ed65-41e4-aef2-8acea03bd332.ff7977ed-2b1f-4766-b0d1-3f8cb71a8897
Jul 14 16:29:40 devstack sudo[95908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:29:41 devstack sudo[95908]: pam_unix(sudo:session): session closed for user root
Jul 14 16:29:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6a9d0c5e-732f-4d24-a50b-5690e635a45c tempest-GroupsV314Test-1382985782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-808f1fbe-ed65-41e4-aef2-8acea03bd332.ff7977ed-2b1f-4766-b0d1-3f8cb71a8897" returned: 0 in 0.601s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:29:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6a9d0c5e-732f-4d24-a50b-5690e635a45c tempest-GroupsV314Test-1382985782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-808f1fbe-ed65-41e4-aef2-8acea03bd332.ff7977ed-2b1f-4766-b0d1-3f8cb71a8897 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:29:41 devstack sudo[95917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-808f1fbe-ed65-41e4-aef2-8acea03bd332.ff7977ed-2b1f-4766-b0d1-3f8cb71a8897
Jul 14 16:29:41 devstack sudo[95917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:29:41 devstack sudo[95917]: pam_unix(sudo:session): session closed for user root
Jul 14 16:29:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6a9d0c5e-732f-4d24-a50b-5690e635a45c tempest-GroupsV314Test-1382985782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-808f1fbe-ed65-41e4-aef2-8acea03bd332.ff7977ed-2b1f-4766-b0d1-3f8cb71a8897" returned: 0 in 0.351s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:29:41 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6a9d0c5e-732f-4d24-a50b-5690e635a45c tempest-GroupsV314Test-1382985782 None] Lock "cinder-quobyte-ff7977ed-2b1f-4766-b0d1-3f8cb71a8897" released by "_delete_snapshot" :: held 2.489s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:29:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6a9d0c5e-732f-4d24-a50b-5690e635a45c tempest-GroupsV314Test-1382985782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.413s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:29:41 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-6a9d0c5e-732f-4d24-a50b-5690e635a45c tempest-GroupsV314Test-1382985782 None] Create group from source-group-07d90aaa-0a72-4d3e-958c-4a57549ff9bd completed successfully.
Jul 14 16:29:43 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-dc4867e0-13c2-4494-b651-6eed78b68144 tempest-GroupsV314Test-1382985782 None] Acquiring lock "cinder-quobyte-8dee0f2a-74e4-4e61-ab44-bebe64edd5f2" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:29:43 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-dc4867e0-13c2-4494-b651-6eed78b68144 tempest-GroupsV314Test-1382985782 None] Lock "cinder-quobyte-8dee0f2a-74e4-4e61-ab44-bebe64edd5f2" acquired by "delete_volume" :: waited 0.032s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:29:43 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[b407b48e-d958-42d1-9602-ede21bbbbd05]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:29:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-dc4867e0-13c2-4494-b651-6eed78b68144 tempest-GroupsV314Test-1382985782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8dee0f2a-74e4-4e61-ab44-bebe64edd5f2 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:29:43 devstack sudo[95935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8dee0f2a-74e4-4e61-ab44-bebe64edd5f2
Jul 14 16:29:43 devstack sudo[95935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:29:43 devstack sudo[95935]: pam_unix(sudo:session): session closed for user root
Jul 14 16:29:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-dc4867e0-13c2-4494-b651-6eed78b68144 tempest-GroupsV314Test-1382985782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8dee0f2a-74e4-4e61-ab44-bebe64edd5f2" returned: 0 in 0.589s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:29:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-dc4867e0-13c2-4494-b651-6eed78b68144 tempest-GroupsV314Test-1382985782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8dee0f2a-74e4-4e61-ab44-bebe64edd5f2 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:29:43 devstack sudo[95942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8dee0f2a-74e4-4e61-ab44-bebe64edd5f2
Jul 14 16:29:43 devstack sudo[95942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:29:44 devstack sudo[95942]: pam_unix(sudo:session): session closed for user root
Jul 14 16:29:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-dc4867e0-13c2-4494-b651-6eed78b68144 tempest-GroupsV314Test-1382985782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8dee0f2a-74e4-4e61-ab44-bebe64edd5f2" returned: 0 in 0.286s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:29:44 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-dc4867e0-13c2-4494-b651-6eed78b68144 tempest-GroupsV314Test-1382985782 None] Lock "cinder-quobyte-8dee0f2a-74e4-4e61-ab44-bebe64edd5f2" released by "delete_volume" :: held 0.994s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:29:44 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-dc4867e0-13c2-4494-b651-6eed78b68144 tempest-GroupsV314Test-1382985782 None] Created reservations ['dfd238a2-b91d-4190-b80f-1be08d6229f6'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:29:44 devstack cinder-volume[87166]: WARNING cinder.quota [None req-dc4867e0-13c2-4494-b651-6eed78b68144 tempest-GroupsV314Test-1382985782 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1840073596 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1840073596, it is now deprecated. Please use the default quota class for default quota.
Jul 14 16:29:44 devstack cinder-volume[87166]: WARNING cinder.quota [None req-dc4867e0-13c2-4494-b651-6eed78b68144 tempest-GroupsV314Test-1382985782 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1840073596 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1840073596, it is now deprecated. Please use the default quota class for default quota.
Jul 14 16:29:44 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-dc4867e0-13c2-4494-b651-6eed78b68144 tempest-GroupsV314Test-1382985782 None] Created reservations ['603566f2-abeb-4162-91af-35626e9d0482', 'eacc694e-cf70-4c0e-82a5-4c465df7919f', 'a74ae56c-9c16-42b6-8830-f4b5965b3ca0', '473cdc16-cf32-4e26-9d10-cf78dad66bbe'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:29:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-dc4867e0-13c2-4494-b651-6eed78b68144 tempest-GroupsV314Test-1382985782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:29:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-dc4867e0-13c2-4494-b651-6eed78b68144 tempest-GroupsV314Test-1382985782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:29:44 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-dc4867e0-13c2-4494-b651-6eed78b68144 tempest-GroupsV314Test-1382985782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:29:44 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-dc4867e0-13c2-4494-b651-6eed78b68144 tempest-GroupsV314Test-1382985782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:29:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-dc4867e0-13c2-4494-b651-6eed78b68144 tempest-GroupsV314Test-1382985782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:29:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-dc4867e0-13c2-4494-b651-6eed78b68144 tempest-GroupsV314Test-1382985782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:29:44 devstack sudo[95945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:29:44 devstack sudo[95945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:29:45 devstack sudo[95945]: pam_unix(sudo:session): session closed for user root
Jul 14 16:29:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-dc4867e0-13c2-4494-b651-6eed78b68144 tempest-GroupsV314Test-1382985782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.547s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:29:45 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-dc4867e0-13c2-4494-b651-6eed78b68144 tempest-GroupsV314Test-1382985782 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:29:45 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-dc4867e0-13c2-4494-b651-6eed78b68144 tempest-GroupsV314Test-1382985782 None] Delete group completed successfully.
Jul 14 16:29:45 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-40a90f20-72a2-4aef-b8c6-9077ed6f27c7 tempest-TestMinimumBasicScenario-258503962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:29:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-40a90f20-72a2-4aef-b8c6-9077ed6f27c7 tempest-TestMinimumBasicScenario-258503962 None] Flow 'volume_create_manager' (79a40f9d-8637-4801-b287-7463808ee024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:29:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-40a90f20-72a2-4aef-b8c6-9077ed6f27c7 tempest-TestMinimumBasicScenario-258503962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e31102f0-7c0e-4ede-a53a-a3fc28629d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:29:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-40a90f20-72a2-4aef-b8c6-9077ed6f27c7 tempest-TestMinimumBasicScenario-258503962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e31102f0-7c0e-4ede-a53a-a3fc28629d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:29:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1278221630',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb39fd60-df8a-43cf-95f3-d862952cfc02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='974124485b73489e9ff6ee0b691366cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:29:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:29:45Z,use_quota=True,user_id='78cabba6ee4541b6bf530967c03e0cb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:29:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-40a90f20-72a2-4aef-b8c6-9077ed6f27c7 tempest-TestMinimumBasicScenario-258503962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06ee27d7-9824-4f5f-82cf-4ab9e9ac3e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:29:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-40a90f20-72a2-4aef-b8c6-9077ed6f27c7 tempest-TestMinimumBasicScenario-258503962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06ee27d7-9824-4f5f-82cf-4ab9e9ac3e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:29:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-40a90f20-72a2-4aef-b8c6-9077ed6f27c7 tempest-TestMinimumBasicScenario-258503962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef5fb95a-6a48-4f6d-b4c7-663ea34ca709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:29:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-40a90f20-72a2-4aef-b8c6-9077ed6f27c7 tempest-TestMinimumBasicScenario-258503962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef5fb95a-6a48-4f6d-b4c7-663ea34ca709) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb39fd60-df8a-43cf-95f3-d862952cfc02', 'volume_name': 'volume-cb39fd60-df8a-43cf-95f3-d862952cfc02', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:29:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-40a90f20-72a2-4aef-b8c6-9077ed6f27c7 tempest-TestMinimumBasicScenario-258503962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (652c4d83-65d7-426e-9665-ee924134dbbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:29:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-40a90f20-72a2-4aef-b8c6-9077ed6f27c7 tempest-TestMinimumBasicScenario-258503962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (652c4d83-65d7-426e-9665-ee924134dbbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:29:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-40a90f20-72a2-4aef-b8c6-9077ed6f27c7 tempest-TestMinimumBasicScenario-258503962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1eded84b-d6de-472b-a51c-b242a1a20a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:29:45 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-40a90f20-72a2-4aef-b8c6-9077ed6f27c7 tempest-TestMinimumBasicScenario-258503962 None] Volume cb39fd60-df8a-43cf-95f3-d862952cfc02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb39fd60-df8a-43cf-95f3-d862952cfc02', 'volume_size': 1}
Jul 14 16:29:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-40a90f20-72a2-4aef-b8c6-9077ed6f27c7 tempest-TestMinimumBasicScenario-258503962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:29:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-40a90f20-72a2-4aef-b8c6-9077ed6f27c7 tempest-TestMinimumBasicScenario-258503962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:29:45 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-40a90f20-72a2-4aef-b8c6-9077ed6f27c7 tempest-TestMinimumBasicScenario-258503962 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:29:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1278221630',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb39fd60-df8a-43cf-95f3-d862952cfc02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='974124485b73489e9ff6ee0b691366cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:29:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:29:45Z,use_quota=True,user_id='78cabba6ee4541b6bf530967c03e0cb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:29:45 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-40a90f20-72a2-4aef-b8c6-9077ed6f27c7 tempest-TestMinimumBasicScenario-258503962 None] Creating volume cb39fd60-df8a-43cf-95f3-d862952cfc02 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:29:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-40a90f20-72a2-4aef-b8c6-9077ed6f27c7 tempest-TestMinimumBasicScenario-258503962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:29:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-40a90f20-72a2-4aef-b8c6-9077ed6f27c7 tempest-TestMinimumBasicScenario-258503962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:29:45 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-40a90f20-72a2-4aef-b8c6-9077ed6f27c7 tempest-TestMinimumBasicScenario-258503962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:29:45 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-40a90f20-72a2-4aef-b8c6-9077ed6f27c7 tempest-TestMinimumBasicScenario-258503962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:29:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-40a90f20-72a2-4aef-b8c6-9077ed6f27c7 tempest-TestMinimumBasicScenario-258503962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:29:45 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-40a90f20-72a2-4aef-b8c6-9077ed6f27c7 tempest-TestMinimumBasicScenario-258503962 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:29:45 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-40a90f20-72a2-4aef-b8c6-9077ed6f27c7 tempest-TestMinimumBasicScenario-258503962 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:29:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-40a90f20-72a2-4aef-b8c6-9077ed6f27c7 tempest-TestMinimumBasicScenario-258503962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cb39fd60-df8a-43cf-95f3-d862952cfc02 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:29:45 devstack sudo[95949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cb39fd60-df8a-43cf-95f3-d862952cfc02 1073741824
Jul 14 16:29:45 devstack sudo[95949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:29:46 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-723c546f-76f7-46b2-bf94-5a896d77554d tempest-GroupsV314Test-1382985782 None] Acquiring lock "cinder-quobyte-808f1fbe-ed65-41e4-aef2-8acea03bd332" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:29:46 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-723c546f-76f7-46b2-bf94-5a896d77554d tempest-GroupsV314Test-1382985782 None] Lock "cinder-quobyte-808f1fbe-ed65-41e4-aef2-8acea03bd332" acquired by "delete_volume" :: waited 0.046s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:29:46 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d232ca-98b4-4527-82b8-243a77a4d2e9]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:29:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-723c546f-76f7-46b2-bf94-5a896d77554d tempest-GroupsV314Test-1382985782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-808f1fbe-ed65-41e4-aef2-8acea03bd332 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:29:46 devstack sudo[95955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-808f1fbe-ed65-41e4-aef2-8acea03bd332
Jul 14 16:29:46 devstack sudo[95955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:29:46 devstack sudo[95949]: pam_unix(sudo:session): session closed for user root
Jul 14 16:29:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-40a90f20-72a2-4aef-b8c6-9077ed6f27c7 tempest-TestMinimumBasicScenario-258503962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cb39fd60-df8a-43cf-95f3-d862952cfc02 1073741824" returned: 0 in 0.758s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:29:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-40a90f20-72a2-4aef-b8c6-9077ed6f27c7 tempest-TestMinimumBasicScenario-258503962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cb39fd60-df8a-43cf-95f3-d862952cfc02 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:29:46 devstack sudo[95957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cb39fd60-df8a-43cf-95f3-d862952cfc02
Jul 14 16:29:46 devstack sudo[95957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:29:46 devstack sudo[95955]: pam_unix(sudo:session): session closed for user root
Jul 14 16:29:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-723c546f-76f7-46b2-bf94-5a896d77554d tempest-GroupsV314Test-1382985782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-808f1fbe-ed65-41e4-aef2-8acea03bd332" returned: 0 in 0.655s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:29:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-723c546f-76f7-46b2-bf94-5a896d77554d tempest-GroupsV314Test-1382985782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-808f1fbe-ed65-41e4-aef2-8acea03bd332 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:29:46 devstack sudo[95970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-808f1fbe-ed65-41e4-aef2-8acea03bd332
Jul 14 16:29:46 devstack sudo[95970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:29:47 devstack sudo[95957]: pam_unix(sudo:session): session closed for user root
Jul 14 16:29:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-40a90f20-72a2-4aef-b8c6-9077ed6f27c7 tempest-TestMinimumBasicScenario-258503962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cb39fd60-df8a-43cf-95f3-d862952cfc02" returned: 0 in 0.652s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:29:47 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-40a90f20-72a2-4aef-b8c6-9077ed6f27c7 tempest-TestMinimumBasicScenario-258503962 None] <== create_volume: return (1518ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:29:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-40a90f20-72a2-4aef-b8c6-9077ed6f27c7 tempest-TestMinimumBasicScenario-258503962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.526s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:29:47 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-40a90f20-72a2-4aef-b8c6-9077ed6f27c7 tempest-TestMinimumBasicScenario-258503962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1eded84b-d6de-472b-a51c-b242a1a20a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb39fd60-df8a-43cf-95f3-d862952cfc02', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:29:47 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-40a90f20-72a2-4aef-b8c6-9077ed6f27c7 tempest-TestMinimumBasicScenario-258503962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a2d8321-b27f-464e-828f-c52ddcf73f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:29:47 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-40a90f20-72a2-4aef-b8c6-9077ed6f27c7 tempest-TestMinimumBasicScenario-258503962 None] Volume volume-cb39fd60-df8a-43cf-95f3-d862952cfc02 (cb39fd60-df8a-43cf-95f3-d862952cfc02): created successfully
Jul 14 16:29:47 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-40a90f20-72a2-4aef-b8c6-9077ed6f27c7 tempest-TestMinimumBasicScenario-258503962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a2d8321-b27f-464e-828f-c52ddcf73f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:29:47 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-40a90f20-72a2-4aef-b8c6-9077ed6f27c7 tempest-TestMinimumBasicScenario-258503962 None] Flow 'volume_create_manager' (79a40f9d-8637-4801-b287-7463808ee024) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:29:47 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-40a90f20-72a2-4aef-b8c6-9077ed6f27c7 tempest-TestMinimumBasicScenario-258503962 None] Created volume successfully.
Jul 14 16:29:47 devstack sudo[95970]: pam_unix(sudo:session): session closed for user root
Jul 14 16:29:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-723c546f-76f7-46b2-bf94-5a896d77554d tempest-GroupsV314Test-1382985782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-808f1fbe-ed65-41e4-aef2-8acea03bd332" returned: 0 in 0.703s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:29:47 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-723c546f-76f7-46b2-bf94-5a896d77554d tempest-GroupsV314Test-1382985782 None] Lock "cinder-quobyte-808f1fbe-ed65-41e4-aef2-8acea03bd332" released by "delete_volume" :: held 1.493s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:29:47 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-723c546f-76f7-46b2-bf94-5a896d77554d tempest-GroupsV314Test-1382985782 None] Created reservations ['b4b27001-0011-433f-a63c-ed654254a15b'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:29:47 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-723c546f-76f7-46b2-bf94-5a896d77554d tempest-GroupsV314Test-1382985782 None] Created reservations ['4082e1ed-9e57-44e8-81a1-6e0f336a85bb', '58cc89d3-a16d-4739-9a9a-53c591f09dfb', 'b134b25f-ed40-4b4f-9bf1-388901a4708c', 'c3595503-5b9c-4cf7-b7dd-f55d00923f60'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:29:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-723c546f-76f7-46b2-bf94-5a896d77554d tempest-GroupsV314Test-1382985782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:29:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-723c546f-76f7-46b2-bf94-5a896d77554d tempest-GroupsV314Test-1382985782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:29:48 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-723c546f-76f7-46b2-bf94-5a896d77554d tempest-GroupsV314Test-1382985782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:29:48 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-723c546f-76f7-46b2-bf94-5a896d77554d tempest-GroupsV314Test-1382985782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:29:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-723c546f-76f7-46b2-bf94-5a896d77554d tempest-GroupsV314Test-1382985782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:29:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-723c546f-76f7-46b2-bf94-5a896d77554d tempest-GroupsV314Test-1382985782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:29:48 devstack sudo[96026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:29:48 devstack sudo[96026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:29:49 devstack sudo[96026]: pam_unix(sudo:session): session closed for user root
Jul 14 16:29:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-723c546f-76f7-46b2-bf94-5a896d77554d tempest-GroupsV314Test-1382985782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.790s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:29:49 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-723c546f-76f7-46b2-bf94-5a896d77554d tempest-GroupsV314Test-1382985782 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:29:49 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-723c546f-76f7-46b2-bf94-5a896d77554d tempest-GroupsV314Test-1382985782 None] Delete group completed successfully.
Jul 14 16:29:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-2c6fd61d-5d54-47d4-9adf-7c328053440b req-b81412a9-85be-4d32-b218-dd24d9942389 tempest-TestMinimumBasicScenario-258503962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:29:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-2c6fd61d-5d54-47d4-9adf-7c328053440b req-b81412a9-85be-4d32-b218-dd24d9942389 tempest-TestMinimumBasicScenario-258503962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:29:50 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dbba2c9-c72a-4d9e-9479-ceaa226fb40c]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:29:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-2c6fd61d-5d54-47d4-9adf-7c328053440b req-b81412a9-85be-4d32-b218-dd24d9942389 tempest-TestMinimumBasicScenario-258503962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cb39fd60-df8a-43cf-95f3-d862952cfc02 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:29:50 devstack sudo[96054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cb39fd60-df8a-43cf-95f3-d862952cfc02
Jul 14 16:29:50 devstack sudo[96054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:29:50 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfd629a9-9792-424b-85e2-34ad1fd38a6b tempest-AttachVolumeNegativeTest-1726980645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:29:50 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-dfd629a9-9792-424b-85e2-34ad1fd38a6b tempest-AttachVolumeNegativeTest-1726980645 None] Flow 'volume_create_manager' (ff9a24cd-3fd7-4e83-a111-7158ff7a91aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:29:50 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-dfd629a9-9792-424b-85e2-34ad1fd38a6b tempest-AttachVolumeNegativeTest-1726980645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e59fde6-24a8-4b27-8d51-85bd6a56a1df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:29:50 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-dfd629a9-9792-424b-85e2-34ad1fd38a6b tempest-AttachVolumeNegativeTest-1726980645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e59fde6-24a8-4b27-8d51-85bd6a56a1df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:29:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1278663177',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a41cf429-b0e0-4a7f-bbca-c0c6b92b98f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cf84256246844f789857d186f14522c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:29:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:29:51Z,use_quota=True,user_id='4409e01f79d64f8eab1c43653e9d8333',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:29:50 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-dfd629a9-9792-424b-85e2-34ad1fd38a6b tempest-AttachVolumeNegativeTest-1726980645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba100e30-2861-4bc0-b5ce-a0b3d7de5e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:29:50 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-dfd629a9-9792-424b-85e2-34ad1fd38a6b tempest-AttachVolumeNegativeTest-1726980645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba100e30-2861-4bc0-b5ce-a0b3d7de5e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:29:50 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-dfd629a9-9792-424b-85e2-34ad1fd38a6b tempest-AttachVolumeNegativeTest-1726980645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6596300-ed1e-49bd-99c2-3ccbeca37792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:29:50 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-dfd629a9-9792-424b-85e2-34ad1fd38a6b tempest-AttachVolumeNegativeTest-1726980645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6596300-ed1e-49bd-99c2-3ccbeca37792) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a41cf429-b0e0-4a7f-bbca-c0c6b92b98f5', 'volume_name': 'volume-a41cf429-b0e0-4a7f-bbca-c0c6b92b98f5', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:29:50 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-dfd629a9-9792-424b-85e2-34ad1fd38a6b tempest-AttachVolumeNegativeTest-1726980645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80492bf6-dea6-4982-902d-cb9b80b333cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:29:50 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-dfd629a9-9792-424b-85e2-34ad1fd38a6b tempest-AttachVolumeNegativeTest-1726980645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80492bf6-dea6-4982-902d-cb9b80b333cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:29:50 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-dfd629a9-9792-424b-85e2-34ad1fd38a6b tempest-AttachVolumeNegativeTest-1726980645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbe040d0-a4db-4ee5-adad-e51dc66cd05e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:29:50 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-dfd629a9-9792-424b-85e2-34ad1fd38a6b tempest-AttachVolumeNegativeTest-1726980645 None] Volume a41cf429-b0e0-4a7f-bbca-c0c6b92b98f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a41cf429-b0e0-4a7f-bbca-c0c6b92b98f5', 'volume_size': 1}
Jul 14 16:29:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-dfd629a9-9792-424b-85e2-34ad1fd38a6b tempest-AttachVolumeNegativeTest-1726980645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:29:50 devstack sudo[96054]: pam_unix(sudo:session): session closed for user root
Jul 14 16:29:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-2c6fd61d-5d54-47d4-9adf-7c328053440b req-b81412a9-85be-4d32-b218-dd24d9942389 tempest-TestMinimumBasicScenario-258503962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cb39fd60-df8a-43cf-95f3-d862952cfc02" returned: 0 in 0.837s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:29:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-2c6fd61d-5d54-47d4-9adf-7c328053440b req-b81412a9-85be-4d32-b218-dd24d9942389 tempest-TestMinimumBasicScenario-258503962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.887s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:29:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-dfd629a9-9792-424b-85e2-34ad1fd38a6b tempest-AttachVolumeNegativeTest-1726980645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.047s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:29:50 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-dfd629a9-9792-424b-85e2-34ad1fd38a6b tempest-AttachVolumeNegativeTest-1726980645 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:29:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1278663177',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a41cf429-b0e0-4a7f-bbca-c0c6b92b98f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cf84256246844f789857d186f14522c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:29:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:29:51Z,use_quota=True,user_id='4409e01f79d64f8eab1c43653e9d8333',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:29:50 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-dfd629a9-9792-424b-85e2-34ad1fd38a6b tempest-AttachVolumeNegativeTest-1726980645 None] Creating volume a41cf429-b0e0-4a7f-bbca-c0c6b92b98f5 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:29:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-dfd629a9-9792-424b-85e2-34ad1fd38a6b tempest-AttachVolumeNegativeTest-1726980645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:29:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-dfd629a9-9792-424b-85e2-34ad1fd38a6b tempest-AttachVolumeNegativeTest-1726980645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:29:50 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-dfd629a9-9792-424b-85e2-34ad1fd38a6b tempest-AttachVolumeNegativeTest-1726980645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:29:50 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-dfd629a9-9792-424b-85e2-34ad1fd38a6b tempest-AttachVolumeNegativeTest-1726980645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:29:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-dfd629a9-9792-424b-85e2-34ad1fd38a6b tempest-AttachVolumeNegativeTest-1726980645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:29:50 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-dfd629a9-9792-424b-85e2-34ad1fd38a6b tempest-AttachVolumeNegativeTest-1726980645 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:29:50 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-dfd629a9-9792-424b-85e2-34ad1fd38a6b tempest-AttachVolumeNegativeTest-1726980645 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:29:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-dfd629a9-9792-424b-85e2-34ad1fd38a6b tempest-AttachVolumeNegativeTest-1726980645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a41cf429-b0e0-4a7f-bbca-c0c6b92b98f5 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:29:51 devstack sudo[96059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a41cf429-b0e0-4a7f-bbca-c0c6b92b98f5 1073741824
Jul 14 16:29:51 devstack sudo[96059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:29:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-2c6fd61d-5d54-47d4-9adf-7c328053440b req-b81412a9-85be-4d32-b218-dd24d9942389 tempest-TestMinimumBasicScenario-258503962 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052', 'name': 'volume-cb39fd60-df8a-43cf-95f3-d862952cfc02', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3adb3d5b-a1bd-494f-b293-543854ad65f4', 'enforce_multipath': True} {{(pid=87166) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 14 16:29:51 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-2c6fd61d-5d54-47d4-9adf-7c328053440b req-b81412a9-85be-4d32-b218-dd24d9942389 tempest-TestMinimumBasicScenario-258503962 None] attachment_update completed successfully.
Jul 14 16:29:52 devstack sudo[96059]: pam_unix(sudo:session): session closed for user root
Jul 14 16:29:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-dfd629a9-9792-424b-85e2-34ad1fd38a6b tempest-AttachVolumeNegativeTest-1726980645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a41cf429-b0e0-4a7f-bbca-c0c6b92b98f5 1073741824" returned: 0 in 1.039s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:29:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-dfd629a9-9792-424b-85e2-34ad1fd38a6b tempest-AttachVolumeNegativeTest-1726980645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a41cf429-b0e0-4a7f-bbca-c0c6b92b98f5 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:29:52 devstack sudo[96424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a41cf429-b0e0-4a7f-bbca-c0c6b92b98f5
Jul 14 16:29:52 devstack sudo[96424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:29:52 devstack sudo[96424]: pam_unix(sudo:session): session closed for user root
Jul 14 16:29:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-dfd629a9-9792-424b-85e2-34ad1fd38a6b tempest-AttachVolumeNegativeTest-1726980645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a41cf429-b0e0-4a7f-bbca-c0c6b92b98f5" returned: 0 in 0.643s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:29:52 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-dfd629a9-9792-424b-85e2-34ad1fd38a6b tempest-AttachVolumeNegativeTest-1726980645 None] <== create_volume: return (1746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:29:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-dfd629a9-9792-424b-85e2-34ad1fd38a6b tempest-AttachVolumeNegativeTest-1726980645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.751s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:29:52 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-dfd629a9-9792-424b-85e2-34ad1fd38a6b tempest-AttachVolumeNegativeTest-1726980645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbe040d0-a4db-4ee5-adad-e51dc66cd05e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a41cf429-b0e0-4a7f-bbca-c0c6b92b98f5', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:29:52 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-dfd629a9-9792-424b-85e2-34ad1fd38a6b tempest-AttachVolumeNegativeTest-1726980645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3df62dc2-0b5f-4335-a4f4-dc9dfa7fa5f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:29:52 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-dfd629a9-9792-424b-85e2-34ad1fd38a6b tempest-AttachVolumeNegativeTest-1726980645 None] Volume volume-a41cf429-b0e0-4a7f-bbca-c0c6b92b98f5 (a41cf429-b0e0-4a7f-bbca-c0c6b92b98f5): created successfully
Jul 14 16:29:52 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-dfd629a9-9792-424b-85e2-34ad1fd38a6b tempest-AttachVolumeNegativeTest-1726980645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3df62dc2-0b5f-4335-a4f4-dc9dfa7fa5f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:29:52 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-dfd629a9-9792-424b-85e2-34ad1fd38a6b tempest-AttachVolumeNegativeTest-1726980645 None] Flow 'volume_create_manager' (ff9a24cd-3fd7-4e83-a111-7158ff7a91aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:29:52 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-dfd629a9-9792-424b-85e2-34ad1fd38a6b tempest-AttachVolumeNegativeTest-1726980645 None] Created volume successfully.
Jul 14 16:29:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-8cfbf4a0-f5f1-47af-b26b-4f0564005638 req-4209f11d-1cd5-40e0-9d87-9c6aed208cea tempest-AttachVolumeNegativeTest-1726980645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:29:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-8cfbf4a0-f5f1-47af-b26b-4f0564005638 req-4209f11d-1cd5-40e0-9d87-9c6aed208cea tempest-AttachVolumeNegativeTest-1726980645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:29:55 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[9332decd-ea86-4de8-8969-40f2e8796122]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:29:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-8cfbf4a0-f5f1-47af-b26b-4f0564005638 req-4209f11d-1cd5-40e0-9d87-9c6aed208cea tempest-AttachVolumeNegativeTest-1726980645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a41cf429-b0e0-4a7f-bbca-c0c6b92b98f5 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:29:55 devstack sudo[96490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a41cf429-b0e0-4a7f-bbca-c0c6b92b98f5
Jul 14 16:29:55 devstack sudo[96490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:29:56 devstack sudo[96490]: pam_unix(sudo:session): session closed for user root
Jul 14 16:29:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-8cfbf4a0-f5f1-47af-b26b-4f0564005638 req-4209f11d-1cd5-40e0-9d87-9c6aed208cea tempest-AttachVolumeNegativeTest-1726980645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a41cf429-b0e0-4a7f-bbca-c0c6b92b98f5" returned: 0 in 0.648s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:29:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-8cfbf4a0-f5f1-47af-b26b-4f0564005638 req-4209f11d-1cd5-40e0-9d87-9c6aed208cea tempest-AttachVolumeNegativeTest-1726980645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.701s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:29:56 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-8cfbf4a0-f5f1-47af-b26b-4f0564005638 req-4209f11d-1cd5-40e0-9d87-9c6aed208cea tempest-AttachVolumeNegativeTest-1726980645 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052', 'name': 'volume-a41cf429-b0e0-4a7f-bbca-c0c6b92b98f5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6744d7f7-ded8-4fd4-a2d5-ac328b4b9455', 'enforce_multipath': True} {{(pid=87166) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 14 16:29:56 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-8cfbf4a0-f5f1-47af-b26b-4f0564005638 req-4209f11d-1cd5-40e0-9d87-9c6aed208cea tempest-AttachVolumeNegativeTest-1726980645 None] attachment_update completed successfully.
Jul 14 16:29:59 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-ed1dc7a5-8c61-48a5-9a72-e7bd0e1dcebd req-8f311c1a-6a85-4677-a9e9-4bc18c7b37bd tempest-AttachVolumeNegativeTest-1726980645 None] Terminate volume connection completed successfully.
Jul 14 16:29:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-ed1dc7a5-8c61-48a5-9a72-e7bd0e1dcebd req-8f311c1a-6a85-4677-a9e9-4bc18c7b37bd tempest-AttachVolumeNegativeTest-1726980645 None] Deleting attachment 6744d7f7-ded8-4fd4-a2d5-ac328b4b9455. {{(pid=87166) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 14 16:30:07 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-cf97f181-5f12-4354-bdd3-30713128d6e3 tempest-AttachVolumeNegativeTest-1726980645 None] Acquiring lock "cinder-a41cf429-b0e0-4a7f-bbca-c0c6b92b98f5-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:30:07 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-cf97f181-5f12-4354-bdd3-30713128d6e3 tempest-AttachVolumeNegativeTest-1726980645 None] Lock "cinder-a41cf429-b0e0-4a7f-bbca-c0c6b92b98f5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:30:07 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-cf97f181-5f12-4354-bdd3-30713128d6e3 tempest-AttachVolumeNegativeTest-1726980645 None] Acquiring lock "cinder-quobyte-a41cf429-b0e0-4a7f-bbca-c0c6b92b98f5" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:30:07 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-cf97f181-5f12-4354-bdd3-30713128d6e3 tempest-AttachVolumeNegativeTest-1726980645 None] Lock "cinder-quobyte-a41cf429-b0e0-4a7f-bbca-c0c6b92b98f5" acquired by "delete_volume" :: waited 0.018s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:30:07 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[070649b3-7fd4-4840-986d-e5a60028cf5f]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:30:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cf97f181-5f12-4354-bdd3-30713128d6e3 tempest-AttachVolumeNegativeTest-1726980645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a41cf429-b0e0-4a7f-bbca-c0c6b92b98f5 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:07 devstack sudo[96612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a41cf429-b0e0-4a7f-bbca-c0c6b92b98f5
Jul 14 16:30:07 devstack sudo[96612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:07 devstack sudo[96612]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cf97f181-5f12-4354-bdd3-30713128d6e3 tempest-AttachVolumeNegativeTest-1726980645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a41cf429-b0e0-4a7f-bbca-c0c6b92b98f5" returned: 0 in 0.422s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cf97f181-5f12-4354-bdd3-30713128d6e3 tempest-AttachVolumeNegativeTest-1726980645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a41cf429-b0e0-4a7f-bbca-c0c6b92b98f5 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:07 devstack sudo[96618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a41cf429-b0e0-4a7f-bbca-c0c6b92b98f5
Jul 14 16:30:07 devstack sudo[96618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:07 devstack sudo[96618]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cf97f181-5f12-4354-bdd3-30713128d6e3 tempest-AttachVolumeNegativeTest-1726980645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a41cf429-b0e0-4a7f-bbca-c0c6b92b98f5" returned: 0 in 0.288s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:07 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-cf97f181-5f12-4354-bdd3-30713128d6e3 tempest-AttachVolumeNegativeTest-1726980645 None] Lock "cinder-quobyte-a41cf429-b0e0-4a7f-bbca-c0c6b92b98f5" released by "delete_volume" :: held 0.779s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:30:07 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-cf97f181-5f12-4354-bdd3-30713128d6e3 tempest-AttachVolumeNegativeTest-1726980645 None] Created reservations ['1c31e802-be51-4b0f-a8c0-5963f3614bae', '30589453-6b22-4c5d-8a9a-6ecb071a44a6', 'e24edb09-08f1-4dc3-9842-a0231fbf58ad', '15392ab1-5057-4d17-9df4-16137d9ea9a9'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:30:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cf97f181-5f12-4354-bdd3-30713128d6e3 tempest-AttachVolumeNegativeTest-1726980645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:30:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cf97f181-5f12-4354-bdd3-30713128d6e3 tempest-AttachVolumeNegativeTest-1726980645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:30:08 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-cf97f181-5f12-4354-bdd3-30713128d6e3 tempest-AttachVolumeNegativeTest-1726980645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:30:08 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-cf97f181-5f12-4354-bdd3-30713128d6e3 tempest-AttachVolumeNegativeTest-1726980645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:30:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cf97f181-5f12-4354-bdd3-30713128d6e3 tempest-AttachVolumeNegativeTest-1726980645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:30:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cf97f181-5f12-4354-bdd3-30713128d6e3 tempest-AttachVolumeNegativeTest-1726980645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:08 devstack sudo[96621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:30:08 devstack sudo[96621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:08 devstack sudo[96621]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cf97f181-5f12-4354-bdd3-30713128d6e3 tempest-AttachVolumeNegativeTest-1726980645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.274s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:08 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-cf97f181-5f12-4354-bdd3-30713128d6e3 tempest-AttachVolumeNegativeTest-1726980645 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:30:08 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-cf97f181-5f12-4354-bdd3-30713128d6e3 tempest-AttachVolumeNegativeTest-1726980645 None] Deleted volume successfully.
Jul 14 16:30:08 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-cf97f181-5f12-4354-bdd3-30713128d6e3 tempest-AttachVolumeNegativeTest-1726980645 None] Lock "cinder-a41cf429-b0e0-4a7f-bbca-c0c6b92b98f5-delete_volume" released by "delete_volume" :: held 1.281s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:30:08 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a75023eb-f8d0-403f-97d6-4d18e93b4603 tempest-AttachVolumeNegativeTest-1726980645 None] Acquiring lock "cinder-26db40c2-ebe0-477d-8f97-c5cb02fac3bc-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:30:08 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a75023eb-f8d0-403f-97d6-4d18e93b4603 tempest-AttachVolumeNegativeTest-1726980645 None] Lock "cinder-26db40c2-ebe0-477d-8f97-c5cb02fac3bc-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:30:08 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a75023eb-f8d0-403f-97d6-4d18e93b4603 tempest-AttachVolumeNegativeTest-1726980645 None] Acquiring lock "cinder-quobyte-26db40c2-ebe0-477d-8f97-c5cb02fac3bc" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:30:08 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a75023eb-f8d0-403f-97d6-4d18e93b4603 tempest-AttachVolumeNegativeTest-1726980645 None] Lock "cinder-quobyte-26db40c2-ebe0-477d-8f97-c5cb02fac3bc" acquired by "delete_volume" :: waited 0.014s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:30:08 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[c68f42af-c167-4325-a3a6-9033afb66df7]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:30:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a75023eb-f8d0-403f-97d6-4d18e93b4603 tempest-AttachVolumeNegativeTest-1726980645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-26db40c2-ebe0-477d-8f97-c5cb02fac3bc {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:08 devstack sudo[96624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-26db40c2-ebe0-477d-8f97-c5cb02fac3bc
Jul 14 16:30:08 devstack sudo[96624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:08 devstack sudo[96624]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a75023eb-f8d0-403f-97d6-4d18e93b4603 tempest-AttachVolumeNegativeTest-1726980645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-26db40c2-ebe0-477d-8f97-c5cb02fac3bc" returned: 0 in 0.389s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a75023eb-f8d0-403f-97d6-4d18e93b4603 tempest-AttachVolumeNegativeTest-1726980645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-26db40c2-ebe0-477d-8f97-c5cb02fac3bc {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:08 devstack sudo[96629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-26db40c2-ebe0-477d-8f97-c5cb02fac3bc
Jul 14 16:30:08 devstack sudo[96629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:09 devstack sudo[96629]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a75023eb-f8d0-403f-97d6-4d18e93b4603 tempest-AttachVolumeNegativeTest-1726980645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-26db40c2-ebe0-477d-8f97-c5cb02fac3bc" returned: 0 in 0.250s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:09 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a75023eb-f8d0-403f-97d6-4d18e93b4603 tempest-AttachVolumeNegativeTest-1726980645 None] Lock "cinder-quobyte-26db40c2-ebe0-477d-8f97-c5cb02fac3bc" released by "delete_volume" :: held 0.686s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:30:09 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-a75023eb-f8d0-403f-97d6-4d18e93b4603 tempest-AttachVolumeNegativeTest-1726980645 None] Created reservations ['e89a65d5-4ff8-4240-aa14-700050a69462', '4c16edd7-7e59-4aed-9fa5-213b8065b885', '76b0bf47-2c35-4276-b1c3-f2a63e3bcdeb', '0794c4d6-212a-42d1-ac7c-9050ceced3d1'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:30:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a75023eb-f8d0-403f-97d6-4d18e93b4603 tempest-AttachVolumeNegativeTest-1726980645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:30:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a75023eb-f8d0-403f-97d6-4d18e93b4603 tempest-AttachVolumeNegativeTest-1726980645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:30:09 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a75023eb-f8d0-403f-97d6-4d18e93b4603 tempest-AttachVolumeNegativeTest-1726980645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:30:09 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a75023eb-f8d0-403f-97d6-4d18e93b4603 tempest-AttachVolumeNegativeTest-1726980645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:30:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a75023eb-f8d0-403f-97d6-4d18e93b4603 tempest-AttachVolumeNegativeTest-1726980645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:30:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a75023eb-f8d0-403f-97d6-4d18e93b4603 tempest-AttachVolumeNegativeTest-1726980645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:09 devstack sudo[96633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:30:09 devstack sudo[96633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:09 devstack sudo[96633]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a75023eb-f8d0-403f-97d6-4d18e93b4603 tempest-AttachVolumeNegativeTest-1726980645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.274s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:09 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-a75023eb-f8d0-403f-97d6-4d18e93b4603 tempest-AttachVolumeNegativeTest-1726980645 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:30:09 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-a75023eb-f8d0-403f-97d6-4d18e93b4603 tempest-AttachVolumeNegativeTest-1726980645 None] Deleted volume successfully.
Jul 14 16:30:09 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a75023eb-f8d0-403f-97d6-4d18e93b4603 tempest-AttachVolumeNegativeTest-1726980645 None] Lock "cinder-26db40c2-ebe0-477d-8f97-c5cb02fac3bc-delete_volume" released by "delete_volume" :: held 1.198s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:30:09 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-02982cc6-b35a-4ec7-bf34-2b57499086c9 tempest-AttachVolumeNegativeTest-1726980645 None] Acquiring lock "cinder-cacbc5a3-73ea-4ff6-9e6b-adfedd97f448-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:30:09 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-02982cc6-b35a-4ec7-bf34-2b57499086c9 tempest-AttachVolumeNegativeTest-1726980645 None] Lock "cinder-cacbc5a3-73ea-4ff6-9e6b-adfedd97f448-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:30:09 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-02982cc6-b35a-4ec7-bf34-2b57499086c9 tempest-AttachVolumeNegativeTest-1726980645 None] Acquiring lock "cinder-quobyte-cacbc5a3-73ea-4ff6-9e6b-adfedd97f448" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:30:10 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-02982cc6-b35a-4ec7-bf34-2b57499086c9 tempest-AttachVolumeNegativeTest-1726980645 None] Lock "cinder-quobyte-cacbc5a3-73ea-4ff6-9e6b-adfedd97f448" acquired by "delete_volume" :: waited 0.015s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:30:10 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[a088b631-e494-4ad6-a0f7-b95f97ae33b7]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:30:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-02982cc6-b35a-4ec7-bf34-2b57499086c9 tempest-AttachVolumeNegativeTest-1726980645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cacbc5a3-73ea-4ff6-9e6b-adfedd97f448 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:10 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8ba12cc-a40d-4040-b059-eaea86b5a3e8 tempest-SnapshotsActionsTest-638814915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:30:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f8ba12cc-a40d-4040-b059-eaea86b5a3e8 tempest-SnapshotsActionsTest-638814915 None] Flow 'volume_create_manager' (6a2869b4-616b-4128-8ca9-240345180550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:30:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f8ba12cc-a40d-4040-b059-eaea86b5a3e8 tempest-SnapshotsActionsTest-638814915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fce5f68c-420c-4c7b-be77-4142351326f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:30:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f8ba12cc-a40d-4040-b059-eaea86b5a3e8 tempest-SnapshotsActionsTest-638814915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fce5f68c-420c-4c7b-be77-4142351326f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:30:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-824110150',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1700751-5c94-4f7b-8047-d8888dcbdae8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88fdb8cfaa6448f5a3eee632747338ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:30:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:30:10Z,use_quota=True,user_id='3651b27790154af0a5427789184439ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:30:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f8ba12cc-a40d-4040-b059-eaea86b5a3e8 tempest-SnapshotsActionsTest-638814915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58370ba4-8c3c-4ef4-bc6a-669659b16f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:30:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f8ba12cc-a40d-4040-b059-eaea86b5a3e8 tempest-SnapshotsActionsTest-638814915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58370ba4-8c3c-4ef4-bc6a-669659b16f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:30:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f8ba12cc-a40d-4040-b059-eaea86b5a3e8 tempest-SnapshotsActionsTest-638814915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c91f1cc8-1130-4cd7-80c5-97d9674e2b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:30:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f8ba12cc-a40d-4040-b059-eaea86b5a3e8 tempest-SnapshotsActionsTest-638814915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c91f1cc8-1130-4cd7-80c5-97d9674e2b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1700751-5c94-4f7b-8047-d8888dcbdae8', 'volume_name': 'volume-b1700751-5c94-4f7b-8047-d8888dcbdae8', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:30:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f8ba12cc-a40d-4040-b059-eaea86b5a3e8 tempest-SnapshotsActionsTest-638814915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a554617-8956-4ce5-a0f6-3757c31f5aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:30:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f8ba12cc-a40d-4040-b059-eaea86b5a3e8 tempest-SnapshotsActionsTest-638814915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a554617-8956-4ce5-a0f6-3757c31f5aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:30:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f8ba12cc-a40d-4040-b059-eaea86b5a3e8 tempest-SnapshotsActionsTest-638814915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2985284-ee15-4643-a416-ca3267b0b992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:30:10 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-f8ba12cc-a40d-4040-b059-eaea86b5a3e8 tempest-SnapshotsActionsTest-638814915 None] Volume b1700751-5c94-4f7b-8047-d8888dcbdae8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1700751-5c94-4f7b-8047-d8888dcbdae8', 'volume_size': 1}
Jul 14 16:30:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f8ba12cc-a40d-4040-b059-eaea86b5a3e8 tempest-SnapshotsActionsTest-638814915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:30:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f8ba12cc-a40d-4040-b059-eaea86b5a3e8 tempest-SnapshotsActionsTest-638814915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:30:10 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f8ba12cc-a40d-4040-b059-eaea86b5a3e8 tempest-SnapshotsActionsTest-638814915 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:30:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-824110150',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1700751-5c94-4f7b-8047-d8888dcbdae8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88fdb8cfaa6448f5a3eee632747338ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:30:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:30:10Z,use_quota=True,user_id='3651b27790154af0a5427789184439ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:30:10 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-f8ba12cc-a40d-4040-b059-eaea86b5a3e8 tempest-SnapshotsActionsTest-638814915 None] Creating volume b1700751-5c94-4f7b-8047-d8888dcbdae8 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:30:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f8ba12cc-a40d-4040-b059-eaea86b5a3e8 tempest-SnapshotsActionsTest-638814915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:30:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f8ba12cc-a40d-4040-b059-eaea86b5a3e8 tempest-SnapshotsActionsTest-638814915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:30:10 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f8ba12cc-a40d-4040-b059-eaea86b5a3e8 tempest-SnapshotsActionsTest-638814915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:30:10 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f8ba12cc-a40d-4040-b059-eaea86b5a3e8 tempest-SnapshotsActionsTest-638814915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:30:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f8ba12cc-a40d-4040-b059-eaea86b5a3e8 tempest-SnapshotsActionsTest-638814915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:30:10 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f8ba12cc-a40d-4040-b059-eaea86b5a3e8 tempest-SnapshotsActionsTest-638814915 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:30:10 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-f8ba12cc-a40d-4040-b059-eaea86b5a3e8 tempest-SnapshotsActionsTest-638814915 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:30:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f8ba12cc-a40d-4040-b059-eaea86b5a3e8 tempest-SnapshotsActionsTest-638814915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:10 devstack sudo[96636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cacbc5a3-73ea-4ff6-9e6b-adfedd97f448
Jul 14 16:30:10 devstack sudo[96636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:10 devstack sudo[96637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8 1073741824
Jul 14 16:30:10 devstack sudo[96637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:10 devstack sudo[96636]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-02982cc6-b35a-4ec7-bf34-2b57499086c9 tempest-AttachVolumeNegativeTest-1726980645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cacbc5a3-73ea-4ff6-9e6b-adfedd97f448" returned: 0 in 0.423s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-02982cc6-b35a-4ec7-bf34-2b57499086c9 tempest-AttachVolumeNegativeTest-1726980645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cacbc5a3-73ea-4ff6-9e6b-adfedd97f448 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:10 devstack sudo[96646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cacbc5a3-73ea-4ff6-9e6b-adfedd97f448
Jul 14 16:30:10 devstack sudo[96646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:10 devstack sudo[96637]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f8ba12cc-a40d-4040-b059-eaea86b5a3e8 tempest-SnapshotsActionsTest-638814915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8 1073741824" returned: 0 in 0.572s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f8ba12cc-a40d-4040-b059-eaea86b5a3e8 tempest-SnapshotsActionsTest-638814915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:10 devstack sudo[96646]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:10 devstack sudo[96650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8
Jul 14 16:30:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-02982cc6-b35a-4ec7-bf34-2b57499086c9 tempest-AttachVolumeNegativeTest-1726980645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cacbc5a3-73ea-4ff6-9e6b-adfedd97f448" returned: 0 in 0.344s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:10 devstack sudo[96650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:10 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-02982cc6-b35a-4ec7-bf34-2b57499086c9 tempest-AttachVolumeNegativeTest-1726980645 None] Lock "cinder-quobyte-cacbc5a3-73ea-4ff6-9e6b-adfedd97f448" released by "delete_volume" :: held 0.822s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:30:10 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-02982cc6-b35a-4ec7-bf34-2b57499086c9 tempest-AttachVolumeNegativeTest-1726980645 None] Created reservations ['69fbdb4a-1234-4cbb-b0fc-680df80eea65', '6a341377-5bd9-4eda-a3c4-1c42f496447f', '4026580f-e1cb-467e-881c-47269deaae83', '0d2c9f68-3b6c-40fc-b953-fc5b27875233'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:30:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-02982cc6-b35a-4ec7-bf34-2b57499086c9 tempest-AttachVolumeNegativeTest-1726980645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:30:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-02982cc6-b35a-4ec7-bf34-2b57499086c9 tempest-AttachVolumeNegativeTest-1726980645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:30:11 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-02982cc6-b35a-4ec7-bf34-2b57499086c9 tempest-AttachVolumeNegativeTest-1726980645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:30:11 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-02982cc6-b35a-4ec7-bf34-2b57499086c9 tempest-AttachVolumeNegativeTest-1726980645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:30:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-02982cc6-b35a-4ec7-bf34-2b57499086c9 tempest-AttachVolumeNegativeTest-1726980645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:30:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-02982cc6-b35a-4ec7-bf34-2b57499086c9 tempest-AttachVolumeNegativeTest-1726980645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:11 devstack sudo[96658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:30:11 devstack sudo[96658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:11 devstack sudo[96650]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f8ba12cc-a40d-4040-b059-eaea86b5a3e8 tempest-SnapshotsActionsTest-638814915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8" returned: 0 in 0.438s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:11 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f8ba12cc-a40d-4040-b059-eaea86b5a3e8 tempest-SnapshotsActionsTest-638814915 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:30:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f8ba12cc-a40d-4040-b059-eaea86b5a3e8 tempest-SnapshotsActionsTest-638814915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:30:11 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f8ba12cc-a40d-4040-b059-eaea86b5a3e8 tempest-SnapshotsActionsTest-638814915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2985284-ee15-4643-a416-ca3267b0b992) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1700751-5c94-4f7b-8047-d8888dcbdae8', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:30:11 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f8ba12cc-a40d-4040-b059-eaea86b5a3e8 tempest-SnapshotsActionsTest-638814915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e65c0da-1aff-441d-a018-dd775e2d7437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:30:11 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-f8ba12cc-a40d-4040-b059-eaea86b5a3e8 tempest-SnapshotsActionsTest-638814915 None] Volume volume-b1700751-5c94-4f7b-8047-d8888dcbdae8 (b1700751-5c94-4f7b-8047-d8888dcbdae8): created successfully
Jul 14 16:30:11 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f8ba12cc-a40d-4040-b059-eaea86b5a3e8 tempest-SnapshotsActionsTest-638814915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e65c0da-1aff-441d-a018-dd775e2d7437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:30:11 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f8ba12cc-a40d-4040-b059-eaea86b5a3e8 tempest-SnapshotsActionsTest-638814915 None] Flow 'volume_create_manager' (6a2869b4-616b-4128-8ca9-240345180550) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:30:11 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-f8ba12cc-a40d-4040-b059-eaea86b5a3e8 tempest-SnapshotsActionsTest-638814915 None] Created volume successfully.
Jul 14 16:30:11 devstack sudo[96658]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-02982cc6-b35a-4ec7-bf34-2b57499086c9 tempest-AttachVolumeNegativeTest-1726980645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.421s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:11 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-02982cc6-b35a-4ec7-bf34-2b57499086c9 tempest-AttachVolumeNegativeTest-1726980645 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:30:11 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-02982cc6-b35a-4ec7-bf34-2b57499086c9 tempest-AttachVolumeNegativeTest-1726980645 None] Deleted volume successfully.
Jul 14 16:30:11 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-02982cc6-b35a-4ec7-bf34-2b57499086c9 tempest-AttachVolumeNegativeTest-1726980645 None] Lock "cinder-cacbc5a3-73ea-4ff6-9e6b-adfedd97f448-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:30:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cead6714-bdd6-40c9-8164-2bd424e31314 tempest-SnapshotsActionsTest-638814915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:30:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cead6714-bdd6-40c9-8164-2bd424e31314 tempest-SnapshotsActionsTest-638814915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:30:12 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-cead6714-bdd6-40c9-8164-2bd424e31314 tempest-SnapshotsActionsTest-638814915 None] Creating offline snapshot 7aec2f37-5dcd-4047-aae5-bae12f1db9a1 of volume b1700751-5c94-4f7b-8047-d8888dcbdae8 {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 16:30:12 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50bd8c0-3f9f-4413-9171-a42ea034ce83]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:30:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cead6714-bdd6-40c9-8164-2bd424e31314 tempest-SnapshotsActionsTest-638814915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:12 devstack sudo[96686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8
Jul 14 16:30:12 devstack sudo[96686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:12 devstack sudo[96686]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cead6714-bdd6-40c9-8164-2bd424e31314 tempest-SnapshotsActionsTest-638814915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8" returned: 0 in 0.546s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cead6714-bdd6-40c9-8164-2bd424e31314 tempest-SnapshotsActionsTest-638814915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7aec2f37-5dcd-4047-aae5-bae12f1db9a1 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:13 devstack sudo[96692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7aec2f37-5dcd-4047-aae5-bae12f1db9a1 1G
Jul 14 16:30:13 devstack sudo[96692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:13 devstack sudo[96692]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cead6714-bdd6-40c9-8164-2bd424e31314 tempest-SnapshotsActionsTest-638814915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7aec2f37-5dcd-4047-aae5-bae12f1db9a1 1G" returned: 0 in 0.497s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cead6714-bdd6-40c9-8164-2bd424e31314 tempest-SnapshotsActionsTest-638814915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1700751-5c94-4f7b-8047-d8888dcbdae8 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7aec2f37-5dcd-4047-aae5-bae12f1db9a1 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:13 devstack sudo[96699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1700751-5c94-4f7b-8047-d8888dcbdae8 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7aec2f37-5dcd-4047-aae5-bae12f1db9a1
Jul 14 16:30:13 devstack sudo[96699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:13 devstack sudo[96699]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cead6714-bdd6-40c9-8164-2bd424e31314 tempest-SnapshotsActionsTest-638814915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1700751-5c94-4f7b-8047-d8888dcbdae8 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7aec2f37-5dcd-4047-aae5-bae12f1db9a1" returned: 0 in 0.357s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:13 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-cead6714-bdd6-40c9-8164-2bd424e31314 tempest-SnapshotsActionsTest-638814915 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7aec2f37-5dcd-4047-aae5-bae12f1db9a1 is being set with open permissions: ugo+rw
Jul 14 16:30:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cead6714-bdd6-40c9-8164-2bd424e31314 tempest-SnapshotsActionsTest-638814915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7aec2f37-5dcd-4047-aae5-bae12f1db9a1 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:13 devstack sudo[96705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7aec2f37-5dcd-4047-aae5-bae12f1db9a1
Jul 14 16:30:13 devstack sudo[96705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:14 devstack sudo[96705]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cead6714-bdd6-40c9-8164-2bd424e31314 tempest-SnapshotsActionsTest-638814915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7aec2f37-5dcd-4047-aae5-bae12f1db9a1" returned: 0 in 0.277s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cead6714-bdd6-40c9-8164-2bd424e31314 tempest-SnapshotsActionsTest-638814915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:14 devstack sudo[96708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.info
Jul 14 16:30:14 devstack sudo[96708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:14 devstack sudo[96708]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cead6714-bdd6-40c9-8164-2bd424e31314 tempest-SnapshotsActionsTest-638814915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.info" returned: 0 in 0.258s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:14 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-cead6714-bdd6-40c9-8164-2bd424e31314 tempest-SnapshotsActionsTest-638814915 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.info is being set with open permissions: ugo+rw
Jul 14 16:30:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cead6714-bdd6-40c9-8164-2bd424e31314 tempest-SnapshotsActionsTest-638814915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:14 devstack sudo[96711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.info
Jul 14 16:30:14 devstack sudo[96711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:14 devstack sudo[96711]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cead6714-bdd6-40c9-8164-2bd424e31314 tempest-SnapshotsActionsTest-638814915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.info" returned: 0 in 0.326s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cead6714-bdd6-40c9-8164-2bd424e31314 tempest-SnapshotsActionsTest-638814915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.368s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:30:14 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-cead6714-bdd6-40c9-8164-2bd424e31314 tempest-SnapshotsActionsTest-638814915 None] Create snapshot completed successfully
Jul 14 16:30:15 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-1957d724-2e88-4f14-906f-e023f602bea1 tempest-AttachVolumeTestJSON-1037344391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:30:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1957d724-2e88-4f14-906f-e023f602bea1 tempest-AttachVolumeTestJSON-1037344391 None] Flow 'volume_create_manager' (cdb089c5-87a2-4eef-8dd5-2dbf0bc7b6cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:30:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1957d724-2e88-4f14-906f-e023f602bea1 tempest-AttachVolumeTestJSON-1037344391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8d0ba46-f3d1-4405-9df6-266b81ca565a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:30:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1957d724-2e88-4f14-906f-e023f602bea1 tempest-AttachVolumeTestJSON-1037344391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8d0ba46-f3d1-4405-9df6-266b81ca565a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:30:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-953121692',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32e992a8-c129-4231-b746-e06c7ddb8e43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a48e5fb250034dfbb4de440df0be7961',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:30:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:30:15Z,use_quota=True,user_id='ab1817e4c8eb4dfe8f1a0db1c01094e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:30:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1957d724-2e88-4f14-906f-e023f602bea1 tempest-AttachVolumeTestJSON-1037344391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e91a645-d12e-4293-872c-762fef68308e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:30:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1957d724-2e88-4f14-906f-e023f602bea1 tempest-AttachVolumeTestJSON-1037344391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e91a645-d12e-4293-872c-762fef68308e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:30:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1957d724-2e88-4f14-906f-e023f602bea1 tempest-AttachVolumeTestJSON-1037344391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a14d5d7-6009-4720-8651-1d92ba433cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:30:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1957d724-2e88-4f14-906f-e023f602bea1 tempest-AttachVolumeTestJSON-1037344391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a14d5d7-6009-4720-8651-1d92ba433cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32e992a8-c129-4231-b746-e06c7ddb8e43', 'volume_name': 'volume-32e992a8-c129-4231-b746-e06c7ddb8e43', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:30:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1957d724-2e88-4f14-906f-e023f602bea1 tempest-AttachVolumeTestJSON-1037344391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01ef901d-d2f8-4219-97cc-434f069b515a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:30:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1957d724-2e88-4f14-906f-e023f602bea1 tempest-AttachVolumeTestJSON-1037344391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01ef901d-d2f8-4219-97cc-434f069b515a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:30:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1957d724-2e88-4f14-906f-e023f602bea1 tempest-AttachVolumeTestJSON-1037344391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d8ec0ae-f68d-4a1d-8a68-928d2159799f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:30:15 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-1957d724-2e88-4f14-906f-e023f602bea1 tempest-AttachVolumeTestJSON-1037344391 None] Volume 32e992a8-c129-4231-b746-e06c7ddb8e43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32e992a8-c129-4231-b746-e06c7ddb8e43', 'volume_size': 1}
Jul 14 16:30:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1957d724-2e88-4f14-906f-e023f602bea1 tempest-AttachVolumeTestJSON-1037344391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:30:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1957d724-2e88-4f14-906f-e023f602bea1 tempest-AttachVolumeTestJSON-1037344391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:30:15 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-1957d724-2e88-4f14-906f-e023f602bea1 tempest-AttachVolumeTestJSON-1037344391 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:30:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-953121692',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32e992a8-c129-4231-b746-e06c7ddb8e43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a48e5fb250034dfbb4de440df0be7961',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:30:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:30:15Z,use_quota=True,user_id='ab1817e4c8eb4dfe8f1a0db1c01094e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:30:15 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-1957d724-2e88-4f14-906f-e023f602bea1 tempest-AttachVolumeTestJSON-1037344391 None] Creating volume 32e992a8-c129-4231-b746-e06c7ddb8e43 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:30:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1957d724-2e88-4f14-906f-e023f602bea1 tempest-AttachVolumeTestJSON-1037344391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:30:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1957d724-2e88-4f14-906f-e023f602bea1 tempest-AttachVolumeTestJSON-1037344391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:30:15 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-1957d724-2e88-4f14-906f-e023f602bea1 tempest-AttachVolumeTestJSON-1037344391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:30:15 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-1957d724-2e88-4f14-906f-e023f602bea1 tempest-AttachVolumeTestJSON-1037344391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:30:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1957d724-2e88-4f14-906f-e023f602bea1 tempest-AttachVolumeTestJSON-1037344391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:30:15 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-1957d724-2e88-4f14-906f-e023f602bea1 tempest-AttachVolumeTestJSON-1037344391 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:30:15 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-1957d724-2e88-4f14-906f-e023f602bea1 tempest-AttachVolumeTestJSON-1037344391 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:30:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1957d724-2e88-4f14-906f-e023f602bea1 tempest-AttachVolumeTestJSON-1037344391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-32e992a8-c129-4231-b746-e06c7ddb8e43 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:15 devstack sudo[96717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-32e992a8-c129-4231-b746-e06c7ddb8e43 1073741824
Jul 14 16:30:15 devstack sudo[96717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-61239e96-14f0-495c-a7c8-c1ad556065e7 tempest-SnapshotsActionsTest-638814915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:30:16 devstack sudo[96717]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1957d724-2e88-4f14-906f-e023f602bea1 tempest-AttachVolumeTestJSON-1037344391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-32e992a8-c129-4231-b746-e06c7ddb8e43 1073741824" returned: 0 in 0.520s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1957d724-2e88-4f14-906f-e023f602bea1 tempest-AttachVolumeTestJSON-1037344391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-32e992a8-c129-4231-b746-e06c7ddb8e43 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:16 devstack sudo[96723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-32e992a8-c129-4231-b746-e06c7ddb8e43
Jul 14 16:30:16 devstack sudo[96723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:16 devstack sudo[96723]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1957d724-2e88-4f14-906f-e023f602bea1 tempest-AttachVolumeTestJSON-1037344391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-32e992a8-c129-4231-b746-e06c7ddb8e43" returned: 0 in 0.268s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:16 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-1957d724-2e88-4f14-906f-e023f602bea1 tempest-AttachVolumeTestJSON-1037344391 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:30:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1957d724-2e88-4f14-906f-e023f602bea1 tempest-AttachVolumeTestJSON-1037344391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:30:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-61239e96-14f0-495c-a7c8-c1ad556065e7 tempest-SnapshotsActionsTest-638814915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.313s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:30:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1957d724-2e88-4f14-906f-e023f602bea1 tempest-AttachVolumeTestJSON-1037344391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d8ec0ae-f68d-4a1d-8a68-928d2159799f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32e992a8-c129-4231-b746-e06c7ddb8e43', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:30:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1957d724-2e88-4f14-906f-e023f602bea1 tempest-AttachVolumeTestJSON-1037344391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (273a0ac0-9880-45bd-9a2c-d6533b353640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:30:16 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-61239e96-14f0-495c-a7c8-c1ad556065e7 tempest-SnapshotsActionsTest-638814915 None] Creating offline snapshot 7c2505a8-80fa-4572-8527-f3631daa686d of volume b1700751-5c94-4f7b-8047-d8888dcbdae8 {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 16:30:16 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-1957d724-2e88-4f14-906f-e023f602bea1 tempest-AttachVolumeTestJSON-1037344391 None] Volume volume-32e992a8-c129-4231-b746-e06c7ddb8e43 (32e992a8-c129-4231-b746-e06c7ddb8e43): created successfully
Jul 14 16:30:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1957d724-2e88-4f14-906f-e023f602bea1 tempest-AttachVolumeTestJSON-1037344391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (273a0ac0-9880-45bd-9a2c-d6533b353640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:30:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1957d724-2e88-4f14-906f-e023f602bea1 tempest-AttachVolumeTestJSON-1037344391 None] Flow 'volume_create_manager' (cdb089c5-87a2-4eef-8dd5-2dbf0bc7b6cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:30:16 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d6f416-5ba4-41bd-9c6e-cce11f895d22]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:30:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-61239e96-14f0-495c-a7c8-c1ad556065e7 tempest-SnapshotsActionsTest-638814915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7aec2f37-5dcd-4047-aae5-bae12f1db9a1 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:16 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-1957d724-2e88-4f14-906f-e023f602bea1 tempest-AttachVolumeTestJSON-1037344391 None] Created volume successfully.
Jul 14 16:30:16 devstack sudo[96727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7aec2f37-5dcd-4047-aae5-bae12f1db9a1
Jul 14 16:30:16 devstack sudo[96727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:16 devstack sudo[96727]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-61239e96-14f0-495c-a7c8-c1ad556065e7 tempest-SnapshotsActionsTest-638814915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7aec2f37-5dcd-4047-aae5-bae12f1db9a1" returned: 0 in 0.411s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:16 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-61239e96-14f0-495c-a7c8-c1ad556065e7 tempest-SnapshotsActionsTest-638814915 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1700751-5c94-4f7b-8047-d8888dcbdae8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 16:30:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-61239e96-14f0-495c-a7c8-c1ad556065e7 tempest-SnapshotsActionsTest-638814915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7aec2f37-5dcd-4047-aae5-bae12f1db9a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7c2505a8-80fa-4572-8527-f3631daa686d 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:16 devstack sudo[96732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7aec2f37-5dcd-4047-aae5-bae12f1db9a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7c2505a8-80fa-4572-8527-f3631daa686d 1G
Jul 14 16:30:16 devstack sudo[96732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:17 devstack sudo[96732]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-61239e96-14f0-495c-a7c8-c1ad556065e7 tempest-SnapshotsActionsTest-638814915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7aec2f37-5dcd-4047-aae5-bae12f1db9a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7c2505a8-80fa-4572-8527-f3631daa686d 1G" returned: 0 in 0.457s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-61239e96-14f0-495c-a7c8-c1ad556065e7 tempest-SnapshotsActionsTest-638814915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7aec2f37-5dcd-4047-aae5-bae12f1db9a1 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7c2505a8-80fa-4572-8527-f3631daa686d {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:17 devstack sudo[96738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7aec2f37-5dcd-4047-aae5-bae12f1db9a1 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7c2505a8-80fa-4572-8527-f3631daa686d
Jul 14 16:30:17 devstack sudo[96738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:17 devstack sudo[96738]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-61239e96-14f0-495c-a7c8-c1ad556065e7 tempest-SnapshotsActionsTest-638814915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7aec2f37-5dcd-4047-aae5-bae12f1db9a1 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7c2505a8-80fa-4572-8527-f3631daa686d" returned: 0 in 0.441s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:17 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-61239e96-14f0-495c-a7c8-c1ad556065e7 tempest-SnapshotsActionsTest-638814915 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7c2505a8-80fa-4572-8527-f3631daa686d is being set with open permissions: ugo+rw
Jul 14 16:30:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-61239e96-14f0-495c-a7c8-c1ad556065e7 tempest-SnapshotsActionsTest-638814915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7c2505a8-80fa-4572-8527-f3631daa686d {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:17 devstack sudo[96747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7c2505a8-80fa-4572-8527-f3631daa686d
Jul 14 16:30:17 devstack sudo[96747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:18 devstack sudo[96747]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-61239e96-14f0-495c-a7c8-c1ad556065e7 tempest-SnapshotsActionsTest-638814915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7c2505a8-80fa-4572-8527-f3631daa686d" returned: 0 in 0.359s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-61239e96-14f0-495c-a7c8-c1ad556065e7 tempest-SnapshotsActionsTest-638814915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.848s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:30:18 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-61239e96-14f0-495c-a7c8-c1ad556065e7 tempest-SnapshotsActionsTest-638814915 None] Create snapshot completed successfully
Jul 14 16:30:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-1d6f95c8-48f2-4684-b9d4-2319888c0ed4 req-a3535754-665c-469e-8173-c0898579dabd tempest-AttachVolumeTestJSON-1037344391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:30:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-1d6f95c8-48f2-4684-b9d4-2319888c0ed4 req-a3535754-665c-469e-8173-c0898579dabd tempest-AttachVolumeTestJSON-1037344391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:30:18 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[c320832f-e2bf-4ea7-a54f-72be47c96c41]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:30:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-1d6f95c8-48f2-4684-b9d4-2319888c0ed4 req-a3535754-665c-469e-8173-c0898579dabd tempest-AttachVolumeTestJSON-1037344391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-32e992a8-c129-4231-b746-e06c7ddb8e43 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:18 devstack sudo[96758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-32e992a8-c129-4231-b746-e06c7ddb8e43
Jul 14 16:30:18 devstack sudo[96758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:18 devstack sudo[96758]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-1d6f95c8-48f2-4684-b9d4-2319888c0ed4 req-a3535754-665c-469e-8173-c0898579dabd tempest-AttachVolumeTestJSON-1037344391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-32e992a8-c129-4231-b746-e06c7ddb8e43" returned: 0 in 0.366s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-1d6f95c8-48f2-4684-b9d4-2319888c0ed4 req-a3535754-665c-469e-8173-c0898579dabd tempest-AttachVolumeTestJSON-1037344391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.386s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:30:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-1d6f95c8-48f2-4684-b9d4-2319888c0ed4 req-a3535754-665c-469e-8173-c0898579dabd tempest-AttachVolumeTestJSON-1037344391 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052', 'name': 'volume-32e992a8-c129-4231-b746-e06c7ddb8e43', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3783a84c-89d5-443d-955b-ae2bbc8ef193', 'enforce_multipath': True} {{(pid=87166) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 14 16:30:18 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-1d6f95c8-48f2-4684-b9d4-2319888c0ed4 req-a3535754-665c-469e-8173-c0898579dabd tempest-AttachVolumeTestJSON-1037344391 None] attachment_update completed successfully.
Jul 14 16:30:19 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [req-97e6c519-340e-4533-a3fb-ffe024f4c219 req-b16790fb-096b-4519-8c1c-404a8c322679 tempest-VolumesSnapshotsTestJSON-1517441318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:30:19 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-97e6c519-340e-4533-a3fb-ffe024f4c219 req-b16790fb-096b-4519-8c1c-404a8c322679 tempest-VolumesSnapshotsTestJSON-1517441318 None] Flow 'volume_create_manager' (b8ff637c-0dd1-4ab5-b87e-857e7012d65e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:30:19 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-97e6c519-340e-4533-a3fb-ffe024f4c219 req-b16790fb-096b-4519-8c1c-404a8c322679 tempest-VolumesSnapshotsTestJSON-1517441318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bca8e22-aeb5-4afc-8fba-9f79e4a7efc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:30:19 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-97e6c519-340e-4533-a3fb-ffe024f4c219 req-b16790fb-096b-4519-8c1c-404a8c322679 tempest-VolumesSnapshotsTestJSON-1517441318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bca8e22-aeb5-4afc-8fba-9f79e4a7efc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:30:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1222100836',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6884c2e-2d37-4c57-b5d1-528c6da56dbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a0b31b03d924ce5a003b8fff664426a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:30:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:30:19Z,use_quota=True,user_id='e6d3281e094940cb9c1097b9a222edc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:30:19 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-97e6c519-340e-4533-a3fb-ffe024f4c219 req-b16790fb-096b-4519-8c1c-404a8c322679 tempest-VolumesSnapshotsTestJSON-1517441318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (999b676c-40a4-47bc-826a-088e0c19a8fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:30:19 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-97e6c519-340e-4533-a3fb-ffe024f4c219 req-b16790fb-096b-4519-8c1c-404a8c322679 tempest-VolumesSnapshotsTestJSON-1517441318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (999b676c-40a4-47bc-826a-088e0c19a8fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:30:19 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-97e6c519-340e-4533-a3fb-ffe024f4c219 req-b16790fb-096b-4519-8c1c-404a8c322679 tempest-VolumesSnapshotsTestJSON-1517441318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5f0bc1b-ce33-42a3-a05f-bc9f17a41587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:30:19 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-97e6c519-340e-4533-a3fb-ffe024f4c219 req-b16790fb-096b-4519-8c1c-404a8c322679 tempest-VolumesSnapshotsTestJSON-1517441318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5f0bc1b-ce33-42a3-a05f-bc9f17a41587) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6884c2e-2d37-4c57-b5d1-528c6da56dbc', 'volume_name': 'volume-b6884c2e-2d37-4c57-b5d1-528c6da56dbc', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:30:19 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-97e6c519-340e-4533-a3fb-ffe024f4c219 req-b16790fb-096b-4519-8c1c-404a8c322679 tempest-VolumesSnapshotsTestJSON-1517441318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a353562-d1d2-4113-b5ed-4ca6b256424b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:30:19 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-97e6c519-340e-4533-a3fb-ffe024f4c219 req-b16790fb-096b-4519-8c1c-404a8c322679 tempest-VolumesSnapshotsTestJSON-1517441318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a353562-d1d2-4113-b5ed-4ca6b256424b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:30:19 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-97e6c519-340e-4533-a3fb-ffe024f4c219 req-b16790fb-096b-4519-8c1c-404a8c322679 tempest-VolumesSnapshotsTestJSON-1517441318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e293b31a-adbc-4b0d-bbef-870dc0430c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:30:19 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [req-97e6c519-340e-4533-a3fb-ffe024f4c219 req-b16790fb-096b-4519-8c1c-404a8c322679 tempest-VolumesSnapshotsTestJSON-1517441318 None] Volume b6884c2e-2d37-4c57-b5d1-528c6da56dbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6884c2e-2d37-4c57-b5d1-528c6da56dbc', 'volume_size': 1}
Jul 14 16:30:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-97e6c519-340e-4533-a3fb-ffe024f4c219 req-b16790fb-096b-4519-8c1c-404a8c322679 tempest-VolumesSnapshotsTestJSON-1517441318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:30:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-97e6c519-340e-4533-a3fb-ffe024f4c219 req-b16790fb-096b-4519-8c1c-404a8c322679 tempest-VolumesSnapshotsTestJSON-1517441318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:30:19 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [req-97e6c519-340e-4533-a3fb-ffe024f4c219 req-b16790fb-096b-4519-8c1c-404a8c322679 tempest-VolumesSnapshotsTestJSON-1517441318 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:30:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1222100836',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6884c2e-2d37-4c57-b5d1-528c6da56dbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a0b31b03d924ce5a003b8fff664426a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:30:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:30:19Z,use_quota=True,user_id='e6d3281e094940cb9c1097b9a222edc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:30:19 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [req-97e6c519-340e-4533-a3fb-ffe024f4c219 req-b16790fb-096b-4519-8c1c-404a8c322679 tempest-VolumesSnapshotsTestJSON-1517441318 None] Creating volume b6884c2e-2d37-4c57-b5d1-528c6da56dbc {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:30:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-97e6c519-340e-4533-a3fb-ffe024f4c219 req-b16790fb-096b-4519-8c1c-404a8c322679 tempest-VolumesSnapshotsTestJSON-1517441318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:30:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-97e6c519-340e-4533-a3fb-ffe024f4c219 req-b16790fb-096b-4519-8c1c-404a8c322679 tempest-VolumesSnapshotsTestJSON-1517441318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:30:19 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [req-97e6c519-340e-4533-a3fb-ffe024f4c219 req-b16790fb-096b-4519-8c1c-404a8c322679 tempest-VolumesSnapshotsTestJSON-1517441318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:30:19 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [req-97e6c519-340e-4533-a3fb-ffe024f4c219 req-b16790fb-096b-4519-8c1c-404a8c322679 tempest-VolumesSnapshotsTestJSON-1517441318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:30:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-97e6c519-340e-4533-a3fb-ffe024f4c219 req-b16790fb-096b-4519-8c1c-404a8c322679 tempest-VolumesSnapshotsTestJSON-1517441318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:30:19 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [req-97e6c519-340e-4533-a3fb-ffe024f4c219 req-b16790fb-096b-4519-8c1c-404a8c322679 tempest-VolumesSnapshotsTestJSON-1517441318 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:30:19 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [req-97e6c519-340e-4533-a3fb-ffe024f4c219 req-b16790fb-096b-4519-8c1c-404a8c322679 tempest-VolumesSnapshotsTestJSON-1517441318 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:30:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-97e6c519-340e-4533-a3fb-ffe024f4c219 req-b16790fb-096b-4519-8c1c-404a8c322679 tempest-VolumesSnapshotsTestJSON-1517441318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b6884c2e-2d37-4c57-b5d1-528c6da56dbc 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:19 devstack sudo[96766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b6884c2e-2d37-4c57-b5d1-528c6da56dbc 1073741824
Jul 14 16:30:19 devstack sudo[96766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:19 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-79cb0e69-d553-4ca8-aeaf-673c2ed683bf tempest-SnapshotsActionsTest-1459873502 None] Acquiring lock "cinder-7c2505a8-80fa-4572-8527-f3631daa686d-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:30:19 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-79cb0e69-d553-4ca8-aeaf-673c2ed683bf tempest-SnapshotsActionsTest-1459873502 None] Lock "cinder-7c2505a8-80fa-4572-8527-f3631daa686d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:30:19 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-79cb0e69-d553-4ca8-aeaf-673c2ed683bf tempest-SnapshotsActionsTest-1459873502 None] Acquiring lock "cinder-quobyte-b1700751-5c94-4f7b-8047-d8888dcbdae8" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:30:19 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-79cb0e69-d553-4ca8-aeaf-673c2ed683bf tempest-SnapshotsActionsTest-1459873502 None] Lock "cinder-quobyte-b1700751-5c94-4f7b-8047-d8888dcbdae8" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:30:19 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-79cb0e69-d553-4ca8-aeaf-673c2ed683bf tempest-SnapshotsActionsTest-1459873502 None] Acquiring lock "cinder-quobyte-7c2505a8-80fa-4572-8527-f3631daa686d" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:30:19 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-79cb0e69-d553-4ca8-aeaf-673c2ed683bf tempest-SnapshotsActionsTest-1459873502 None] Lock "cinder-quobyte-7c2505a8-80fa-4572-8527-f3631daa686d" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:30:19 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-79cb0e69-d553-4ca8-aeaf-673c2ed683bf tempest-SnapshotsActionsTest-1459873502 None] Deleting offline snapshot 7c2505a8-80fa-4572-8527-f3631daa686d of volume b1700751-5c94-4f7b-8047-d8888dcbdae8 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 16:30:19 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-79cb0e69-d553-4ca8-aeaf-673c2ed683bf tempest-SnapshotsActionsTest-1459873502 None] snapshot_file for this snap is: volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7c2505a8-80fa-4572-8527-f3631daa686d {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 16:30:19 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb0fbcc0-1044-464e-af0f-ec6599c1bc1d]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:30:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-79cb0e69-d553-4ca8-aeaf-673c2ed683bf tempest-SnapshotsActionsTest-1459873502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7c2505a8-80fa-4572-8527-f3631daa686d {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:19 devstack sudo[96768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7c2505a8-80fa-4572-8527-f3631daa686d
Jul 14 16:30:19 devstack sudo[96768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:19 devstack sudo[96766]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-97e6c519-340e-4533-a3fb-ffe024f4c219 req-b16790fb-096b-4519-8c1c-404a8c322679 tempest-VolumesSnapshotsTestJSON-1517441318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b6884c2e-2d37-4c57-b5d1-528c6da56dbc 1073741824" returned: 0 in 0.508s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-97e6c519-340e-4533-a3fb-ffe024f4c219 req-b16790fb-096b-4519-8c1c-404a8c322679 tempest-VolumesSnapshotsTestJSON-1517441318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b6884c2e-2d37-4c57-b5d1-528c6da56dbc {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:20 devstack sudo[96779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b6884c2e-2d37-4c57-b5d1-528c6da56dbc
Jul 14 16:30:20 devstack sudo[96779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:20 devstack sudo[96768]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-79cb0e69-d553-4ca8-aeaf-673c2ed683bf tempest-SnapshotsActionsTest-1459873502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7c2505a8-80fa-4572-8527-f3631daa686d" returned: 0 in 0.417s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:20 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-79cb0e69-d553-4ca8-aeaf-673c2ed683bf tempest-SnapshotsActionsTest-1459873502 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1700751-5c94-4f7b-8047-d8888dcbdae8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 16:30:20 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[68507883-966b-4fb3-b874-c784fb2d6e42]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:30:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-79cb0e69-d553-4ca8-aeaf-673c2ed683bf tempest-SnapshotsActionsTest-1459873502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7aec2f37-5dcd-4047-aae5-bae12f1db9a1 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:20 devstack sudo[96789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7aec2f37-5dcd-4047-aae5-bae12f1db9a1
Jul 14 16:30:20 devstack sudo[96789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:20 devstack sudo[96779]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-97e6c519-340e-4533-a3fb-ffe024f4c219 req-b16790fb-096b-4519-8c1c-404a8c322679 tempest-VolumesSnapshotsTestJSON-1517441318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b6884c2e-2d37-4c57-b5d1-528c6da56dbc" returned: 0 in 0.259s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:20 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [req-97e6c519-340e-4533-a3fb-ffe024f4c219 req-b16790fb-096b-4519-8c1c-404a8c322679 tempest-VolumesSnapshotsTestJSON-1517441318 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:30:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-97e6c519-340e-4533-a3fb-ffe024f4c219 req-b16790fb-096b-4519-8c1c-404a8c322679 tempest-VolumesSnapshotsTestJSON-1517441318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:30:20 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-97e6c519-340e-4533-a3fb-ffe024f4c219 req-b16790fb-096b-4519-8c1c-404a8c322679 tempest-VolumesSnapshotsTestJSON-1517441318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e293b31a-adbc-4b0d-bbef-870dc0430c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6884c2e-2d37-4c57-b5d1-528c6da56dbc', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:30:20 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-97e6c519-340e-4533-a3fb-ffe024f4c219 req-b16790fb-096b-4519-8c1c-404a8c322679 tempest-VolumesSnapshotsTestJSON-1517441318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e8f5752-720f-483b-808b-6b67d338897a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:30:20 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [req-97e6c519-340e-4533-a3fb-ffe024f4c219 req-b16790fb-096b-4519-8c1c-404a8c322679 tempest-VolumesSnapshotsTestJSON-1517441318 None] Volume volume-b6884c2e-2d37-4c57-b5d1-528c6da56dbc (b6884c2e-2d37-4c57-b5d1-528c6da56dbc): created successfully
Jul 14 16:30:20 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-97e6c519-340e-4533-a3fb-ffe024f4c219 req-b16790fb-096b-4519-8c1c-404a8c322679 tempest-VolumesSnapshotsTestJSON-1517441318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e8f5752-720f-483b-808b-6b67d338897a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:30:20 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-97e6c519-340e-4533-a3fb-ffe024f4c219 req-b16790fb-096b-4519-8c1c-404a8c322679 tempest-VolumesSnapshotsTestJSON-1517441318 None] Flow 'volume_create_manager' (b8ff637c-0dd1-4ab5-b87e-857e7012d65e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:30:20 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-97e6c519-340e-4533-a3fb-ffe024f4c219 req-b16790fb-096b-4519-8c1c-404a8c322679 tempest-VolumesSnapshotsTestJSON-1517441318 None] Created volume successfully.
Jul 14 16:30:20 devstack sudo[96789]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-79cb0e69-d553-4ca8-aeaf-673c2ed683bf tempest-SnapshotsActionsTest-1459873502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7aec2f37-5dcd-4047-aae5-bae12f1db9a1" returned: 0 in 0.475s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:20 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-79cb0e69-d553-4ca8-aeaf-673c2ed683bf tempest-SnapshotsActionsTest-1459873502 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1700751-5c94-4f7b-8047-d8888dcbdae8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 16:30:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-79cb0e69-d553-4ca8-aeaf-673c2ed683bf tempest-SnapshotsActionsTest-1459873502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7c2505a8-80fa-4572-8527-f3631daa686d {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:20 devstack sudo[96813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7c2505a8-80fa-4572-8527-f3631daa686d
Jul 14 16:30:20 devstack sudo[96813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-6046f7ff-5768-48c5-8909-c6670cbe608b req-a575c9da-4411-474b-9756-29388e84711b tempest-VolumesSnapshotsTestJSON-1517441318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:30:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-6046f7ff-5768-48c5-8909-c6670cbe608b req-a575c9da-4411-474b-9756-29388e84711b tempest-VolumesSnapshotsTestJSON-1517441318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:30:20 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [req-6046f7ff-5768-48c5-8909-c6670cbe608b req-a575c9da-4411-474b-9756-29388e84711b tempest-VolumesSnapshotsTestJSON-1517441318 None] Creating offline snapshot a1a4572e-f478-42a6-878c-bf4c5a27b101 of volume b6884c2e-2d37-4c57-b5d1-528c6da56dbc {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 16:30:20 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e312177-70cd-4fe4-b411-575721e1cd68]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:30:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-6046f7ff-5768-48c5-8909-c6670cbe608b req-a575c9da-4411-474b-9756-29388e84711b tempest-VolumesSnapshotsTestJSON-1517441318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b6884c2e-2d37-4c57-b5d1-528c6da56dbc {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:21 devstack sudo[96815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b6884c2e-2d37-4c57-b5d1-528c6da56dbc
Jul 14 16:30:21 devstack sudo[96815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:21 devstack sudo[96813]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-79cb0e69-d553-4ca8-aeaf-673c2ed683bf tempest-SnapshotsActionsTest-1459873502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7c2505a8-80fa-4572-8527-f3631daa686d" returned: 0 in 0.695s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-79cb0e69-d553-4ca8-aeaf-673c2ed683bf tempest-SnapshotsActionsTest-1459873502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7c2505a8-80fa-4572-8527-f3631daa686d {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:21 devstack sudo[96820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7c2505a8-80fa-4572-8527-f3631daa686d
Jul 14 16:30:21 devstack sudo[96820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:21 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-15c9d339-ffd7-4fda-8644-12697cbb997f tempest-AttachVolumeTestJSON-1037344391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:30:21 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-15c9d339-ffd7-4fda-8644-12697cbb997f tempest-AttachVolumeTestJSON-1037344391 None] Flow 'volume_create_manager' (049fcb9b-aab8-46a4-87f0-e8577d2f1a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:30:21 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-15c9d339-ffd7-4fda-8644-12697cbb997f tempest-AttachVolumeTestJSON-1037344391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (268d44e9-cf07-4967-a26f-6934aacdb6bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:30:21 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-15c9d339-ffd7-4fda-8644-12697cbb997f tempest-AttachVolumeTestJSON-1037344391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (268d44e9-cf07-4967-a26f-6934aacdb6bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:30:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1636498772',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83777ef7-d2fe-44bb-9fb0-0bd67f1160dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a48e5fb250034dfbb4de440df0be7961',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:30:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:30:21Z,use_quota=True,user_id='ab1817e4c8eb4dfe8f1a0db1c01094e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:30:21 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-15c9d339-ffd7-4fda-8644-12697cbb997f tempest-AttachVolumeTestJSON-1037344391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (847df20a-a7b1-4915-ac93-568432a2ed11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:30:21 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-15c9d339-ffd7-4fda-8644-12697cbb997f tempest-AttachVolumeTestJSON-1037344391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (847df20a-a7b1-4915-ac93-568432a2ed11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:30:21 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-15c9d339-ffd7-4fda-8644-12697cbb997f tempest-AttachVolumeTestJSON-1037344391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eba674b2-cb5d-4306-bc19-96ba830c00b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:30:21 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-15c9d339-ffd7-4fda-8644-12697cbb997f tempest-AttachVolumeTestJSON-1037344391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eba674b2-cb5d-4306-bc19-96ba830c00b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83777ef7-d2fe-44bb-9fb0-0bd67f1160dc', 'volume_name': 'volume-83777ef7-d2fe-44bb-9fb0-0bd67f1160dc', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:30:21 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-15c9d339-ffd7-4fda-8644-12697cbb997f tempest-AttachVolumeTestJSON-1037344391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc84c941-9d61-4d70-9c80-b9e8ace7191d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:30:21 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-15c9d339-ffd7-4fda-8644-12697cbb997f tempest-AttachVolumeTestJSON-1037344391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc84c941-9d61-4d70-9c80-b9e8ace7191d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:30:21 devstack sudo[96815]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:21 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-15c9d339-ffd7-4fda-8644-12697cbb997f tempest-AttachVolumeTestJSON-1037344391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d87ee9c-f968-42ae-9508-bd39736e0e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:30:21 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-15c9d339-ffd7-4fda-8644-12697cbb997f tempest-AttachVolumeTestJSON-1037344391 None] Volume 83777ef7-d2fe-44bb-9fb0-0bd67f1160dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83777ef7-d2fe-44bb-9fb0-0bd67f1160dc', 'volume_size': 1}
Jul 14 16:30:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-15c9d339-ffd7-4fda-8644-12697cbb997f tempest-AttachVolumeTestJSON-1037344391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:30:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-6046f7ff-5768-48c5-8909-c6670cbe608b req-a575c9da-4411-474b-9756-29388e84711b tempest-VolumesSnapshotsTestJSON-1517441318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b6884c2e-2d37-4c57-b5d1-528c6da56dbc" returned: 0 in 0.593s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-6046f7ff-5768-48c5-8909-c6670cbe608b req-a575c9da-4411-474b-9756-29388e84711b tempest-VolumesSnapshotsTestJSON-1517441318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b6884c2e-2d37-4c57-b5d1-528c6da56dbc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b6884c2e-2d37-4c57-b5d1-528c6da56dbc.a1a4572e-f478-42a6-878c-bf4c5a27b101 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:21 devstack sudo[96828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b6884c2e-2d37-4c57-b5d1-528c6da56dbc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b6884c2e-2d37-4c57-b5d1-528c6da56dbc.a1a4572e-f478-42a6-878c-bf4c5a27b101 1G
Jul 14 16:30:21 devstack sudo[96828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:21 devstack sudo[96820]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-79cb0e69-d553-4ca8-aeaf-673c2ed683bf tempest-SnapshotsActionsTest-1459873502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7c2505a8-80fa-4572-8527-f3631daa686d" returned: 0 in 0.355s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:21 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-79cb0e69-d553-4ca8-aeaf-673c2ed683bf tempest-SnapshotsActionsTest-1459873502 None] Lock "cinder-quobyte-7c2505a8-80fa-4572-8527-f3631daa686d" released by "_delete_snapshot" :: held 2.078s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:30:21 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-79cb0e69-d553-4ca8-aeaf-673c2ed683bf tempest-SnapshotsActionsTest-1459873502 None] Lock "cinder-quobyte-b1700751-5c94-4f7b-8047-d8888dcbdae8" released by "delete_snapshot" :: held 2.118s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:30:21 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-79cb0e69-d553-4ca8-aeaf-673c2ed683bf tempest-SnapshotsActionsTest-1459873502 None] Created reservations ['3a41e07e-5b9d-4400-a5d9-e9cc6815580d', '1da0d5f4-dcbc-4081-9696-c6809a08aab5', '724abc86-9abe-4a20-9c9a-43238bae6e26', '90914db2-56b6-4e96-8d6c-a159d2ad5e8e'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:30:21 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-79cb0e69-d553-4ca8-aeaf-673c2ed683bf tempest-SnapshotsActionsTest-1459873502 None] Delete snapshot completed successfully.
Jul 14 16:30:21 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-79cb0e69-d553-4ca8-aeaf-673c2ed683bf tempest-SnapshotsActionsTest-1459873502 None] Lock "cinder-7c2505a8-80fa-4572-8527-f3631daa686d-delete_snapshot" released by "delete_snapshot" :: held 2.315s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:30:22 devstack sudo[96828]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-6046f7ff-5768-48c5-8909-c6670cbe608b req-a575c9da-4411-474b-9756-29388e84711b tempest-VolumesSnapshotsTestJSON-1517441318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b6884c2e-2d37-4c57-b5d1-528c6da56dbc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b6884c2e-2d37-4c57-b5d1-528c6da56dbc.a1a4572e-f478-42a6-878c-bf4c5a27b101 1G" returned: 0 in 0.531s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-6046f7ff-5768-48c5-8909-c6670cbe608b req-a575c9da-4411-474b-9756-29388e84711b tempest-VolumesSnapshotsTestJSON-1517441318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6884c2e-2d37-4c57-b5d1-528c6da56dbc -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b6884c2e-2d37-4c57-b5d1-528c6da56dbc.a1a4572e-f478-42a6-878c-bf4c5a27b101 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:22 devstack sudo[96834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6884c2e-2d37-4c57-b5d1-528c6da56dbc -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b6884c2e-2d37-4c57-b5d1-528c6da56dbc.a1a4572e-f478-42a6-878c-bf4c5a27b101
Jul 14 16:30:22 devstack sudo[96834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:22 devstack sudo[96834]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-6046f7ff-5768-48c5-8909-c6670cbe608b req-a575c9da-4411-474b-9756-29388e84711b tempest-VolumesSnapshotsTestJSON-1517441318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6884c2e-2d37-4c57-b5d1-528c6da56dbc -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b6884c2e-2d37-4c57-b5d1-528c6da56dbc.a1a4572e-f478-42a6-878c-bf4c5a27b101" returned: 0 in 0.304s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:22 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [req-6046f7ff-5768-48c5-8909-c6670cbe608b req-a575c9da-4411-474b-9756-29388e84711b tempest-VolumesSnapshotsTestJSON-1517441318 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b6884c2e-2d37-4c57-b5d1-528c6da56dbc.a1a4572e-f478-42a6-878c-bf4c5a27b101 is being set with open permissions: ugo+rw
Jul 14 16:30:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-6046f7ff-5768-48c5-8909-c6670cbe608b req-a575c9da-4411-474b-9756-29388e84711b tempest-VolumesSnapshotsTestJSON-1517441318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b6884c2e-2d37-4c57-b5d1-528c6da56dbc.a1a4572e-f478-42a6-878c-bf4c5a27b101 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:22 devstack sudo[96839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b6884c2e-2d37-4c57-b5d1-528c6da56dbc.a1a4572e-f478-42a6-878c-bf4c5a27b101
Jul 14 16:30:22 devstack sudo[96839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:22 devstack sudo[96839]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-6046f7ff-5768-48c5-8909-c6670cbe608b req-a575c9da-4411-474b-9756-29388e84711b tempest-VolumesSnapshotsTestJSON-1517441318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b6884c2e-2d37-4c57-b5d1-528c6da56dbc.a1a4572e-f478-42a6-878c-bf4c5a27b101" returned: 0 in 0.242s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-6046f7ff-5768-48c5-8909-c6670cbe608b req-a575c9da-4411-474b-9756-29388e84711b tempest-VolumesSnapshotsTestJSON-1517441318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b6884c2e-2d37-4c57-b5d1-528c6da56dbc.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:22 devstack sudo[96842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b6884c2e-2d37-4c57-b5d1-528c6da56dbc.info
Jul 14 16:30:22 devstack sudo[96842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:22 devstack sudo[96842]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-6046f7ff-5768-48c5-8909-c6670cbe608b req-a575c9da-4411-474b-9756-29388e84711b tempest-VolumesSnapshotsTestJSON-1517441318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b6884c2e-2d37-4c57-b5d1-528c6da56dbc.info" returned: 0 in 0.257s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:22 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [req-6046f7ff-5768-48c5-8909-c6670cbe608b req-a575c9da-4411-474b-9756-29388e84711b tempest-VolumesSnapshotsTestJSON-1517441318 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b6884c2e-2d37-4c57-b5d1-528c6da56dbc.info is being set with open permissions: ugo+rw
Jul 14 16:30:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-6046f7ff-5768-48c5-8909-c6670cbe608b req-a575c9da-4411-474b-9756-29388e84711b tempest-VolumesSnapshotsTestJSON-1517441318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b6884c2e-2d37-4c57-b5d1-528c6da56dbc.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:22 devstack sudo[96845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b6884c2e-2d37-4c57-b5d1-528c6da56dbc.info
Jul 14 16:30:22 devstack sudo[96845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:23 devstack sudo[96845]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-6046f7ff-5768-48c5-8909-c6670cbe608b req-a575c9da-4411-474b-9756-29388e84711b tempest-VolumesSnapshotsTestJSON-1517441318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b6884c2e-2d37-4c57-b5d1-528c6da56dbc.info" returned: 0 in 0.264s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-6046f7ff-5768-48c5-8909-c6670cbe608b req-a575c9da-4411-474b-9756-29388e84711b tempest-VolumesSnapshotsTestJSON-1517441318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.317s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:30:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-15c9d339-ffd7-4fda-8644-12697cbb997f tempest-AttachVolumeTestJSON-1037344391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.666s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:30:23 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-15c9d339-ffd7-4fda-8644-12697cbb997f tempest-AttachVolumeTestJSON-1037344391 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:30:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1636498772',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83777ef7-d2fe-44bb-9fb0-0bd67f1160dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a48e5fb250034dfbb4de440df0be7961',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:30:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:30:21Z,use_quota=True,user_id='ab1817e4c8eb4dfe8f1a0db1c01094e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:30:23 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-15c9d339-ffd7-4fda-8644-12697cbb997f tempest-AttachVolumeTestJSON-1037344391 None] Creating volume 83777ef7-d2fe-44bb-9fb0-0bd67f1160dc {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:30:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-15c9d339-ffd7-4fda-8644-12697cbb997f tempest-AttachVolumeTestJSON-1037344391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:30:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-15c9d339-ffd7-4fda-8644-12697cbb997f tempest-AttachVolumeTestJSON-1037344391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:30:23 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-15c9d339-ffd7-4fda-8644-12697cbb997f tempest-AttachVolumeTestJSON-1037344391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:30:23 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-15c9d339-ffd7-4fda-8644-12697cbb997f tempest-AttachVolumeTestJSON-1037344391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:30:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-15c9d339-ffd7-4fda-8644-12697cbb997f tempest-AttachVolumeTestJSON-1037344391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:30:23 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-15c9d339-ffd7-4fda-8644-12697cbb997f tempest-AttachVolumeTestJSON-1037344391 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:30:23 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-15c9d339-ffd7-4fda-8644-12697cbb997f tempest-AttachVolumeTestJSON-1037344391 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:30:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-15c9d339-ffd7-4fda-8644-12697cbb997f tempest-AttachVolumeTestJSON-1037344391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-83777ef7-d2fe-44bb-9fb0-0bd67f1160dc 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:23 devstack sudo[96848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-83777ef7-d2fe-44bb-9fb0-0bd67f1160dc 1073741824
Jul 14 16:30:23 devstack sudo[96848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:23 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-6046f7ff-5768-48c5-8909-c6670cbe608b req-a575c9da-4411-474b-9756-29388e84711b tempest-VolumesSnapshotsTestJSON-1517441318 None] Create snapshot completed successfully
Jul 14 16:30:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-348847a4-092b-45a9-bf46-325fcedfd5ae tempest-SnapshotsActionsTest-638814915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:30:23 devstack sudo[96848]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-15c9d339-ffd7-4fda-8644-12697cbb997f tempest-AttachVolumeTestJSON-1037344391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-83777ef7-d2fe-44bb-9fb0-0bd67f1160dc 1073741824" returned: 0 in 0.555s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-15c9d339-ffd7-4fda-8644-12697cbb997f tempest-AttachVolumeTestJSON-1037344391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-83777ef7-d2fe-44bb-9fb0-0bd67f1160dc {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:23 devstack sudo[96854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-83777ef7-d2fe-44bb-9fb0-0bd67f1160dc
Jul 14 16:30:23 devstack sudo[96854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:24 devstack sudo[96854]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-15c9d339-ffd7-4fda-8644-12697cbb997f tempest-AttachVolumeTestJSON-1037344391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-83777ef7-d2fe-44bb-9fb0-0bd67f1160dc" returned: 0 in 0.240s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:24 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-15c9d339-ffd7-4fda-8644-12697cbb997f tempest-AttachVolumeTestJSON-1037344391 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:30:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-15c9d339-ffd7-4fda-8644-12697cbb997f tempest-AttachVolumeTestJSON-1037344391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:30:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-348847a4-092b-45a9-bf46-325fcedfd5ae tempest-SnapshotsActionsTest-638814915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.704s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:30:24 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-348847a4-092b-45a9-bf46-325fcedfd5ae tempest-SnapshotsActionsTest-638814915 None] Creating offline snapshot 8b2adac8-9523-4e8f-97a5-949c2fa3c9c1 of volume b1700751-5c94-4f7b-8047-d8888dcbdae8 {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 16:30:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-15c9d339-ffd7-4fda-8644-12697cbb997f tempest-AttachVolumeTestJSON-1037344391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d87ee9c-f968-42ae-9508-bd39736e0e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83777ef7-d2fe-44bb-9fb0-0bd67f1160dc', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:30:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-15c9d339-ffd7-4fda-8644-12697cbb997f tempest-AttachVolumeTestJSON-1037344391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2694c0b-b983-4a73-8490-69dbf092fe7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:30:24 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[10146e6a-65fd-42d9-ad87-9b230d38ddda]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:30:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-348847a4-092b-45a9-bf46-325fcedfd5ae tempest-SnapshotsActionsTest-638814915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7aec2f37-5dcd-4047-aae5-bae12f1db9a1 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:24 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-15c9d339-ffd7-4fda-8644-12697cbb997f tempest-AttachVolumeTestJSON-1037344391 None] Volume volume-83777ef7-d2fe-44bb-9fb0-0bd67f1160dc (83777ef7-d2fe-44bb-9fb0-0bd67f1160dc): created successfully
Jul 14 16:30:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-15c9d339-ffd7-4fda-8644-12697cbb997f tempest-AttachVolumeTestJSON-1037344391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2694c0b-b983-4a73-8490-69dbf092fe7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:30:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-15c9d339-ffd7-4fda-8644-12697cbb997f tempest-AttachVolumeTestJSON-1037344391 None] Flow 'volume_create_manager' (049fcb9b-aab8-46a4-87f0-e8577d2f1a76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:30:24 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-15c9d339-ffd7-4fda-8644-12697cbb997f tempest-AttachVolumeTestJSON-1037344391 None] Created volume successfully.
Jul 14 16:30:24 devstack sudo[96857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7aec2f37-5dcd-4047-aae5-bae12f1db9a1
Jul 14 16:30:24 devstack sudo[96857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:24 devstack cinder-volume[87166]: DEBUG cinder.coordination [req-4829f19f-87ac-472e-9a2a-cff1522e0711 req-b3ab2b9f-f4b6-4e53-902c-dbbf25f851e8 tempest-VolumesSnapshotsTestJSON-1517441318 None] Acquiring lock "cinder-a1a4572e-f478-42a6-878c-bf4c5a27b101-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:30:24 devstack cinder-volume[87166]: DEBUG cinder.coordination [req-4829f19f-87ac-472e-9a2a-cff1522e0711 req-b3ab2b9f-f4b6-4e53-902c-dbbf25f851e8 tempest-VolumesSnapshotsTestJSON-1517441318 None] Lock "cinder-a1a4572e-f478-42a6-878c-bf4c5a27b101-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:30:24 devstack cinder-volume[87166]: DEBUG cinder.coordination [req-4829f19f-87ac-472e-9a2a-cff1522e0711 req-b3ab2b9f-f4b6-4e53-902c-dbbf25f851e8 tempest-VolumesSnapshotsTestJSON-1517441318 None] Acquiring lock "cinder-quobyte-b6884c2e-2d37-4c57-b5d1-528c6da56dbc" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:30:24 devstack cinder-volume[87166]: DEBUG cinder.coordination [req-4829f19f-87ac-472e-9a2a-cff1522e0711 req-b3ab2b9f-f4b6-4e53-902c-dbbf25f851e8 tempest-VolumesSnapshotsTestJSON-1517441318 None] Lock "cinder-quobyte-b6884c2e-2d37-4c57-b5d1-528c6da56dbc" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:30:24 devstack cinder-volume[87166]: DEBUG cinder.coordination [req-4829f19f-87ac-472e-9a2a-cff1522e0711 req-b3ab2b9f-f4b6-4e53-902c-dbbf25f851e8 tempest-VolumesSnapshotsTestJSON-1517441318 None] Acquiring lock "cinder-quobyte-a1a4572e-f478-42a6-878c-bf4c5a27b101" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:30:24 devstack cinder-volume[87166]: DEBUG cinder.coordination [req-4829f19f-87ac-472e-9a2a-cff1522e0711 req-b3ab2b9f-f4b6-4e53-902c-dbbf25f851e8 tempest-VolumesSnapshotsTestJSON-1517441318 None] Lock "cinder-quobyte-a1a4572e-f478-42a6-878c-bf4c5a27b101" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:30:24 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [req-4829f19f-87ac-472e-9a2a-cff1522e0711 req-b3ab2b9f-f4b6-4e53-902c-dbbf25f851e8 tempest-VolumesSnapshotsTestJSON-1517441318 None] Deleting offline snapshot a1a4572e-f478-42a6-878c-bf4c5a27b101 of volume b6884c2e-2d37-4c57-b5d1-528c6da56dbc {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 16:30:24 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [req-4829f19f-87ac-472e-9a2a-cff1522e0711 req-b3ab2b9f-f4b6-4e53-902c-dbbf25f851e8 tempest-VolumesSnapshotsTestJSON-1517441318 None] snapshot_file for this snap is: volume-b6884c2e-2d37-4c57-b5d1-528c6da56dbc.a1a4572e-f478-42a6-878c-bf4c5a27b101 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 16:30:24 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e9c19ed-409d-435a-8063-59ab0591b89b]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:30:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-4829f19f-87ac-472e-9a2a-cff1522e0711 req-b3ab2b9f-f4b6-4e53-902c-dbbf25f851e8 tempest-VolumesSnapshotsTestJSON-1517441318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b6884c2e-2d37-4c57-b5d1-528c6da56dbc.a1a4572e-f478-42a6-878c-bf4c5a27b101 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:24 devstack sudo[96857]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-348847a4-092b-45a9-bf46-325fcedfd5ae tempest-SnapshotsActionsTest-638814915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7aec2f37-5dcd-4047-aae5-bae12f1db9a1" returned: 0 in 0.476s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:24 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-348847a4-092b-45a9-bf46-325fcedfd5ae tempest-SnapshotsActionsTest-638814915 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1700751-5c94-4f7b-8047-d8888dcbdae8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 16:30:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-348847a4-092b-45a9-bf46-325fcedfd5ae tempest-SnapshotsActionsTest-638814915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7aec2f37-5dcd-4047-aae5-bae12f1db9a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.8b2adac8-9523-4e8f-97a5-949c2fa3c9c1 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:24 devstack sudo[96863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7aec2f37-5dcd-4047-aae5-bae12f1db9a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.8b2adac8-9523-4e8f-97a5-949c2fa3c9c1 1G
Jul 14 16:30:24 devstack sudo[96863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:24 devstack sudo[96862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b6884c2e-2d37-4c57-b5d1-528c6da56dbc.a1a4572e-f478-42a6-878c-bf4c5a27b101
Jul 14 16:30:24 devstack sudo[96862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:25 devstack sudo[96862]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-4829f19f-87ac-472e-9a2a-cff1522e0711 req-b3ab2b9f-f4b6-4e53-902c-dbbf25f851e8 tempest-VolumesSnapshotsTestJSON-1517441318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b6884c2e-2d37-4c57-b5d1-528c6da56dbc.a1a4572e-f478-42a6-878c-bf4c5a27b101" returned: 0 in 0.449s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:25 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [req-4829f19f-87ac-472e-9a2a-cff1522e0711 req-b3ab2b9f-f4b6-4e53-902c-dbbf25f851e8 tempest-VolumesSnapshotsTestJSON-1517441318 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6884c2e-2d37-4c57-b5d1-528c6da56dbc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 16:30:25 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b52d227-b6fa-4d4d-a83e-fb67964fd9b4]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:30:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-4829f19f-87ac-472e-9a2a-cff1522e0711 req-b3ab2b9f-f4b6-4e53-902c-dbbf25f851e8 tempest-VolumesSnapshotsTestJSON-1517441318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b6884c2e-2d37-4c57-b5d1-528c6da56dbc {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:25 devstack sudo[96875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b6884c2e-2d37-4c57-b5d1-528c6da56dbc
Jul 14 16:30:25 devstack sudo[96875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:25 devstack sudo[96863]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-348847a4-092b-45a9-bf46-325fcedfd5ae tempest-SnapshotsActionsTest-638814915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7aec2f37-5dcd-4047-aae5-bae12f1db9a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.8b2adac8-9523-4e8f-97a5-949c2fa3c9c1 1G" returned: 0 in 0.627s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-348847a4-092b-45a9-bf46-325fcedfd5ae tempest-SnapshotsActionsTest-638814915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7aec2f37-5dcd-4047-aae5-bae12f1db9a1 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.8b2adac8-9523-4e8f-97a5-949c2fa3c9c1 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:25 devstack sudo[96879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7aec2f37-5dcd-4047-aae5-bae12f1db9a1 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.8b2adac8-9523-4e8f-97a5-949c2fa3c9c1
Jul 14 16:30:25 devstack sudo[96879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-61195080-9d25-4f56-9aa5-aaae8fe36c31 req-bb01e566-4ec3-4625-8b01-fcd5a3244df0 tempest-AttachVolumeTestJSON-1037344391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:30:25 devstack sudo[96875]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-4829f19f-87ac-472e-9a2a-cff1522e0711 req-b3ab2b9f-f4b6-4e53-902c-dbbf25f851e8 tempest-VolumesSnapshotsTestJSON-1517441318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b6884c2e-2d37-4c57-b5d1-528c6da56dbc" returned: 0 in 0.446s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-4829f19f-87ac-472e-9a2a-cff1522e0711 req-b3ab2b9f-f4b6-4e53-902c-dbbf25f851e8 tempest-VolumesSnapshotsTestJSON-1517441318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b6884c2e-2d37-4c57-b5d1-528c6da56dbc.a1a4572e-f478-42a6-878c-bf4c5a27b101 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:25 devstack sudo[96893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b6884c2e-2d37-4c57-b5d1-528c6da56dbc.a1a4572e-f478-42a6-878c-bf4c5a27b101
Jul 14 16:30:25 devstack sudo[96893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:25 devstack sudo[96879]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-348847a4-092b-45a9-bf46-325fcedfd5ae tempest-SnapshotsActionsTest-638814915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7aec2f37-5dcd-4047-aae5-bae12f1db9a1 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.8b2adac8-9523-4e8f-97a5-949c2fa3c9c1" returned: 0 in 0.341s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:25 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-348847a4-092b-45a9-bf46-325fcedfd5ae tempest-SnapshotsActionsTest-638814915 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.8b2adac8-9523-4e8f-97a5-949c2fa3c9c1 is being set with open permissions: ugo+rw
Jul 14 16:30:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-348847a4-092b-45a9-bf46-325fcedfd5ae tempest-SnapshotsActionsTest-638814915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.8b2adac8-9523-4e8f-97a5-949c2fa3c9c1 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:25 devstack sudo[96895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.8b2adac8-9523-4e8f-97a5-949c2fa3c9c1
Jul 14 16:30:25 devstack sudo[96895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:25 devstack sudo[96895]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-348847a4-092b-45a9-bf46-325fcedfd5ae tempest-SnapshotsActionsTest-638814915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.8b2adac8-9523-4e8f-97a5-949c2fa3c9c1" returned: 0 in 0.252s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-348847a4-092b-45a9-bf46-325fcedfd5ae tempest-SnapshotsActionsTest-638814915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.809s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:30:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-61195080-9d25-4f56-9aa5-aaae8fe36c31 req-bb01e566-4ec3-4625-8b01-fcd5a3244df0 tempest-AttachVolumeTestJSON-1037344391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.420s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:30:25 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d53ec94-8e2f-4b67-8cfc-d67b8dfeb4bd]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:30:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-61195080-9d25-4f56-9aa5-aaae8fe36c31 req-bb01e566-4ec3-4625-8b01-fcd5a3244df0 tempest-AttachVolumeTestJSON-1037344391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-83777ef7-d2fe-44bb-9fb0-0bd67f1160dc {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:25 devstack sudo[96893]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-4829f19f-87ac-472e-9a2a-cff1522e0711 req-b3ab2b9f-f4b6-4e53-902c-dbbf25f851e8 tempest-VolumesSnapshotsTestJSON-1517441318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b6884c2e-2d37-4c57-b5d1-528c6da56dbc.a1a4572e-f478-42a6-878c-bf4c5a27b101" returned: 0 in 0.383s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-4829f19f-87ac-472e-9a2a-cff1522e0711 req-b3ab2b9f-f4b6-4e53-902c-dbbf25f851e8 tempest-VolumesSnapshotsTestJSON-1517441318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b6884c2e-2d37-4c57-b5d1-528c6da56dbc.a1a4572e-f478-42a6-878c-bf4c5a27b101 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:25 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-348847a4-092b-45a9-bf46-325fcedfd5ae tempest-SnapshotsActionsTest-638814915 None] Create snapshot completed successfully
Jul 14 16:30:25 devstack sudo[96902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b6884c2e-2d37-4c57-b5d1-528c6da56dbc.a1a4572e-f478-42a6-878c-bf4c5a27b101
Jul 14 16:30:25 devstack sudo[96902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:26 devstack sudo[96901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-83777ef7-d2fe-44bb-9fb0-0bd67f1160dc
Jul 14 16:30:26 devstack sudo[96901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:26 devstack sudo[96902]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-4829f19f-87ac-472e-9a2a-cff1522e0711 req-b3ab2b9f-f4b6-4e53-902c-dbbf25f851e8 tempest-VolumesSnapshotsTestJSON-1517441318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b6884c2e-2d37-4c57-b5d1-528c6da56dbc.a1a4572e-f478-42a6-878c-bf4c5a27b101" returned: 0 in 0.253s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:26 devstack cinder-volume[87166]: DEBUG cinder.coordination [req-4829f19f-87ac-472e-9a2a-cff1522e0711 req-b3ab2b9f-f4b6-4e53-902c-dbbf25f851e8 tempest-VolumesSnapshotsTestJSON-1517441318 None] Lock "cinder-quobyte-a1a4572e-f478-42a6-878c-bf4c5a27b101" released by "_delete_snapshot" :: held 1.690s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:30:26 devstack cinder-volume[87166]: DEBUG cinder.coordination [req-4829f19f-87ac-472e-9a2a-cff1522e0711 req-b3ab2b9f-f4b6-4e53-902c-dbbf25f851e8 tempest-VolumesSnapshotsTestJSON-1517441318 None] Lock "cinder-quobyte-b6884c2e-2d37-4c57-b5d1-528c6da56dbc" released by "delete_snapshot" :: held 1.721s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:30:26 devstack sudo[96901]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-61195080-9d25-4f56-9aa5-aaae8fe36c31 req-bb01e566-4ec3-4625-8b01-fcd5a3244df0 tempest-AttachVolumeTestJSON-1037344391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-83777ef7-d2fe-44bb-9fb0-0bd67f1160dc" returned: 0 in 0.383s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-61195080-9d25-4f56-9aa5-aaae8fe36c31 req-bb01e566-4ec3-4625-8b01-fcd5a3244df0 tempest-AttachVolumeTestJSON-1037344391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.411s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:30:26 devstack cinder-volume[87166]: DEBUG cinder.quota [req-4829f19f-87ac-472e-9a2a-cff1522e0711 req-b3ab2b9f-f4b6-4e53-902c-dbbf25f851e8 tempest-VolumesSnapshotsTestJSON-1517441318 None] Created reservations ['2d4918b3-3d65-4555-bde2-c0ea0cddc697', 'cb451ee6-7a0d-44ba-972a-9923fb3a2094', '07b48d66-dacb-4d0f-b199-2debf58638e2', '825b0779-b78c-4f4a-81b8-dbb4f1ddaf41'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:30:26 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-61195080-9d25-4f56-9aa5-aaae8fe36c31 req-bb01e566-4ec3-4625-8b01-fcd5a3244df0 tempest-AttachVolumeTestJSON-1037344391 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052', 'name': 'volume-83777ef7-d2fe-44bb-9fb0-0bd67f1160dc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a9cdf9b9-2cb3-4edb-94e1-3dcd21a42f57', 'enforce_multipath': True} {{(pid=87166) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 14 16:30:26 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-4829f19f-87ac-472e-9a2a-cff1522e0711 req-b3ab2b9f-f4b6-4e53-902c-dbbf25f851e8 tempest-VolumesSnapshotsTestJSON-1517441318 None] Delete snapshot completed successfully.
Jul 14 16:30:26 devstack cinder-volume[87166]: DEBUG cinder.coordination [req-4829f19f-87ac-472e-9a2a-cff1522e0711 req-b3ab2b9f-f4b6-4e53-902c-dbbf25f851e8 tempest-VolumesSnapshotsTestJSON-1517441318 None] Lock "cinder-a1a4572e-f478-42a6-878c-bf4c5a27b101-delete_snapshot" released by "delete_snapshot" :: held 1.903s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:30:26 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-61195080-9d25-4f56-9aa5-aaae8fe36c31 req-bb01e566-4ec3-4625-8b01-fcd5a3244df0 tempest-AttachVolumeTestJSON-1037344391 None] attachment_update completed successfully.
Jul 14 16:30:26 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0c65afad-fd83-4dab-b78a-d75e5657d500 tempest-SnapshotsActionsTest-1459873502 None] Acquiring lock "cinder-8b2adac8-9523-4e8f-97a5-949c2fa3c9c1-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:30:26 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0c65afad-fd83-4dab-b78a-d75e5657d500 tempest-SnapshotsActionsTest-1459873502 None] Lock "cinder-8b2adac8-9523-4e8f-97a5-949c2fa3c9c1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:30:26 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0c65afad-fd83-4dab-b78a-d75e5657d500 tempest-SnapshotsActionsTest-1459873502 None] Acquiring lock "cinder-quobyte-b1700751-5c94-4f7b-8047-d8888dcbdae8" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:30:26 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0c65afad-fd83-4dab-b78a-d75e5657d500 tempest-SnapshotsActionsTest-1459873502 None] Lock "cinder-quobyte-b1700751-5c94-4f7b-8047-d8888dcbdae8" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:30:26 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0c65afad-fd83-4dab-b78a-d75e5657d500 tempest-SnapshotsActionsTest-1459873502 None] Acquiring lock "cinder-quobyte-8b2adac8-9523-4e8f-97a5-949c2fa3c9c1" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:30:26 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0c65afad-fd83-4dab-b78a-d75e5657d500 tempest-SnapshotsActionsTest-1459873502 None] Lock "cinder-quobyte-8b2adac8-9523-4e8f-97a5-949c2fa3c9c1" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:30:26 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-0c65afad-fd83-4dab-b78a-d75e5657d500 tempest-SnapshotsActionsTest-1459873502 None] Deleting offline snapshot 8b2adac8-9523-4e8f-97a5-949c2fa3c9c1 of volume b1700751-5c94-4f7b-8047-d8888dcbdae8 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 16:30:26 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-0c65afad-fd83-4dab-b78a-d75e5657d500 tempest-SnapshotsActionsTest-1459873502 None] snapshot_file for this snap is: volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.8b2adac8-9523-4e8f-97a5-949c2fa3c9c1 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 16:30:26 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[d447b76d-2e84-4864-9085-041d1f860dbd]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:30:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0c65afad-fd83-4dab-b78a-d75e5657d500 tempest-SnapshotsActionsTest-1459873502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.8b2adac8-9523-4e8f-97a5-949c2fa3c9c1 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:26 devstack cinder-volume[87166]: DEBUG cinder.coordination [req-832619c5-2ef8-4840-a7b7-9935531b0688 req-f47e7649-b498-45d4-b0a2-217980e7646a tempest-VolumesSnapshotsTestJSON-1517441318 None] Acquiring lock "cinder-b6884c2e-2d37-4c57-b5d1-528c6da56dbc-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:30:26 devstack cinder-volume[87166]: DEBUG cinder.coordination [req-832619c5-2ef8-4840-a7b7-9935531b0688 req-f47e7649-b498-45d4-b0a2-217980e7646a tempest-VolumesSnapshotsTestJSON-1517441318 None] Lock "cinder-b6884c2e-2d37-4c57-b5d1-528c6da56dbc-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:30:26 devstack sudo[96911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.8b2adac8-9523-4e8f-97a5-949c2fa3c9c1
Jul 14 16:30:26 devstack sudo[96911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:26 devstack cinder-volume[87166]: DEBUG cinder.coordination [req-832619c5-2ef8-4840-a7b7-9935531b0688 req-f47e7649-b498-45d4-b0a2-217980e7646a tempest-VolumesSnapshotsTestJSON-1517441318 None] Acquiring lock "cinder-quobyte-b6884c2e-2d37-4c57-b5d1-528c6da56dbc" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:30:27 devstack cinder-volume[87166]: DEBUG cinder.coordination [req-832619c5-2ef8-4840-a7b7-9935531b0688 req-f47e7649-b498-45d4-b0a2-217980e7646a tempest-VolumesSnapshotsTestJSON-1517441318 None] Lock "cinder-quobyte-b6884c2e-2d37-4c57-b5d1-528c6da56dbc" acquired by "delete_volume" :: waited 0.024s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:30:27 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd1facd-2d5d-4214-983e-feb52bc62fc3]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:30:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-832619c5-2ef8-4840-a7b7-9935531b0688 req-f47e7649-b498-45d4-b0a2-217980e7646a tempest-VolumesSnapshotsTestJSON-1517441318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b6884c2e-2d37-4c57-b5d1-528c6da56dbc {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:27 devstack sudo[96913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b6884c2e-2d37-4c57-b5d1-528c6da56dbc
Jul 14 16:30:27 devstack sudo[96913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:27 devstack sudo[96911]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0c65afad-fd83-4dab-b78a-d75e5657d500 tempest-SnapshotsActionsTest-1459873502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.8b2adac8-9523-4e8f-97a5-949c2fa3c9c1" returned: 0 in 0.514s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:27 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-0c65afad-fd83-4dab-b78a-d75e5657d500 tempest-SnapshotsActionsTest-1459873502 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1700751-5c94-4f7b-8047-d8888dcbdae8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 16:30:27 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3736db4-3f43-4377-9f83-7fa32acbd47f]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:30:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0c65afad-fd83-4dab-b78a-d75e5657d500 tempest-SnapshotsActionsTest-1459873502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7aec2f37-5dcd-4047-aae5-bae12f1db9a1 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:27 devstack sudo[96918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7aec2f37-5dcd-4047-aae5-bae12f1db9a1
Jul 14 16:30:27 devstack sudo[96918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:27 devstack sudo[96913]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-832619c5-2ef8-4840-a7b7-9935531b0688 req-f47e7649-b498-45d4-b0a2-217980e7646a tempest-VolumesSnapshotsTestJSON-1517441318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b6884c2e-2d37-4c57-b5d1-528c6da56dbc" returned: 0 in 0.486s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-832619c5-2ef8-4840-a7b7-9935531b0688 req-f47e7649-b498-45d4-b0a2-217980e7646a tempest-VolumesSnapshotsTestJSON-1517441318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b6884c2e-2d37-4c57-b5d1-528c6da56dbc {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:27 devstack sudo[96925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b6884c2e-2d37-4c57-b5d1-528c6da56dbc
Jul 14 16:30:27 devstack sudo[96925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:27 devstack sudo[96918]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0c65afad-fd83-4dab-b78a-d75e5657d500 tempest-SnapshotsActionsTest-1459873502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7aec2f37-5dcd-4047-aae5-bae12f1db9a1" returned: 0 in 0.508s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:27 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-0c65afad-fd83-4dab-b78a-d75e5657d500 tempest-SnapshotsActionsTest-1459873502 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1700751-5c94-4f7b-8047-d8888dcbdae8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 16:30:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0c65afad-fd83-4dab-b78a-d75e5657d500 tempest-SnapshotsActionsTest-1459873502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.8b2adac8-9523-4e8f-97a5-949c2fa3c9c1 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:27 devstack sudo[96925]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-832619c5-2ef8-4840-a7b7-9935531b0688 req-f47e7649-b498-45d4-b0a2-217980e7646a tempest-VolumesSnapshotsTestJSON-1517441318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b6884c2e-2d37-4c57-b5d1-528c6da56dbc" returned: 0 in 0.311s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:27 devstack sudo[96931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.8b2adac8-9523-4e8f-97a5-949c2fa3c9c1
Jul 14 16:30:27 devstack sudo[96931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:27 devstack cinder-volume[87166]: DEBUG cinder.coordination [req-832619c5-2ef8-4840-a7b7-9935531b0688 req-f47e7649-b498-45d4-b0a2-217980e7646a tempest-VolumesSnapshotsTestJSON-1517441318 None] Lock "cinder-quobyte-b6884c2e-2d37-4c57-b5d1-528c6da56dbc" released by "delete_volume" :: held 0.870s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:30:27 devstack cinder-volume[87166]: DEBUG cinder.quota [req-832619c5-2ef8-4840-a7b7-9935531b0688 req-f47e7649-b498-45d4-b0a2-217980e7646a tempest-VolumesSnapshotsTestJSON-1517441318 None] Created reservations ['08a86cab-a890-4f93-8cb3-8e0943832542', 'daba99eb-2485-4b97-81c5-5aae902407bb', '8e4a621a-4cfe-4721-ad08-3f7876c83eac', '38056bc0-8d46-4689-bc8c-782f5490dd58'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:30:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-832619c5-2ef8-4840-a7b7-9935531b0688 req-f47e7649-b498-45d4-b0a2-217980e7646a tempest-VolumesSnapshotsTestJSON-1517441318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:30:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-832619c5-2ef8-4840-a7b7-9935531b0688 req-f47e7649-b498-45d4-b0a2-217980e7646a tempest-VolumesSnapshotsTestJSON-1517441318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:30:28 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [req-832619c5-2ef8-4840-a7b7-9935531b0688 req-f47e7649-b498-45d4-b0a2-217980e7646a tempest-VolumesSnapshotsTestJSON-1517441318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:30:28 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [req-832619c5-2ef8-4840-a7b7-9935531b0688 req-f47e7649-b498-45d4-b0a2-217980e7646a tempest-VolumesSnapshotsTestJSON-1517441318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:30:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-832619c5-2ef8-4840-a7b7-9935531b0688 req-f47e7649-b498-45d4-b0a2-217980e7646a tempest-VolumesSnapshotsTestJSON-1517441318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:30:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-832619c5-2ef8-4840-a7b7-9935531b0688 req-f47e7649-b498-45d4-b0a2-217980e7646a tempest-VolumesSnapshotsTestJSON-1517441318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:28 devstack sudo[96933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:30:28 devstack sudo[96933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:28 devstack sudo[96931]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0c65afad-fd83-4dab-b78a-d75e5657d500 tempest-SnapshotsActionsTest-1459873502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.8b2adac8-9523-4e8f-97a5-949c2fa3c9c1" returned: 0 in 0.647s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0c65afad-fd83-4dab-b78a-d75e5657d500 tempest-SnapshotsActionsTest-1459873502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.8b2adac8-9523-4e8f-97a5-949c2fa3c9c1 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:28 devstack sudo[96933]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-832619c5-2ef8-4840-a7b7-9935531b0688 req-f47e7649-b498-45d4-b0a2-217980e7646a tempest-VolumesSnapshotsTestJSON-1517441318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.415s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:28 devstack cinder-volume[87166]: DEBUG cinder.manager [req-832619c5-2ef8-4840-a7b7-9935531b0688 req-f47e7649-b498-45d4-b0a2-217980e7646a tempest-VolumesSnapshotsTestJSON-1517441318 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:30:28 devstack sudo[96941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.8b2adac8-9523-4e8f-97a5-949c2fa3c9c1
Jul 14 16:30:28 devstack sudo[96941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:28 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-832619c5-2ef8-4840-a7b7-9935531b0688 req-f47e7649-b498-45d4-b0a2-217980e7646a tempest-VolumesSnapshotsTestJSON-1517441318 None] Deleted volume successfully.
Jul 14 16:30:28 devstack cinder-volume[87166]: DEBUG cinder.coordination [req-832619c5-2ef8-4840-a7b7-9935531b0688 req-f47e7649-b498-45d4-b0a2-217980e7646a tempest-VolumesSnapshotsTestJSON-1517441318 None] Lock "cinder-b6884c2e-2d37-4c57-b5d1-528c6da56dbc-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:30:28 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-69517ea1-a8ae-4317-8535-5ed8cd2ffc69 req-510a1dbd-196b-484b-801f-34b4a25e1053 tempest-AttachVolumeTestJSON-1037344391 None] Terminate volume connection completed successfully.
Jul 14 16:30:28 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-69517ea1-a8ae-4317-8535-5ed8cd2ffc69 req-510a1dbd-196b-484b-801f-34b4a25e1053 tempest-AttachVolumeTestJSON-1037344391 None] Deleting attachment 3783a84c-89d5-443d-955b-ae2bbc8ef193. {{(pid=87166) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 14 16:30:28 devstack sudo[96941]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0c65afad-fd83-4dab-b78a-d75e5657d500 tempest-SnapshotsActionsTest-1459873502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.8b2adac8-9523-4e8f-97a5-949c2fa3c9c1" returned: 0 in 0.391s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:28 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0c65afad-fd83-4dab-b78a-d75e5657d500 tempest-SnapshotsActionsTest-1459873502 None] Lock "cinder-quobyte-8b2adac8-9523-4e8f-97a5-949c2fa3c9c1" released by "_delete_snapshot" :: held 2.209s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:30:28 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0c65afad-fd83-4dab-b78a-d75e5657d500 tempest-SnapshotsActionsTest-1459873502 None] Lock "cinder-quobyte-b1700751-5c94-4f7b-8047-d8888dcbdae8" released by "delete_snapshot" :: held 2.247s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:30:28 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-0c65afad-fd83-4dab-b78a-d75e5657d500 tempest-SnapshotsActionsTest-1459873502 None] Created reservations ['90ce91f2-50cf-4fd8-b2df-525ea9b4d59a', '1ac9f7ce-5b7a-49e3-a4c7-4b2f47633eb3', '70d6cdcf-5557-485f-9294-927c1c1b2d01', '63aba190-63f7-4807-89d4-179e6efe1fc2'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:30:29 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-0c65afad-fd83-4dab-b78a-d75e5657d500 tempest-SnapshotsActionsTest-1459873502 None] Delete snapshot completed successfully.
Jul 14 16:30:29 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0c65afad-fd83-4dab-b78a-d75e5657d500 tempest-SnapshotsActionsTest-1459873502 None] Lock "cinder-8b2adac8-9523-4e8f-97a5-949c2fa3c9c1-delete_snapshot" released by "delete_snapshot" :: held 2.418s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:30:29 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-10070022-e736-4743-800b-6d828935c319 req-b5c0d403-fb30-43f1-8346-33ab8f5b7b18 tempest-AttachVolumeTestJSON-1037344391 None] Terminate volume connection completed successfully.
Jul 14 16:30:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-10070022-e736-4743-800b-6d828935c319 req-b5c0d403-fb30-43f1-8346-33ab8f5b7b18 tempest-AttachVolumeTestJSON-1037344391 None] Deleting attachment a9cdf9b9-2cb3-4edb-94e1-3dcd21a42f57. {{(pid=87166) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 14 16:30:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-db507d01-c016-4451-83a2-be22fbe2c56a tempest-SnapshotsActionsTest-638814915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:30:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-db507d01-c016-4451-83a2-be22fbe2c56a tempest-SnapshotsActionsTest-638814915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:30:30 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-db507d01-c016-4451-83a2-be22fbe2c56a tempest-SnapshotsActionsTest-638814915 None] Creating offline snapshot b26490b0-942c-4f9b-ac3d-a0a439320d80 of volume b1700751-5c94-4f7b-8047-d8888dcbdae8 {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 16:30:30 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e90c96-2055-40ee-a8c8-bb5f848afbf4]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:30:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-db507d01-c016-4451-83a2-be22fbe2c56a tempest-SnapshotsActionsTest-638814915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7aec2f37-5dcd-4047-aae5-bae12f1db9a1 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:30 devstack sudo[96948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7aec2f37-5dcd-4047-aae5-bae12f1db9a1
Jul 14 16:30:30 devstack sudo[96948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:30 devstack sudo[96948]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-db507d01-c016-4451-83a2-be22fbe2c56a tempest-SnapshotsActionsTest-638814915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7aec2f37-5dcd-4047-aae5-bae12f1db9a1" returned: 0 in 0.478s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:30 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-db507d01-c016-4451-83a2-be22fbe2c56a tempest-SnapshotsActionsTest-638814915 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1700751-5c94-4f7b-8047-d8888dcbdae8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 16:30:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-db507d01-c016-4451-83a2-be22fbe2c56a tempest-SnapshotsActionsTest-638814915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7aec2f37-5dcd-4047-aae5-bae12f1db9a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.b26490b0-942c-4f9b-ac3d-a0a439320d80 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:30 devstack sudo[96953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7aec2f37-5dcd-4047-aae5-bae12f1db9a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.b26490b0-942c-4f9b-ac3d-a0a439320d80 1G
Jul 14 16:30:30 devstack sudo[96953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:31 devstack sudo[96953]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-db507d01-c016-4451-83a2-be22fbe2c56a tempest-SnapshotsActionsTest-638814915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7aec2f37-5dcd-4047-aae5-bae12f1db9a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.b26490b0-942c-4f9b-ac3d-a0a439320d80 1G" returned: 0 in 0.576s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-db507d01-c016-4451-83a2-be22fbe2c56a tempest-SnapshotsActionsTest-638814915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7aec2f37-5dcd-4047-aae5-bae12f1db9a1 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.b26490b0-942c-4f9b-ac3d-a0a439320d80 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:31 devstack sudo[96960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7aec2f37-5dcd-4047-aae5-bae12f1db9a1 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.b26490b0-942c-4f9b-ac3d-a0a439320d80
Jul 14 16:30:31 devstack sudo[96960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:32 devstack sudo[96960]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-db507d01-c016-4451-83a2-be22fbe2c56a tempest-SnapshotsActionsTest-638814915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7aec2f37-5dcd-4047-aae5-bae12f1db9a1 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.b26490b0-942c-4f9b-ac3d-a0a439320d80" returned: 0 in 0.660s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:32 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-db507d01-c016-4451-83a2-be22fbe2c56a tempest-SnapshotsActionsTest-638814915 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.b26490b0-942c-4f9b-ac3d-a0a439320d80 is being set with open permissions: ugo+rw
Jul 14 16:30:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-db507d01-c016-4451-83a2-be22fbe2c56a tempest-SnapshotsActionsTest-638814915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.b26490b0-942c-4f9b-ac3d-a0a439320d80 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:32 devstack sudo[96984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.b26490b0-942c-4f9b-ac3d-a0a439320d80
Jul 14 16:30:32 devstack sudo[96984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:32 devstack sudo[96984]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-db507d01-c016-4451-83a2-be22fbe2c56a tempest-SnapshotsActionsTest-638814915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.b26490b0-942c-4f9b-ac3d-a0a439320d80" returned: 0 in 0.492s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-db507d01-c016-4451-83a2-be22fbe2c56a tempest-SnapshotsActionsTest-638814915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.342s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:30:32 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-db507d01-c016-4451-83a2-be22fbe2c56a tempest-SnapshotsActionsTest-638814915 None] Create snapshot completed successfully
Jul 14 16:30:33 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3cb19554-2145-4466-af5d-d10ce7a178d0 tempest-SnapshotsActionsTest-1459873502 None] Acquiring lock "cinder-b26490b0-942c-4f9b-ac3d-a0a439320d80-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:30:33 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3cb19554-2145-4466-af5d-d10ce7a178d0 tempest-SnapshotsActionsTest-1459873502 None] Lock "cinder-b26490b0-942c-4f9b-ac3d-a0a439320d80-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:30:33 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3cb19554-2145-4466-af5d-d10ce7a178d0 tempest-SnapshotsActionsTest-1459873502 None] Acquiring lock "cinder-quobyte-b1700751-5c94-4f7b-8047-d8888dcbdae8" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:30:33 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3cb19554-2145-4466-af5d-d10ce7a178d0 tempest-SnapshotsActionsTest-1459873502 None] Lock "cinder-quobyte-b1700751-5c94-4f7b-8047-d8888dcbdae8" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:30:33 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3cb19554-2145-4466-af5d-d10ce7a178d0 tempest-SnapshotsActionsTest-1459873502 None] Acquiring lock "cinder-quobyte-b26490b0-942c-4f9b-ac3d-a0a439320d80" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:30:33 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3cb19554-2145-4466-af5d-d10ce7a178d0 tempest-SnapshotsActionsTest-1459873502 None] Lock "cinder-quobyte-b26490b0-942c-4f9b-ac3d-a0a439320d80" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:30:33 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-3cb19554-2145-4466-af5d-d10ce7a178d0 tempest-SnapshotsActionsTest-1459873502 None] Deleting offline snapshot b26490b0-942c-4f9b-ac3d-a0a439320d80 of volume b1700751-5c94-4f7b-8047-d8888dcbdae8 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 16:30:33 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-3cb19554-2145-4466-af5d-d10ce7a178d0 tempest-SnapshotsActionsTest-1459873502 None] snapshot_file for this snap is: volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.b26490b0-942c-4f9b-ac3d-a0a439320d80 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 16:30:33 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ffb902-eac4-4316-9f40-7bee4816d533]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:30:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3cb19554-2145-4466-af5d-d10ce7a178d0 tempest-SnapshotsActionsTest-1459873502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.b26490b0-942c-4f9b-ac3d-a0a439320d80 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:34 devstack sudo[96994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.b26490b0-942c-4f9b-ac3d-a0a439320d80
Jul 14 16:30:34 devstack sudo[96994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:34 devstack sudo[96994]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3cb19554-2145-4466-af5d-d10ce7a178d0 tempest-SnapshotsActionsTest-1459873502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.b26490b0-942c-4f9b-ac3d-a0a439320d80" returned: 0 in 0.526s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:34 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-3cb19554-2145-4466-af5d-d10ce7a178d0 tempest-SnapshotsActionsTest-1459873502 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1700751-5c94-4f7b-8047-d8888dcbdae8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 16:30:34 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e6f4219-bdae-4a78-a7a8-2bea43e45fac]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:30:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3cb19554-2145-4466-af5d-d10ce7a178d0 tempest-SnapshotsActionsTest-1459873502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7aec2f37-5dcd-4047-aae5-bae12f1db9a1 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:34 devstack sudo[96999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7aec2f37-5dcd-4047-aae5-bae12f1db9a1
Jul 14 16:30:34 devstack sudo[96999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:34 devstack sudo[96999]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3cb19554-2145-4466-af5d-d10ce7a178d0 tempest-SnapshotsActionsTest-1459873502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7aec2f37-5dcd-4047-aae5-bae12f1db9a1" returned: 0 in 0.389s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:34 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-3cb19554-2145-4466-af5d-d10ce7a178d0 tempest-SnapshotsActionsTest-1459873502 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1700751-5c94-4f7b-8047-d8888dcbdae8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 16:30:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3cb19554-2145-4466-af5d-d10ce7a178d0 tempest-SnapshotsActionsTest-1459873502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.b26490b0-942c-4f9b-ac3d-a0a439320d80 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:34 devstack sudo[97004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.b26490b0-942c-4f9b-ac3d-a0a439320d80
Jul 14 16:30:34 devstack sudo[97004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:35 devstack sudo[97004]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3cb19554-2145-4466-af5d-d10ce7a178d0 tempest-SnapshotsActionsTest-1459873502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.b26490b0-942c-4f9b-ac3d-a0a439320d80" returned: 0 in 0.411s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3cb19554-2145-4466-af5d-d10ce7a178d0 tempest-SnapshotsActionsTest-1459873502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.b26490b0-942c-4f9b-ac3d-a0a439320d80 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:35 devstack sudo[97010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.b26490b0-942c-4f9b-ac3d-a0a439320d80
Jul 14 16:30:35 devstack sudo[97010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:35 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 16:30:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:30:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:30:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:30:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:30:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:30:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:35 devstack sudo[97012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:30:35 devstack sudo[97012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:35 devstack sudo[97010]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3cb19554-2145-4466-af5d-d10ce7a178d0 tempest-SnapshotsActionsTest-1459873502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.b26490b0-942c-4f9b-ac3d-a0a439320d80" returned: 0 in 0.296s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:35 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3cb19554-2145-4466-af5d-d10ce7a178d0 tempest-SnapshotsActionsTest-1459873502 None] Lock "cinder-quobyte-b26490b0-942c-4f9b-ac3d-a0a439320d80" released by "_delete_snapshot" :: held 1.772s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:30:35 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3cb19554-2145-4466-af5d-d10ce7a178d0 tempest-SnapshotsActionsTest-1459873502 None] Lock "cinder-quobyte-b1700751-5c94-4f7b-8047-d8888dcbdae8" released by "delete_snapshot" :: held 1.802s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:30:35 devstack sudo[97012]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.322s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:35 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:30:35 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Running periodic task VolumeManager._thread_info {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 16:30:35 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] thread count: 8 {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 14 16:30:35 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] thread info: [<_MainThread(MainThread, started 128606490927232)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128606415432960)>, <Thread(Thread-3 (stat_writer), started daemon 128606378859328)>, <Thread(Rabbit-heartbeat, started daemon 128606379646144)>, <Thread(Thread-5 (_runner), started daemon 128606377685824)>, <Thread(Thread-7 (_runner), started daemon 128606377701888)>, <Thread(fd_logger, started daemon 128606377091392)>, <Thread(privsep_reader, started daemon 128606375782080)>] {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 14 16:30:35 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-3cb19554-2145-4466-af5d-d10ce7a178d0 tempest-SnapshotsActionsTest-1459873502 None] Created reservations ['35361e02-aa88-46c9-af43-fcc07da5c331', '7fdb229d-d634-4e57-a51f-9ee5287b55ed', '4342362c-a231-4aae-8417-0c1fa9a133cf', '7ac090a1-03bb-4161-9de3-c4cbfbfb8d8e'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:30:35 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-3cb19554-2145-4466-af5d-d10ce7a178d0 tempest-SnapshotsActionsTest-1459873502 None] Delete snapshot completed successfully.
Jul 14 16:30:35 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3cb19554-2145-4466-af5d-d10ce7a178d0 tempest-SnapshotsActionsTest-1459873502 None] Lock "cinder-b26490b0-942c-4f9b-ac3d-a0a439320d80-delete_snapshot" released by "delete_snapshot" :: held 1.968s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:30:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f8c74a6c-b3f9-4c11-91aa-1cbc28cc5561 tempest-SnapshotsActionsTest-638814915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:30:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f8c74a6c-b3f9-4c11-91aa-1cbc28cc5561 tempest-SnapshotsActionsTest-638814915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:30:36 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-f8c74a6c-b3f9-4c11-91aa-1cbc28cc5561 tempest-SnapshotsActionsTest-638814915 None] Creating offline snapshot 55aaebe1-dd72-4ac9-bb50-6e78742cab47 of volume b1700751-5c94-4f7b-8047-d8888dcbdae8 {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 16:30:36 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[31117a3e-dc4f-4bb5-8ba9-3f3730ecd1ac]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:30:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f8c74a6c-b3f9-4c11-91aa-1cbc28cc5561 tempest-SnapshotsActionsTest-638814915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7aec2f37-5dcd-4047-aae5-bae12f1db9a1 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:36 devstack sudo[97018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7aec2f37-5dcd-4047-aae5-bae12f1db9a1
Jul 14 16:30:36 devstack sudo[97018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:36 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e3f342bd-59b2-4f00-8017-d1425a83d089 tempest-AttachVolumeTestJSON-1037344391 None] Acquiring lock "cinder-83777ef7-d2fe-44bb-9fb0-0bd67f1160dc-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:30:36 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e3f342bd-59b2-4f00-8017-d1425a83d089 tempest-AttachVolumeTestJSON-1037344391 None] Lock "cinder-83777ef7-d2fe-44bb-9fb0-0bd67f1160dc-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:30:36 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e3f342bd-59b2-4f00-8017-d1425a83d089 tempest-AttachVolumeTestJSON-1037344391 None] Acquiring lock "cinder-quobyte-83777ef7-d2fe-44bb-9fb0-0bd67f1160dc" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:30:36 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e3f342bd-59b2-4f00-8017-d1425a83d089 tempest-AttachVolumeTestJSON-1037344391 None] Lock "cinder-quobyte-83777ef7-d2fe-44bb-9fb0-0bd67f1160dc" acquired by "delete_volume" :: waited 0.018s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:30:36 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fedad40-21ed-4fdd-bfbc-ab438f45f420]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:30:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e3f342bd-59b2-4f00-8017-d1425a83d089 tempest-AttachVolumeTestJSON-1037344391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-83777ef7-d2fe-44bb-9fb0-0bd67f1160dc {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:36 devstack sudo[97018]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f8c74a6c-b3f9-4c11-91aa-1cbc28cc5561 tempest-SnapshotsActionsTest-638814915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7aec2f37-5dcd-4047-aae5-bae12f1db9a1" returned: 0 in 0.513s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:36 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-f8c74a6c-b3f9-4c11-91aa-1cbc28cc5561 tempest-SnapshotsActionsTest-638814915 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1700751-5c94-4f7b-8047-d8888dcbdae8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 16:30:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f8c74a6c-b3f9-4c11-91aa-1cbc28cc5561 tempest-SnapshotsActionsTest-638814915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7aec2f37-5dcd-4047-aae5-bae12f1db9a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.55aaebe1-dd72-4ac9-bb50-6e78742cab47 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:36 devstack sudo[97022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-83777ef7-d2fe-44bb-9fb0-0bd67f1160dc
Jul 14 16:30:36 devstack sudo[97022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:36 devstack sudo[97024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7aec2f37-5dcd-4047-aae5-bae12f1db9a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.55aaebe1-dd72-4ac9-bb50-6e78742cab47 1G
Jul 14 16:30:36 devstack sudo[97024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:37 devstack sudo[97022]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e3f342bd-59b2-4f00-8017-d1425a83d089 tempest-AttachVolumeTestJSON-1037344391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-83777ef7-d2fe-44bb-9fb0-0bd67f1160dc" returned: 0 in 0.388s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e3f342bd-59b2-4f00-8017-d1425a83d089 tempest-AttachVolumeTestJSON-1037344391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-83777ef7-d2fe-44bb-9fb0-0bd67f1160dc {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:37 devstack sudo[97034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-83777ef7-d2fe-44bb-9fb0-0bd67f1160dc
Jul 14 16:30:37 devstack sudo[97034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:37 devstack sudo[97024]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f8c74a6c-b3f9-4c11-91aa-1cbc28cc5561 tempest-SnapshotsActionsTest-638814915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7aec2f37-5dcd-4047-aae5-bae12f1db9a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.55aaebe1-dd72-4ac9-bb50-6e78742cab47 1G" returned: 0 in 0.472s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f8c74a6c-b3f9-4c11-91aa-1cbc28cc5561 tempest-SnapshotsActionsTest-638814915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7aec2f37-5dcd-4047-aae5-bae12f1db9a1 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.55aaebe1-dd72-4ac9-bb50-6e78742cab47 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:37 devstack sudo[97036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7aec2f37-5dcd-4047-aae5-bae12f1db9a1 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.55aaebe1-dd72-4ac9-bb50-6e78742cab47
Jul 14 16:30:37 devstack sudo[97036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:37 devstack sudo[97034]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e3f342bd-59b2-4f00-8017-d1425a83d089 tempest-AttachVolumeTestJSON-1037344391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-83777ef7-d2fe-44bb-9fb0-0bd67f1160dc" returned: 0 in 0.277s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:37 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e3f342bd-59b2-4f00-8017-d1425a83d089 tempest-AttachVolumeTestJSON-1037344391 None] Lock "cinder-quobyte-83777ef7-d2fe-44bb-9fb0-0bd67f1160dc" released by "delete_volume" :: held 0.705s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:30:37 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:UPDATE=112,cinder:SELECT=117,cinder:INSERT=26,cinder:DELETE=7 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 16:30:37 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:UPDATE=108,cinder:SELECT=107,cinder:INSERT=24,cinder:DELETE=8 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 16:30:37 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-e3f342bd-59b2-4f00-8017-d1425a83d089 tempest-AttachVolumeTestJSON-1037344391 None] Created reservations ['ceb2ce85-62f2-487c-a0d3-f9d6f9141be6', 'd105a3da-06af-4c6b-abbb-2f681f2c2701', '05a9fdc4-4d6e-49e6-8ac2-c91bcfd170dd', 'f249d484-d2f3-4e8b-8709-8c938779d621'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:30:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e3f342bd-59b2-4f00-8017-d1425a83d089 tempest-AttachVolumeTestJSON-1037344391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:30:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e3f342bd-59b2-4f00-8017-d1425a83d089 tempest-AttachVolumeTestJSON-1037344391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:30:37 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-e3f342bd-59b2-4f00-8017-d1425a83d089 tempest-AttachVolumeTestJSON-1037344391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:30:37 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-e3f342bd-59b2-4f00-8017-d1425a83d089 tempest-AttachVolumeTestJSON-1037344391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:30:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e3f342bd-59b2-4f00-8017-d1425a83d089 tempest-AttachVolumeTestJSON-1037344391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:30:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e3f342bd-59b2-4f00-8017-d1425a83d089 tempest-AttachVolumeTestJSON-1037344391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:37 devstack sudo[97041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:30:37 devstack sudo[97041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:37 devstack sudo[97036]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f8c74a6c-b3f9-4c11-91aa-1cbc28cc5561 tempest-SnapshotsActionsTest-638814915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7aec2f37-5dcd-4047-aae5-bae12f1db9a1 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.55aaebe1-dd72-4ac9-bb50-6e78742cab47" returned: 0 in 0.383s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:37 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-f8c74a6c-b3f9-4c11-91aa-1cbc28cc5561 tempest-SnapshotsActionsTest-638814915 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.55aaebe1-dd72-4ac9-bb50-6e78742cab47 is being set with open permissions: ugo+rw
Jul 14 16:30:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f8c74a6c-b3f9-4c11-91aa-1cbc28cc5561 tempest-SnapshotsActionsTest-638814915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.55aaebe1-dd72-4ac9-bb50-6e78742cab47 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:37 devstack sudo[97044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.55aaebe1-dd72-4ac9-bb50-6e78742cab47
Jul 14 16:30:37 devstack sudo[97044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:37 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-27a16fde-8ca1-4502-a501-0edee33a91be tempest-AttachVolumeTestJSON-1037344391 None] Acquiring lock "cinder-32e992a8-c129-4231-b746-e06c7ddb8e43-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:30:37 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-27a16fde-8ca1-4502-a501-0edee33a91be tempest-AttachVolumeTestJSON-1037344391 None] Lock "cinder-32e992a8-c129-4231-b746-e06c7ddb8e43-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:30:37 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-27a16fde-8ca1-4502-a501-0edee33a91be tempest-AttachVolumeTestJSON-1037344391 None] Acquiring lock "cinder-quobyte-32e992a8-c129-4231-b746-e06c7ddb8e43" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:30:37 devstack sudo[97041]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e3f342bd-59b2-4f00-8017-d1425a83d089 tempest-AttachVolumeTestJSON-1037344391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.298s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:37 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-e3f342bd-59b2-4f00-8017-d1425a83d089 tempest-AttachVolumeTestJSON-1037344391 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:30:37 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-e3f342bd-59b2-4f00-8017-d1425a83d089 tempest-AttachVolumeTestJSON-1037344391 None] Deleted volume successfully.
Jul 14 16:30:37 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-27a16fde-8ca1-4502-a501-0edee33a91be tempest-AttachVolumeTestJSON-1037344391 None] Lock "cinder-quobyte-32e992a8-c129-4231-b746-e06c7ddb8e43" acquired by "delete_volume" :: waited 0.026s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:30:38 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e3f342bd-59b2-4f00-8017-d1425a83d089 tempest-AttachVolumeTestJSON-1037344391 None] Lock "cinder-83777ef7-d2fe-44bb-9fb0-0bd67f1160dc-delete_volume" released by "delete_volume" :: held 1.313s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:30:38 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0cb13f7-1535-49fd-9d2e-a1a6ea82c8b8]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:30:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-27a16fde-8ca1-4502-a501-0edee33a91be tempest-AttachVolumeTestJSON-1037344391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-32e992a8-c129-4231-b746-e06c7ddb8e43 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:38 devstack sudo[97044]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f8c74a6c-b3f9-4c11-91aa-1cbc28cc5561 tempest-SnapshotsActionsTest-638814915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.55aaebe1-dd72-4ac9-bb50-6e78742cab47" returned: 0 in 0.327s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f8c74a6c-b3f9-4c11-91aa-1cbc28cc5561 tempest-SnapshotsActionsTest-638814915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.820s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:30:38 devstack sudo[97047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-32e992a8-c129-4231-b746-e06c7ddb8e43
Jul 14 16:30:38 devstack sudo[97047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:38 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-f8c74a6c-b3f9-4c11-91aa-1cbc28cc5561 tempest-SnapshotsActionsTest-638814915 None] Create snapshot completed successfully
Jul 14 16:30:38 devstack sudo[97047]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-27a16fde-8ca1-4502-a501-0edee33a91be tempest-AttachVolumeTestJSON-1037344391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-32e992a8-c129-4231-b746-e06c7ddb8e43" returned: 0 in 0.407s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-27a16fde-8ca1-4502-a501-0edee33a91be tempest-AttachVolumeTestJSON-1037344391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-32e992a8-c129-4231-b746-e06c7ddb8e43 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:38 devstack sudo[97053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-32e992a8-c129-4231-b746-e06c7ddb8e43
Jul 14 16:30:38 devstack sudo[97053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:38 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3012fffa-5291-413e-8a01-ccbcbfff9bc9 tempest-SnapshotsActionsTest-1459873502 None] Acquiring lock "cinder-55aaebe1-dd72-4ac9-bb50-6e78742cab47-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:30:38 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3012fffa-5291-413e-8a01-ccbcbfff9bc9 tempest-SnapshotsActionsTest-1459873502 None] Lock "cinder-55aaebe1-dd72-4ac9-bb50-6e78742cab47-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:30:38 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3012fffa-5291-413e-8a01-ccbcbfff9bc9 tempest-SnapshotsActionsTest-1459873502 None] Acquiring lock "cinder-quobyte-b1700751-5c94-4f7b-8047-d8888dcbdae8" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:30:38 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3012fffa-5291-413e-8a01-ccbcbfff9bc9 tempest-SnapshotsActionsTest-1459873502 None] Lock "cinder-quobyte-b1700751-5c94-4f7b-8047-d8888dcbdae8" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:30:38 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3012fffa-5291-413e-8a01-ccbcbfff9bc9 tempest-SnapshotsActionsTest-1459873502 None] Acquiring lock "cinder-quobyte-55aaebe1-dd72-4ac9-bb50-6e78742cab47" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:30:38 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3012fffa-5291-413e-8a01-ccbcbfff9bc9 tempest-SnapshotsActionsTest-1459873502 None] Lock "cinder-quobyte-55aaebe1-dd72-4ac9-bb50-6e78742cab47" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:30:38 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-3012fffa-5291-413e-8a01-ccbcbfff9bc9 tempest-SnapshotsActionsTest-1459873502 None] Deleting offline snapshot 55aaebe1-dd72-4ac9-bb50-6e78742cab47 of volume b1700751-5c94-4f7b-8047-d8888dcbdae8 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 16:30:38 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-3012fffa-5291-413e-8a01-ccbcbfff9bc9 tempest-SnapshotsActionsTest-1459873502 None] snapshot_file for this snap is: volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.55aaebe1-dd72-4ac9-bb50-6e78742cab47 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 16:30:38 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f933b12-1b8c-47f6-957a-c85e4a2c43d4]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:30:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3012fffa-5291-413e-8a01-ccbcbfff9bc9 tempest-SnapshotsActionsTest-1459873502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.55aaebe1-dd72-4ac9-bb50-6e78742cab47 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:38 devstack sudo[97053]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-27a16fde-8ca1-4502-a501-0edee33a91be tempest-AttachVolumeTestJSON-1037344391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-32e992a8-c129-4231-b746-e06c7ddb8e43" returned: 0 in 0.289s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:38 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-27a16fde-8ca1-4502-a501-0edee33a91be tempest-AttachVolumeTestJSON-1037344391 None] Lock "cinder-quobyte-32e992a8-c129-4231-b746-e06c7ddb8e43" released by "delete_volume" :: held 0.759s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:30:38 devstack sudo[97056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.55aaebe1-dd72-4ac9-bb50-6e78742cab47
Jul 14 16:30:38 devstack sudo[97056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:38 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-27a16fde-8ca1-4502-a501-0edee33a91be tempest-AttachVolumeTestJSON-1037344391 None] Created reservations ['7ed5f276-cd03-4a25-9526-8a72feed5b8e', '1218c0f5-2a52-4cd5-b069-59c94e34c801', 'b10a0dc3-c299-4267-b019-422e432cf9c0', '8fb56373-69b0-4f70-aaf8-5a38a3db564a'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:30:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-27a16fde-8ca1-4502-a501-0edee33a91be tempest-AttachVolumeTestJSON-1037344391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:30:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-27a16fde-8ca1-4502-a501-0edee33a91be tempest-AttachVolumeTestJSON-1037344391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:30:38 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-27a16fde-8ca1-4502-a501-0edee33a91be tempest-AttachVolumeTestJSON-1037344391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:30:38 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-27a16fde-8ca1-4502-a501-0edee33a91be tempest-AttachVolumeTestJSON-1037344391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:30:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-27a16fde-8ca1-4502-a501-0edee33a91be tempest-AttachVolumeTestJSON-1037344391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:30:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-27a16fde-8ca1-4502-a501-0edee33a91be tempest-AttachVolumeTestJSON-1037344391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:38 devstack sudo[97058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:30:38 devstack sudo[97058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:39 devstack sudo[97056]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3012fffa-5291-413e-8a01-ccbcbfff9bc9 tempest-SnapshotsActionsTest-1459873502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.55aaebe1-dd72-4ac9-bb50-6e78742cab47" returned: 0 in 0.454s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:39 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-3012fffa-5291-413e-8a01-ccbcbfff9bc9 tempest-SnapshotsActionsTest-1459873502 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1700751-5c94-4f7b-8047-d8888dcbdae8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 16:30:39 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-95c90203-7570-44ea-92fa-0fd899740de3 tempest-AttachVolumeTestJSON-1037344391 None] Acquiring lock "cinder-88a61666-6013-4c47-abae-f04015c3c760-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:30:39 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-95c90203-7570-44ea-92fa-0fd899740de3 tempest-AttachVolumeTestJSON-1037344391 None] Lock "cinder-88a61666-6013-4c47-abae-f04015c3c760-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:30:39 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19b79f7-93e1-46aa-b77c-18d254f2e49a]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:30:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3012fffa-5291-413e-8a01-ccbcbfff9bc9 tempest-SnapshotsActionsTest-1459873502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7aec2f37-5dcd-4047-aae5-bae12f1db9a1 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:39 devstack sudo[97058]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-27a16fde-8ca1-4502-a501-0edee33a91be tempest-AttachVolumeTestJSON-1037344391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.334s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:39 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-27a16fde-8ca1-4502-a501-0edee33a91be tempest-AttachVolumeTestJSON-1037344391 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:30:39 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-27a16fde-8ca1-4502-a501-0edee33a91be tempest-AttachVolumeTestJSON-1037344391 None] Deleted volume successfully.
Jul 14 16:30:39 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-27a16fde-8ca1-4502-a501-0edee33a91be tempest-AttachVolumeTestJSON-1037344391 None] Lock "cinder-32e992a8-c129-4231-b746-e06c7ddb8e43-delete_volume" released by "delete_volume" :: held 1.344s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:30:39 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-95c90203-7570-44ea-92fa-0fd899740de3 tempest-AttachVolumeTestJSON-1037344391 None] Acquiring lock "cinder-quobyte-88a61666-6013-4c47-abae-f04015c3c760" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:30:39 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-95c90203-7570-44ea-92fa-0fd899740de3 tempest-AttachVolumeTestJSON-1037344391 None] Lock "cinder-quobyte-88a61666-6013-4c47-abae-f04015c3c760" acquired by "delete_volume" :: waited 0.014s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:30:39 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[8546e87c-4d57-451a-bac2-1fe99589412c]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:30:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-95c90203-7570-44ea-92fa-0fd899740de3 tempest-AttachVolumeTestJSON-1037344391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-88a61666-6013-4c47-abae-f04015c3c760 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:39 devstack sudo[97066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7aec2f37-5dcd-4047-aae5-bae12f1db9a1
Jul 14 16:30:39 devstack sudo[97066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:39 devstack sudo[97067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-88a61666-6013-4c47-abae-f04015c3c760
Jul 14 16:30:39 devstack sudo[97067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:39 devstack sudo[97066]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3012fffa-5291-413e-8a01-ccbcbfff9bc9 tempest-SnapshotsActionsTest-1459873502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7aec2f37-5dcd-4047-aae5-bae12f1db9a1" returned: 0 in 0.438s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:39 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-3012fffa-5291-413e-8a01-ccbcbfff9bc9 tempest-SnapshotsActionsTest-1459873502 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1700751-5c94-4f7b-8047-d8888dcbdae8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 16:30:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3012fffa-5291-413e-8a01-ccbcbfff9bc9 tempest-SnapshotsActionsTest-1459873502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.55aaebe1-dd72-4ac9-bb50-6e78742cab47 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:39 devstack sudo[97074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.55aaebe1-dd72-4ac9-bb50-6e78742cab47
Jul 14 16:30:39 devstack sudo[97074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:39 devstack sudo[97067]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-95c90203-7570-44ea-92fa-0fd899740de3 tempest-AttachVolumeTestJSON-1037344391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-88a61666-6013-4c47-abae-f04015c3c760" returned: 0 in 0.462s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-95c90203-7570-44ea-92fa-0fd899740de3 tempest-AttachVolumeTestJSON-1037344391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-88a61666-6013-4c47-abae-f04015c3c760 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:39 devstack sudo[97079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-88a61666-6013-4c47-abae-f04015c3c760
Jul 14 16:30:39 devstack sudo[97079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:40 devstack sudo[97079]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-95c90203-7570-44ea-92fa-0fd899740de3 tempest-AttachVolumeTestJSON-1037344391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-88a61666-6013-4c47-abae-f04015c3c760" returned: 0 in 0.264s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:40 devstack sudo[97074]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:40 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-95c90203-7570-44ea-92fa-0fd899740de3 tempest-AttachVolumeTestJSON-1037344391 None] Lock "cinder-quobyte-88a61666-6013-4c47-abae-f04015c3c760" released by "delete_volume" :: held 0.777s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:30:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3012fffa-5291-413e-8a01-ccbcbfff9bc9 tempest-SnapshotsActionsTest-1459873502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.55aaebe1-dd72-4ac9-bb50-6e78742cab47" returned: 0 in 0.422s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3012fffa-5291-413e-8a01-ccbcbfff9bc9 tempest-SnapshotsActionsTest-1459873502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.55aaebe1-dd72-4ac9-bb50-6e78742cab47 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:40 devstack sudo[97085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.55aaebe1-dd72-4ac9-bb50-6e78742cab47
Jul 14 16:30:40 devstack sudo[97085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:40 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-95c90203-7570-44ea-92fa-0fd899740de3 tempest-AttachVolumeTestJSON-1037344391 None] Created reservations ['c2a0e04e-6a58-49be-8dca-7cd7b30af70f', '5a6dd4ff-b1de-49ff-bd26-32ca771cdb5e', '79b6881b-8baf-4679-a5a8-94835a791496', '7b8cb728-9116-4a6c-b65a-f45fe5b32b39'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:30:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-95c90203-7570-44ea-92fa-0fd899740de3 tempest-AttachVolumeTestJSON-1037344391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:30:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-95c90203-7570-44ea-92fa-0fd899740de3 tempest-AttachVolumeTestJSON-1037344391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:30:40 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-95c90203-7570-44ea-92fa-0fd899740de3 tempest-AttachVolumeTestJSON-1037344391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:30:40 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-95c90203-7570-44ea-92fa-0fd899740de3 tempest-AttachVolumeTestJSON-1037344391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:30:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-95c90203-7570-44ea-92fa-0fd899740de3 tempest-AttachVolumeTestJSON-1037344391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:30:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-95c90203-7570-44ea-92fa-0fd899740de3 tempest-AttachVolumeTestJSON-1037344391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:40 devstack sudo[97087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:30:40 devstack sudo[97087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:40 devstack sudo[97085]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3012fffa-5291-413e-8a01-ccbcbfff9bc9 tempest-SnapshotsActionsTest-1459873502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.55aaebe1-dd72-4ac9-bb50-6e78742cab47" returned: 0 in 0.308s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:40 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3012fffa-5291-413e-8a01-ccbcbfff9bc9 tempest-SnapshotsActionsTest-1459873502 None] Lock "cinder-quobyte-55aaebe1-dd72-4ac9-bb50-6e78742cab47" released by "_delete_snapshot" :: held 1.769s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:30:40 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3012fffa-5291-413e-8a01-ccbcbfff9bc9 tempest-SnapshotsActionsTest-1459873502 None] Lock "cinder-quobyte-b1700751-5c94-4f7b-8047-d8888dcbdae8" released by "delete_snapshot" :: held 1.809s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:30:40 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-3012fffa-5291-413e-8a01-ccbcbfff9bc9 tempest-SnapshotsActionsTest-1459873502 None] Created reservations ['1dbb2a23-3955-4f15-b294-da162d68867d', '583c477c-ca1c-4bcf-a8ce-c024238db880', 'aa8f6846-9533-4ab4-858b-637e0eee87af', '3f954722-0677-47e5-b8be-ba97c41d59cc'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:30:40 devstack sudo[97087]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-95c90203-7570-44ea-92fa-0fd899740de3 tempest-AttachVolumeTestJSON-1037344391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.289s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:40 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-95c90203-7570-44ea-92fa-0fd899740de3 tempest-AttachVolumeTestJSON-1037344391 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:30:40 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-95c90203-7570-44ea-92fa-0fd899740de3 tempest-AttachVolumeTestJSON-1037344391 None] Deleted volume successfully.
Jul 14 16:30:40 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-95c90203-7570-44ea-92fa-0fd899740de3 tempest-AttachVolumeTestJSON-1037344391 None] Lock "cinder-88a61666-6013-4c47-abae-f04015c3c760-delete_volume" released by "delete_volume" :: held 1.371s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:30:40 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-3012fffa-5291-413e-8a01-ccbcbfff9bc9 tempest-SnapshotsActionsTest-1459873502 None] Delete snapshot completed successfully.
Jul 14 16:30:40 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3012fffa-5291-413e-8a01-ccbcbfff9bc9 tempest-SnapshotsActionsTest-1459873502 None] Lock "cinder-55aaebe1-dd72-4ac9-bb50-6e78742cab47-delete_snapshot" released by "delete_snapshot" :: held 2.000s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:30:41 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-77bfa95f-732e-45f9-8ddb-7b7e94d610c0 tempest-SnapshotsActionsTest-638814915 None] Acquiring lock "cinder-7aec2f37-5dcd-4047-aae5-bae12f1db9a1-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:30:41 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-77bfa95f-732e-45f9-8ddb-7b7e94d610c0 tempest-SnapshotsActionsTest-638814915 None] Lock "cinder-7aec2f37-5dcd-4047-aae5-bae12f1db9a1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:30:41 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-77bfa95f-732e-45f9-8ddb-7b7e94d610c0 tempest-SnapshotsActionsTest-638814915 None] Acquiring lock "cinder-quobyte-b1700751-5c94-4f7b-8047-d8888dcbdae8" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:30:41 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-77bfa95f-732e-45f9-8ddb-7b7e94d610c0 tempest-SnapshotsActionsTest-638814915 None] Lock "cinder-quobyte-b1700751-5c94-4f7b-8047-d8888dcbdae8" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:30:41 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-77bfa95f-732e-45f9-8ddb-7b7e94d610c0 tempest-SnapshotsActionsTest-638814915 None] Acquiring lock "cinder-quobyte-7aec2f37-5dcd-4047-aae5-bae12f1db9a1" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:30:41 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-77bfa95f-732e-45f9-8ddb-7b7e94d610c0 tempest-SnapshotsActionsTest-638814915 None] Lock "cinder-quobyte-7aec2f37-5dcd-4047-aae5-bae12f1db9a1" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:30:41 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-77bfa95f-732e-45f9-8ddb-7b7e94d610c0 tempest-SnapshotsActionsTest-638814915 None] Deleting offline snapshot 7aec2f37-5dcd-4047-aae5-bae12f1db9a1 of volume b1700751-5c94-4f7b-8047-d8888dcbdae8 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 16:30:41 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-77bfa95f-732e-45f9-8ddb-7b7e94d610c0 tempest-SnapshotsActionsTest-638814915 None] snapshot_file for this snap is: volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7aec2f37-5dcd-4047-aae5-bae12f1db9a1 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 16:30:41 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf705b60-a7e7-4eb1-93e5-54301f09b63f]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:30:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-77bfa95f-732e-45f9-8ddb-7b7e94d610c0 tempest-SnapshotsActionsTest-638814915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7aec2f37-5dcd-4047-aae5-bae12f1db9a1 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:41 devstack sudo[97091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7aec2f37-5dcd-4047-aae5-bae12f1db9a1
Jul 14 16:30:41 devstack sudo[97091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:41 devstack sudo[97091]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-77bfa95f-732e-45f9-8ddb-7b7e94d610c0 tempest-SnapshotsActionsTest-638814915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7aec2f37-5dcd-4047-aae5-bae12f1db9a1" returned: 0 in 0.503s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:41 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-77bfa95f-732e-45f9-8ddb-7b7e94d610c0 tempest-SnapshotsActionsTest-638814915 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1700751-5c94-4f7b-8047-d8888dcbdae8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 16:30:41 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e43e1a-ca82-4bc9-9b3f-31693e07db20]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:30:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-77bfa95f-732e-45f9-8ddb-7b7e94d610c0 tempest-SnapshotsActionsTest-638814915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:42 devstack sudo[97096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8
Jul 14 16:30:42 devstack sudo[97096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:42 devstack sudo[97096]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-77bfa95f-732e-45f9-8ddb-7b7e94d610c0 tempest-SnapshotsActionsTest-638814915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8" returned: 0 in 0.564s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-77bfa95f-732e-45f9-8ddb-7b7e94d610c0 tempest-SnapshotsActionsTest-638814915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7aec2f37-5dcd-4047-aae5-bae12f1db9a1 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:42 devstack sudo[97102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7aec2f37-5dcd-4047-aae5-bae12f1db9a1
Jul 14 16:30:42 devstack sudo[97102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:43 devstack sudo[97102]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-77bfa95f-732e-45f9-8ddb-7b7e94d610c0 tempest-SnapshotsActionsTest-638814915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7aec2f37-5dcd-4047-aae5-bae12f1db9a1" returned: 0 in 0.548s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-77bfa95f-732e-45f9-8ddb-7b7e94d610c0 tempest-SnapshotsActionsTest-638814915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7aec2f37-5dcd-4047-aae5-bae12f1db9a1 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:43 devstack sudo[97110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7aec2f37-5dcd-4047-aae5-bae12f1db9a1
Jul 14 16:30:43 devstack sudo[97110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:43 devstack sudo[97110]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-77bfa95f-732e-45f9-8ddb-7b7e94d610c0 tempest-SnapshotsActionsTest-638814915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8.7aec2f37-5dcd-4047-aae5-bae12f1db9a1" returned: 0 in 0.289s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:43 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-77bfa95f-732e-45f9-8ddb-7b7e94d610c0 tempest-SnapshotsActionsTest-638814915 None] Lock "cinder-quobyte-7aec2f37-5dcd-4047-aae5-bae12f1db9a1" released by "_delete_snapshot" :: held 2.177s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:30:43 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-77bfa95f-732e-45f9-8ddb-7b7e94d610c0 tempest-SnapshotsActionsTest-638814915 None] Lock "cinder-quobyte-b1700751-5c94-4f7b-8047-d8888dcbdae8" released by "delete_snapshot" :: held 2.206s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:30:43 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-77bfa95f-732e-45f9-8ddb-7b7e94d610c0 tempest-SnapshotsActionsTest-638814915 None] Created reservations ['00a11ecd-72d2-43f2-99b8-a54c5bbf3657', '1ef096d1-8661-4878-bd6e-6bef4899292c', 'eff92165-0ea8-4f0d-aeba-0e3f7b1f8edb', '5434a060-db35-40c3-bf56-7f338dc27990'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:30:43 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-77bfa95f-732e-45f9-8ddb-7b7e94d610c0 tempest-SnapshotsActionsTest-638814915 None] Delete snapshot completed successfully.
Jul 14 16:30:43 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-77bfa95f-732e-45f9-8ddb-7b7e94d610c0 tempest-SnapshotsActionsTest-638814915 None] Lock "cinder-7aec2f37-5dcd-4047-aae5-bae12f1db9a1-delete_snapshot" released by "delete_snapshot" :: held 2.407s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:30:44 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-9ab1b888-7f16-44ac-a1d5-e8b40f9ca878 tempest-GroupsTest-1352684624 None] Group tempest-Group1-1246862273: creating
Jul 14 16:30:44 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-9ab1b888-7f16-44ac-a1d5-e8b40f9ca878 tempest-GroupsTest-1352684624 None] Group tempest-Group1-1246862273: created successfully
Jul 14 16:30:44 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-9ab1b888-7f16-44ac-a1d5-e8b40f9ca878 tempest-GroupsTest-1352684624 None] Create group completed successfully.
Jul 14 16:30:44 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-74d1d713-801e-48e5-9dda-5fd8d25c10b4 tempest-SnapshotsActionsTest-638814915 None] Acquiring lock "cinder-b1700751-5c94-4f7b-8047-d8888dcbdae8-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:30:44 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-74d1d713-801e-48e5-9dda-5fd8d25c10b4 tempest-SnapshotsActionsTest-638814915 None] Lock "cinder-b1700751-5c94-4f7b-8047-d8888dcbdae8-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:30:44 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-74d1d713-801e-48e5-9dda-5fd8d25c10b4 tempest-SnapshotsActionsTest-638814915 None] Acquiring lock "cinder-quobyte-b1700751-5c94-4f7b-8047-d8888dcbdae8" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:30:44 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-74d1d713-801e-48e5-9dda-5fd8d25c10b4 tempest-SnapshotsActionsTest-638814915 None] Lock "cinder-quobyte-b1700751-5c94-4f7b-8047-d8888dcbdae8" acquired by "delete_volume" :: waited 0.023s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:30:44 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e11e59-12b2-4f41-b343-59479293361b]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:30:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-74d1d713-801e-48e5-9dda-5fd8d25c10b4 tempest-SnapshotsActionsTest-638814915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:44 devstack sudo[97118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8
Jul 14 16:30:44 devstack sudo[97118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:45 devstack sudo[97118]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-74d1d713-801e-48e5-9dda-5fd8d25c10b4 tempest-SnapshotsActionsTest-638814915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8" returned: 0 in 0.501s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-74d1d713-801e-48e5-9dda-5fd8d25c10b4 tempest-SnapshotsActionsTest-638814915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:45 devstack sudo[97124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8
Jul 14 16:30:45 devstack sudo[97124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:45 devstack sudo[97124]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-74d1d713-801e-48e5-9dda-5fd8d25c10b4 tempest-SnapshotsActionsTest-638814915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1700751-5c94-4f7b-8047-d8888dcbdae8" returned: 0 in 0.304s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:45 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-74d1d713-801e-48e5-9dda-5fd8d25c10b4 tempest-SnapshotsActionsTest-638814915 None] Lock "cinder-quobyte-b1700751-5c94-4f7b-8047-d8888dcbdae8" released by "delete_volume" :: held 0.893s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:30:45 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-74d1d713-801e-48e5-9dda-5fd8d25c10b4 tempest-SnapshotsActionsTest-638814915 None] Created reservations ['7725f726-f167-4618-ab86-478fc8f55560', 'e2d4accb-1007-4dee-9713-3a2bdb01b68c', '648b49ce-75e0-4f05-8989-6443ede7cc4b', '16bcc0d2-b27f-4211-9e84-38766b24b2c8'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:30:45 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-18dd498d-b4ff-4aec-ab93-48af40f7461c tempest-GroupsTest-1352684624 None] Group tempest-Group2-1482098566: creating
Jul 14 16:30:45 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-18dd498d-b4ff-4aec-ab93-48af40f7461c tempest-GroupsTest-1352684624 None] Group tempest-Group2-1482098566: created successfully
Jul 14 16:30:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-74d1d713-801e-48e5-9dda-5fd8d25c10b4 tempest-SnapshotsActionsTest-638814915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:30:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-74d1d713-801e-48e5-9dda-5fd8d25c10b4 tempest-SnapshotsActionsTest-638814915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:30:45 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-74d1d713-801e-48e5-9dda-5fd8d25c10b4 tempest-SnapshotsActionsTest-638814915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:30:45 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-74d1d713-801e-48e5-9dda-5fd8d25c10b4 tempest-SnapshotsActionsTest-638814915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:30:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-74d1d713-801e-48e5-9dda-5fd8d25c10b4 tempest-SnapshotsActionsTest-638814915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:30:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-74d1d713-801e-48e5-9dda-5fd8d25c10b4 tempest-SnapshotsActionsTest-638814915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:45 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-18dd498d-b4ff-4aec-ab93-48af40f7461c tempest-GroupsTest-1352684624 None] Create group completed successfully.
Jul 14 16:30:45 devstack sudo[97128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:30:45 devstack sudo[97128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:46 devstack sudo[97128]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-74d1d713-801e-48e5-9dda-5fd8d25c10b4 tempest-SnapshotsActionsTest-638814915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.314s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:46 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-74d1d713-801e-48e5-9dda-5fd8d25c10b4 tempest-SnapshotsActionsTest-638814915 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:30:46 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-74d1d713-801e-48e5-9dda-5fd8d25c10b4 tempest-SnapshotsActionsTest-638814915 None] Deleted volume successfully.
Jul 14 16:30:46 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-74d1d713-801e-48e5-9dda-5fd8d25c10b4 tempest-SnapshotsActionsTest-638814915 None] Lock "cinder-b1700751-5c94-4f7b-8047-d8888dcbdae8-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:30:47 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc78253a-e04a-474c-a8f7-07e5e85b6f9a tempest-GroupsTest-1352684624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:30:47 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cc78253a-e04a-474c-a8f7-07e5e85b6f9a tempest-GroupsTest-1352684624 None] Flow 'volume_create_manager' (2b6d24d8-3a9a-4e22-8797-4dcf01a252e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:30:47 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cc78253a-e04a-474c-a8f7-07e5e85b6f9a tempest-GroupsTest-1352684624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (348367dc-f653-471d-be35-592a30470273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:30:47 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cc78253a-e04a-474c-a8f7-07e5e85b6f9a tempest-GroupsTest-1352684624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (348367dc-f653-471d-be35-592a30470273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:30:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1230753912',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=bba47faf-1839-4c29-9b54-a839b90f9f39,host='devstack@QuobyteHD#QuobyteHD',id=9c5abed3-c3d9-4ca4-9de1-9d5048d711f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04d3f58b152f41f1a7a79a03f3f09ebc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:30:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:30:48Z,use_quota=True,user_id='e67b22c439ad4acab61aa632936b5390',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85d2394d-a3a9-4efc-bb6a-908e8cfc9b5c),volume_type_id=85d2394d-a3a9-4efc-bb6a-908e8cfc9b5c)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:30:47 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cc78253a-e04a-474c-a8f7-07e5e85b6f9a tempest-GroupsTest-1352684624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25e8d168-0883-4f4c-9f81-ce5cb0672dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:30:47 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cc78253a-e04a-474c-a8f7-07e5e85b6f9a tempest-GroupsTest-1352684624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25e8d168-0883-4f4c-9f81-ce5cb0672dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:30:47 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cc78253a-e04a-474c-a8f7-07e5e85b6f9a tempest-GroupsTest-1352684624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94593a4b-7369-4419-8059-780584ebccea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:30:47 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cc78253a-e04a-474c-a8f7-07e5e85b6f9a tempest-GroupsTest-1352684624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94593a4b-7369-4419-8059-780584ebccea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c5abed3-c3d9-4ca4-9de1-9d5048d711f1', 'volume_name': 'volume-9c5abed3-c3d9-4ca4-9de1-9d5048d711f1', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:30:47 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cc78253a-e04a-474c-a8f7-07e5e85b6f9a tempest-GroupsTest-1352684624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f39f534-0da4-4ef7-b461-3133230c4b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:30:47 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cc78253a-e04a-474c-a8f7-07e5e85b6f9a tempest-GroupsTest-1352684624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f39f534-0da4-4ef7-b461-3133230c4b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:30:47 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cc78253a-e04a-474c-a8f7-07e5e85b6f9a tempest-GroupsTest-1352684624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1c08320-71b7-4554-816e-61e22dfd45e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:30:47 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-cc78253a-e04a-474c-a8f7-07e5e85b6f9a tempest-GroupsTest-1352684624 None] Volume 9c5abed3-c3d9-4ca4-9de1-9d5048d711f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c5abed3-c3d9-4ca4-9de1-9d5048d711f1', 'volume_size': 1}
Jul 14 16:30:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cc78253a-e04a-474c-a8f7-07e5e85b6f9a tempest-GroupsTest-1352684624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:30:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cc78253a-e04a-474c-a8f7-07e5e85b6f9a tempest-GroupsTest-1352684624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:30:47 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-cc78253a-e04a-474c-a8f7-07e5e85b6f9a tempest-GroupsTest-1352684624 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=bba47faf-1839-4c29-9b54-a839b90f9f39,created_at=2026-07-14T14:30:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1230753912',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=bba47faf-1839-4c29-9b54-a839b90f9f39,host='devstack@QuobyteHD#QuobyteHD',id=9c5abed3-c3d9-4ca4-9de1-9d5048d711f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04d3f58b152f41f1a7a79a03f3f09ebc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:30:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:30:48Z,use_quota=True,user_id='e67b22c439ad4acab61aa632936b5390',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85d2394d-a3a9-4efc-bb6a-908e8cfc9b5c),volume_type_id=85d2394d-a3a9-4efc-bb6a-908e8cfc9b5c)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:30:47 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-cc78253a-e04a-474c-a8f7-07e5e85b6f9a tempest-GroupsTest-1352684624 None] Creating volume 9c5abed3-c3d9-4ca4-9de1-9d5048d711f1 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:30:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cc78253a-e04a-474c-a8f7-07e5e85b6f9a tempest-GroupsTest-1352684624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:30:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cc78253a-e04a-474c-a8f7-07e5e85b6f9a tempest-GroupsTest-1352684624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:30:47 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-cc78253a-e04a-474c-a8f7-07e5e85b6f9a tempest-GroupsTest-1352684624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:30:47 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-cc78253a-e04a-474c-a8f7-07e5e85b6f9a tempest-GroupsTest-1352684624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:30:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cc78253a-e04a-474c-a8f7-07e5e85b6f9a tempest-GroupsTest-1352684624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:30:47 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-cc78253a-e04a-474c-a8f7-07e5e85b6f9a tempest-GroupsTest-1352684624 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:30:47 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-cc78253a-e04a-474c-a8f7-07e5e85b6f9a tempest-GroupsTest-1352684624 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:30:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cc78253a-e04a-474c-a8f7-07e5e85b6f9a tempest-GroupsTest-1352684624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9c5abed3-c3d9-4ca4-9de1-9d5048d711f1 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:47 devstack sudo[97136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9c5abed3-c3d9-4ca4-9de1-9d5048d711f1 1073741824
Jul 14 16:30:47 devstack sudo[97136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:47 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-1a6b51a0-fb1b-4185-82c1-938a58346b49 req-ab08f725-f5fb-4146-9ac1-5348284680c1 tempest-TestMinimumBasicScenario-258503962 None] Terminate volume connection completed successfully.
Jul 14 16:30:47 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-1a6b51a0-fb1b-4185-82c1-938a58346b49 req-ab08f725-f5fb-4146-9ac1-5348284680c1 tempest-TestMinimumBasicScenario-258503962 None] Deleting attachment 3adb3d5b-a1bd-494f-b293-543854ad65f4. {{(pid=87166) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 14 16:30:48 devstack sudo[97136]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cc78253a-e04a-474c-a8f7-07e5e85b6f9a tempest-GroupsTest-1352684624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9c5abed3-c3d9-4ca4-9de1-9d5048d711f1 1073741824" returned: 0 in 0.705s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cc78253a-e04a-474c-a8f7-07e5e85b6f9a tempest-GroupsTest-1352684624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9c5abed3-c3d9-4ca4-9de1-9d5048d711f1 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:48 devstack sudo[97142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9c5abed3-c3d9-4ca4-9de1-9d5048d711f1
Jul 14 16:30:48 devstack sudo[97142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:48 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3b9b495e-ab6e-4d13-b441-0fa0e796fbb0 tempest-TestMinimumBasicScenario-258503962 None] Acquiring lock "cinder-cb39fd60-df8a-43cf-95f3-d862952cfc02-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:30:48 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3b9b495e-ab6e-4d13-b441-0fa0e796fbb0 tempest-TestMinimumBasicScenario-258503962 None] Lock "cinder-cb39fd60-df8a-43cf-95f3-d862952cfc02-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:30:48 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3b9b495e-ab6e-4d13-b441-0fa0e796fbb0 tempest-TestMinimumBasicScenario-258503962 None] Acquiring lock "cinder-quobyte-cb39fd60-df8a-43cf-95f3-d862952cfc02" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:30:49 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3b9b495e-ab6e-4d13-b441-0fa0e796fbb0 tempest-TestMinimumBasicScenario-258503962 None] Lock "cinder-quobyte-cb39fd60-df8a-43cf-95f3-d862952cfc02" acquired by "delete_volume" :: waited 0.016s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:30:49 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e5b4f2-e52a-4444-80d8-eaa64f5bd8be]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:30:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3b9b495e-ab6e-4d13-b441-0fa0e796fbb0 tempest-TestMinimumBasicScenario-258503962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cb39fd60-df8a-43cf-95f3-d862952cfc02 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:49 devstack sudo[97142]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cc78253a-e04a-474c-a8f7-07e5e85b6f9a tempest-GroupsTest-1352684624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9c5abed3-c3d9-4ca4-9de1-9d5048d711f1" returned: 0 in 0.524s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:49 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-cc78253a-e04a-474c-a8f7-07e5e85b6f9a tempest-GroupsTest-1352684624 None] <== create_volume: return (1311ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:30:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cc78253a-e04a-474c-a8f7-07e5e85b6f9a tempest-GroupsTest-1352684624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.315s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:30:49 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cc78253a-e04a-474c-a8f7-07e5e85b6f9a tempest-GroupsTest-1352684624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1c08320-71b7-4554-816e-61e22dfd45e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c5abed3-c3d9-4ca4-9de1-9d5048d711f1', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:30:49 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cc78253a-e04a-474c-a8f7-07e5e85b6f9a tempest-GroupsTest-1352684624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97fab6d5-d003-4c1f-87ac-1cbac4af4a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:30:49 devstack sudo[97145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cb39fd60-df8a-43cf-95f3-d862952cfc02
Jul 14 16:30:49 devstack sudo[97145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:49 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-cc78253a-e04a-474c-a8f7-07e5e85b6f9a tempest-GroupsTest-1352684624 None] Volume volume-9c5abed3-c3d9-4ca4-9de1-9d5048d711f1 (9c5abed3-c3d9-4ca4-9de1-9d5048d711f1): created successfully
Jul 14 16:30:49 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cc78253a-e04a-474c-a8f7-07e5e85b6f9a tempest-GroupsTest-1352684624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97fab6d5-d003-4c1f-87ac-1cbac4af4a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:30:49 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cc78253a-e04a-474c-a8f7-07e5e85b6f9a tempest-GroupsTest-1352684624 None] Flow 'volume_create_manager' (2b6d24d8-3a9a-4e22-8797-4dcf01a252e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:30:49 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-cc78253a-e04a-474c-a8f7-07e5e85b6f9a tempest-GroupsTest-1352684624 None] Created volume successfully.
Jul 14 16:30:49 devstack sudo[97145]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3b9b495e-ab6e-4d13-b441-0fa0e796fbb0 tempest-TestMinimumBasicScenario-258503962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cb39fd60-df8a-43cf-95f3-d862952cfc02" returned: 0 in 0.444s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3b9b495e-ab6e-4d13-b441-0fa0e796fbb0 tempest-TestMinimumBasicScenario-258503962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cb39fd60-df8a-43cf-95f3-d862952cfc02 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:49 devstack sudo[97152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cb39fd60-df8a-43cf-95f3-d862952cfc02
Jul 14 16:30:49 devstack sudo[97152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:49 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [req-fab2680a-6f4b-4c6b-ba7e-291ea7725b9c req-602e3cbf-c058-41a6-a087-1eb8b6ebc9bc tempest-VolumesGetTestJSON-1059309665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:30:49 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-fab2680a-6f4b-4c6b-ba7e-291ea7725b9c req-602e3cbf-c058-41a6-a087-1eb8b6ebc9bc tempest-VolumesGetTestJSON-1059309665 None] Flow 'volume_create_manager' (a3f412d9-76b8-4cb0-8c2b-508ccd35cd0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:30:49 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-fab2680a-6f4b-4c6b-ba7e-291ea7725b9c req-602e3cbf-c058-41a6-a087-1eb8b6ebc9bc tempest-VolumesGetTestJSON-1059309665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efba79e5-e00c-4642-b3eb-a9d2574bdc7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:30:49 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-fab2680a-6f4b-4c6b-ba7e-291ea7725b9c req-602e3cbf-c058-41a6-a087-1eb8b6ebc9bc tempest-VolumesGetTestJSON-1059309665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efba79e5-e00c-4642-b3eb-a9d2574bdc7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:30:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-686228009',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e711871-c852-4070-b916-c8c9a690ec48,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='41d9216be12d4354a1f3a04ca6c94d23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:30:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:30:50Z,use_quota=True,user_id='ef984641886d49349d8928f16e05be5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:30:49 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-fab2680a-6f4b-4c6b-ba7e-291ea7725b9c req-602e3cbf-c058-41a6-a087-1eb8b6ebc9bc tempest-VolumesGetTestJSON-1059309665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa7df24a-5fc0-45f7-bf93-333947b95e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:30:49 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-fab2680a-6f4b-4c6b-ba7e-291ea7725b9c req-602e3cbf-c058-41a6-a087-1eb8b6ebc9bc tempest-VolumesGetTestJSON-1059309665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa7df24a-5fc0-45f7-bf93-333947b95e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:30:49 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-fab2680a-6f4b-4c6b-ba7e-291ea7725b9c req-602e3cbf-c058-41a6-a087-1eb8b6ebc9bc tempest-VolumesGetTestJSON-1059309665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67c04843-c379-4b5e-a204-411a3dd904a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:30:49 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-fab2680a-6f4b-4c6b-ba7e-291ea7725b9c req-602e3cbf-c058-41a6-a087-1eb8b6ebc9bc tempest-VolumesGetTestJSON-1059309665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67c04843-c379-4b5e-a204-411a3dd904a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e711871-c852-4070-b916-c8c9a690ec48', 'volume_name': 'volume-6e711871-c852-4070-b916-c8c9a690ec48', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:30:49 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-fab2680a-6f4b-4c6b-ba7e-291ea7725b9c req-602e3cbf-c058-41a6-a087-1eb8b6ebc9bc tempest-VolumesGetTestJSON-1059309665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef46ad72-d94e-4fcd-8b23-db6a73c26025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:30:49 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-fab2680a-6f4b-4c6b-ba7e-291ea7725b9c req-602e3cbf-c058-41a6-a087-1eb8b6ebc9bc tempest-VolumesGetTestJSON-1059309665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef46ad72-d94e-4fcd-8b23-db6a73c26025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:30:49 devstack sudo[97152]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:49 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-fab2680a-6f4b-4c6b-ba7e-291ea7725b9c req-602e3cbf-c058-41a6-a087-1eb8b6ebc9bc tempest-VolumesGetTestJSON-1059309665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dac1e0d-b80c-4d72-b36b-c6e5c0393966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:30:49 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [req-fab2680a-6f4b-4c6b-ba7e-291ea7725b9c req-602e3cbf-c058-41a6-a087-1eb8b6ebc9bc tempest-VolumesGetTestJSON-1059309665 None] Volume 6e711871-c852-4070-b916-c8c9a690ec48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e711871-c852-4070-b916-c8c9a690ec48', 'volume_size': 1}
Jul 14 16:30:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-fab2680a-6f4b-4c6b-ba7e-291ea7725b9c req-602e3cbf-c058-41a6-a087-1eb8b6ebc9bc tempest-VolumesGetTestJSON-1059309665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:30:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-fab2680a-6f4b-4c6b-ba7e-291ea7725b9c req-602e3cbf-c058-41a6-a087-1eb8b6ebc9bc tempest-VolumesGetTestJSON-1059309665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:30:49 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [req-fab2680a-6f4b-4c6b-ba7e-291ea7725b9c req-602e3cbf-c058-41a6-a087-1eb8b6ebc9bc tempest-VolumesGetTestJSON-1059309665 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:30:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-686228009',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e711871-c852-4070-b916-c8c9a690ec48,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='41d9216be12d4354a1f3a04ca6c94d23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:30:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:30:50Z,use_quota=True,user_id='ef984641886d49349d8928f16e05be5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:30:49 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [req-fab2680a-6f4b-4c6b-ba7e-291ea7725b9c req-602e3cbf-c058-41a6-a087-1eb8b6ebc9bc tempest-VolumesGetTestJSON-1059309665 None] Creating volume 6e711871-c852-4070-b916-c8c9a690ec48 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:30:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-fab2680a-6f4b-4c6b-ba7e-291ea7725b9c req-602e3cbf-c058-41a6-a087-1eb8b6ebc9bc tempest-VolumesGetTestJSON-1059309665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:30:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-fab2680a-6f4b-4c6b-ba7e-291ea7725b9c req-602e3cbf-c058-41a6-a087-1eb8b6ebc9bc tempest-VolumesGetTestJSON-1059309665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:30:49 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [req-fab2680a-6f4b-4c6b-ba7e-291ea7725b9c req-602e3cbf-c058-41a6-a087-1eb8b6ebc9bc tempest-VolumesGetTestJSON-1059309665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:30:49 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [req-fab2680a-6f4b-4c6b-ba7e-291ea7725b9c req-602e3cbf-c058-41a6-a087-1eb8b6ebc9bc tempest-VolumesGetTestJSON-1059309665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:30:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-fab2680a-6f4b-4c6b-ba7e-291ea7725b9c req-602e3cbf-c058-41a6-a087-1eb8b6ebc9bc tempest-VolumesGetTestJSON-1059309665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:30:49 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [req-fab2680a-6f4b-4c6b-ba7e-291ea7725b9c req-602e3cbf-c058-41a6-a087-1eb8b6ebc9bc tempest-VolumesGetTestJSON-1059309665 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:30:49 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [req-fab2680a-6f4b-4c6b-ba7e-291ea7725b9c req-602e3cbf-c058-41a6-a087-1eb8b6ebc9bc tempest-VolumesGetTestJSON-1059309665 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:30:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-fab2680a-6f4b-4c6b-ba7e-291ea7725b9c req-602e3cbf-c058-41a6-a087-1eb8b6ebc9bc tempest-VolumesGetTestJSON-1059309665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6e711871-c852-4070-b916-c8c9a690ec48 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3b9b495e-ab6e-4d13-b441-0fa0e796fbb0 tempest-TestMinimumBasicScenario-258503962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cb39fd60-df8a-43cf-95f3-d862952cfc02" returned: 0 in 0.330s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:49 devstack sudo[97155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6e711871-c852-4070-b916-c8c9a690ec48 1073741824
Jul 14 16:30:49 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3b9b495e-ab6e-4d13-b441-0fa0e796fbb0 tempest-TestMinimumBasicScenario-258503962 None] Lock "cinder-quobyte-cb39fd60-df8a-43cf-95f3-d862952cfc02" released by "delete_volume" :: held 0.825s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:30:49 devstack sudo[97155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:49 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-3b9b495e-ab6e-4d13-b441-0fa0e796fbb0 tempest-TestMinimumBasicScenario-258503962 None] Created reservations ['60666580-2171-4015-bcec-10b95b296a25', 'efc5608b-0813-4c2a-87e9-592480c07b51', '65a3fc66-48d1-46dc-bb52-50f959f07b6d', 'de61f56e-482f-4aa1-b918-f5cb3ed4307b'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:30:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3b9b495e-ab6e-4d13-b441-0fa0e796fbb0 tempest-TestMinimumBasicScenario-258503962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:30:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3b9b495e-ab6e-4d13-b441-0fa0e796fbb0 tempest-TestMinimumBasicScenario-258503962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:30:49 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-3b9b495e-ab6e-4d13-b441-0fa0e796fbb0 tempest-TestMinimumBasicScenario-258503962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:30:50 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-3b9b495e-ab6e-4d13-b441-0fa0e796fbb0 tempest-TestMinimumBasicScenario-258503962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:30:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3b9b495e-ab6e-4d13-b441-0fa0e796fbb0 tempest-TestMinimumBasicScenario-258503962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:30:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3b9b495e-ab6e-4d13-b441-0fa0e796fbb0 tempest-TestMinimumBasicScenario-258503962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:50 devstack sudo[97157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:30:50 devstack sudo[97157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:50 devstack sudo[97157]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3b9b495e-ab6e-4d13-b441-0fa0e796fbb0 tempest-TestMinimumBasicScenario-258503962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.440s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:50 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-3b9b495e-ab6e-4d13-b441-0fa0e796fbb0 tempest-TestMinimumBasicScenario-258503962 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:30:50 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-3b9b495e-ab6e-4d13-b441-0fa0e796fbb0 tempest-TestMinimumBasicScenario-258503962 None] Deleted volume successfully.
Jul 14 16:30:50 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3b9b495e-ab6e-4d13-b441-0fa0e796fbb0 tempest-TestMinimumBasicScenario-258503962 None] Lock "cinder-cb39fd60-df8a-43cf-95f3-d862952cfc02-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:30:50 devstack sudo[97155]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-fab2680a-6f4b-4c6b-ba7e-291ea7725b9c req-602e3cbf-c058-41a6-a087-1eb8b6ebc9bc tempest-VolumesGetTestJSON-1059309665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6e711871-c852-4070-b916-c8c9a690ec48 1073741824" returned: 0 in 0.811s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-fab2680a-6f4b-4c6b-ba7e-291ea7725b9c req-602e3cbf-c058-41a6-a087-1eb8b6ebc9bc tempest-VolumesGetTestJSON-1059309665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6e711871-c852-4070-b916-c8c9a690ec48 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:50 devstack sudo[97173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6e711871-c852-4070-b916-c8c9a690ec48
Jul 14 16:30:50 devstack sudo[97173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:51 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f897a4e0-d69d-4596-82c8-fd93fab20743 tempest-GroupsTest-1352684624 None] Acquiring lock "cinder-quobyte-9c5abed3-c3d9-4ca4-9de1-9d5048d711f1" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:30:51 devstack sudo[97173]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:51 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f897a4e0-d69d-4596-82c8-fd93fab20743 tempest-GroupsTest-1352684624 None] Lock "cinder-quobyte-9c5abed3-c3d9-4ca4-9de1-9d5048d711f1" acquired by "delete_volume" :: waited 0.023s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:30:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-fab2680a-6f4b-4c6b-ba7e-291ea7725b9c req-602e3cbf-c058-41a6-a087-1eb8b6ebc9bc tempest-VolumesGetTestJSON-1059309665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6e711871-c852-4070-b916-c8c9a690ec48" returned: 0 in 0.428s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:51 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [req-fab2680a-6f4b-4c6b-ba7e-291ea7725b9c req-602e3cbf-c058-41a6-a087-1eb8b6ebc9bc tempest-VolumesGetTestJSON-1059309665 None] <== create_volume: return (1347ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:30:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-fab2680a-6f4b-4c6b-ba7e-291ea7725b9c req-602e3cbf-c058-41a6-a087-1eb8b6ebc9bc tempest-VolumesGetTestJSON-1059309665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.349s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:30:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-fab2680a-6f4b-4c6b-ba7e-291ea7725b9c req-602e3cbf-c058-41a6-a087-1eb8b6ebc9bc tempest-VolumesGetTestJSON-1059309665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dac1e0d-b80c-4d72-b36b-c6e5c0393966) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e711871-c852-4070-b916-c8c9a690ec48', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:30:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-fab2680a-6f4b-4c6b-ba7e-291ea7725b9c req-602e3cbf-c058-41a6-a087-1eb8b6ebc9bc tempest-VolumesGetTestJSON-1059309665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d72c94ee-1420-4483-b91a-2d1caeb5ab82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:30:51 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc57b8c-b699-48e6-9118-0591c2fad7d2]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:30:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f897a4e0-d69d-4596-82c8-fd93fab20743 tempest-GroupsTest-1352684624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9c5abed3-c3d9-4ca4-9de1-9d5048d711f1 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:51 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [req-fab2680a-6f4b-4c6b-ba7e-291ea7725b9c req-602e3cbf-c058-41a6-a087-1eb8b6ebc9bc tempest-VolumesGetTestJSON-1059309665 None] Volume volume-6e711871-c852-4070-b916-c8c9a690ec48 (6e711871-c852-4070-b916-c8c9a690ec48): created successfully
Jul 14 16:30:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-fab2680a-6f4b-4c6b-ba7e-291ea7725b9c req-602e3cbf-c058-41a6-a087-1eb8b6ebc9bc tempest-VolumesGetTestJSON-1059309665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d72c94ee-1420-4483-b91a-2d1caeb5ab82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:30:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-fab2680a-6f4b-4c6b-ba7e-291ea7725b9c req-602e3cbf-c058-41a6-a087-1eb8b6ebc9bc tempest-VolumesGetTestJSON-1059309665 None] Flow 'volume_create_manager' (a3f412d9-76b8-4cb0-8c2b-508ccd35cd0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:30:51 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-fab2680a-6f4b-4c6b-ba7e-291ea7725b9c req-602e3cbf-c058-41a6-a087-1eb8b6ebc9bc tempest-VolumesGetTestJSON-1059309665 None] Created volume successfully.
Jul 14 16:30:51 devstack sudo[97187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9c5abed3-c3d9-4ca4-9de1-9d5048d711f1
Jul 14 16:30:51 devstack sudo[97187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:51 devstack sudo[97187]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f897a4e0-d69d-4596-82c8-fd93fab20743 tempest-GroupsTest-1352684624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9c5abed3-c3d9-4ca4-9de1-9d5048d711f1" returned: 0 in 0.605s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f897a4e0-d69d-4596-82c8-fd93fab20743 tempest-GroupsTest-1352684624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9c5abed3-c3d9-4ca4-9de1-9d5048d711f1 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:51 devstack sudo[97195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9c5abed3-c3d9-4ca4-9de1-9d5048d711f1
Jul 14 16:30:51 devstack sudo[97195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:52 devstack sudo[97195]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f897a4e0-d69d-4596-82c8-fd93fab20743 tempest-GroupsTest-1352684624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9c5abed3-c3d9-4ca4-9de1-9d5048d711f1" returned: 0 in 0.371s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:52 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f897a4e0-d69d-4596-82c8-fd93fab20743 tempest-GroupsTest-1352684624 None] Lock "cinder-quobyte-9c5abed3-c3d9-4ca4-9de1-9d5048d711f1" released by "delete_volume" :: held 1.081s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:30:52 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-f897a4e0-d69d-4596-82c8-fd93fab20743 tempest-GroupsTest-1352684624 None] Created reservations ['008d4896-9991-4342-958a-9d45f9b1172e'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:30:52 devstack cinder-volume[87166]: WARNING cinder.quota [None req-f897a4e0-d69d-4596-82c8-fd93fab20743 tempest-GroupsTest-1352684624 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-488447405 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-488447405, it is now deprecated. Please use the default quota class for default quota.
Jul 14 16:30:52 devstack cinder-volume[87166]: WARNING cinder.quota [None req-f897a4e0-d69d-4596-82c8-fd93fab20743 tempest-GroupsTest-1352684624 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-488447405 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-488447405, it is now deprecated. Please use the default quota class for default quota.
Jul 14 16:30:52 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-f897a4e0-d69d-4596-82c8-fd93fab20743 tempest-GroupsTest-1352684624 None] Created reservations ['54f47571-15fb-4d4e-88d8-1aa60c537999', '6838aea0-f61a-4ecc-9ff6-24ebe631f375', 'e1d4eb74-ccad-4323-a7bd-91c2de2f9697', '48196009-f1e0-47a4-833d-3115e3c3fb25'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:30:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f897a4e0-d69d-4596-82c8-fd93fab20743 tempest-GroupsTest-1352684624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:30:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f897a4e0-d69d-4596-82c8-fd93fab20743 tempest-GroupsTest-1352684624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:30:52 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f897a4e0-d69d-4596-82c8-fd93fab20743 tempest-GroupsTest-1352684624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:30:52 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f897a4e0-d69d-4596-82c8-fd93fab20743 tempest-GroupsTest-1352684624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:30:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f897a4e0-d69d-4596-82c8-fd93fab20743 tempest-GroupsTest-1352684624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:30:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f897a4e0-d69d-4596-82c8-fd93fab20743 tempest-GroupsTest-1352684624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:52 devstack sudo[97198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:30:52 devstack sudo[97198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:52 devstack cinder-volume[87166]: DEBUG cinder.coordination [req-cb3b0d5a-2c7a-4257-8cf6-024166365920 req-34b610f4-d7da-4003-b2da-d33a0d693017 tempest-VolumesGetTestJSON-1059309665 None] Acquiring lock "cinder-6e711871-c852-4070-b916-c8c9a690ec48-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:30:52 devstack sudo[97198]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:52 devstack cinder-volume[87166]: DEBUG cinder.coordination [req-cb3b0d5a-2c7a-4257-8cf6-024166365920 req-34b610f4-d7da-4003-b2da-d33a0d693017 tempest-VolumesGetTestJSON-1059309665 None] Lock "cinder-6e711871-c852-4070-b916-c8c9a690ec48-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:30:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f897a4e0-d69d-4596-82c8-fd93fab20743 tempest-GroupsTest-1352684624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.286s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:52 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-f897a4e0-d69d-4596-82c8-fd93fab20743 tempest-GroupsTest-1352684624 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:30:52 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-f897a4e0-d69d-4596-82c8-fd93fab20743 tempest-GroupsTest-1352684624 None] Delete group completed successfully.
Jul 14 16:30:52 devstack cinder-volume[87166]: DEBUG cinder.coordination [req-cb3b0d5a-2c7a-4257-8cf6-024166365920 req-34b610f4-d7da-4003-b2da-d33a0d693017 tempest-VolumesGetTestJSON-1059309665 None] Acquiring lock "cinder-quobyte-6e711871-c852-4070-b916-c8c9a690ec48" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:30:52 devstack cinder-volume[87166]: DEBUG cinder.coordination [req-cb3b0d5a-2c7a-4257-8cf6-024166365920 req-34b610f4-d7da-4003-b2da-d33a0d693017 tempest-VolumesGetTestJSON-1059309665 None] Lock "cinder-quobyte-6e711871-c852-4070-b916-c8c9a690ec48" acquired by "delete_volume" :: waited 0.015s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:30:52 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a11661d-1424-4106-8256-fda42af12210]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:30:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-cb3b0d5a-2c7a-4257-8cf6-024166365920 req-34b610f4-d7da-4003-b2da-d33a0d693017 tempest-VolumesGetTestJSON-1059309665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6e711871-c852-4070-b916-c8c9a690ec48 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:52 devstack sudo[97201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6e711871-c852-4070-b916-c8c9a690ec48
Jul 14 16:30:52 devstack sudo[97201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:53 devstack sudo[97201]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-cb3b0d5a-2c7a-4257-8cf6-024166365920 req-34b610f4-d7da-4003-b2da-d33a0d693017 tempest-VolumesGetTestJSON-1059309665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6e711871-c852-4070-b916-c8c9a690ec48" returned: 0 in 0.347s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-cb3b0d5a-2c7a-4257-8cf6-024166365920 req-34b610f4-d7da-4003-b2da-d33a0d693017 tempest-VolumesGetTestJSON-1059309665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6e711871-c852-4070-b916-c8c9a690ec48 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:53 devstack sudo[97207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6e711871-c852-4070-b916-c8c9a690ec48
Jul 14 16:30:53 devstack sudo[97207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:53 devstack sudo[97207]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-cb3b0d5a-2c7a-4257-8cf6-024166365920 req-34b610f4-d7da-4003-b2da-d33a0d693017 tempest-VolumesGetTestJSON-1059309665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6e711871-c852-4070-b916-c8c9a690ec48" returned: 0 in 0.310s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:53 devstack cinder-volume[87166]: DEBUG cinder.coordination [req-cb3b0d5a-2c7a-4257-8cf6-024166365920 req-34b610f4-d7da-4003-b2da-d33a0d693017 tempest-VolumesGetTestJSON-1059309665 None] Lock "cinder-quobyte-6e711871-c852-4070-b916-c8c9a690ec48" released by "delete_volume" :: held 0.718s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:30:53 devstack cinder-volume[87166]: DEBUG cinder.quota [req-cb3b0d5a-2c7a-4257-8cf6-024166365920 req-34b610f4-d7da-4003-b2da-d33a0d693017 tempest-VolumesGetTestJSON-1059309665 None] Created reservations ['87889d23-073a-4596-bf33-afe8f02b88d3', 'b1145710-3c39-4dc9-bcbc-5498fe744ceb', '193ccf21-baea-4ab5-8f9f-ff3413fd4384', '3c6bc3c2-8719-4800-b69e-f5effaea73a7'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:30:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-cb3b0d5a-2c7a-4257-8cf6-024166365920 req-34b610f4-d7da-4003-b2da-d33a0d693017 tempest-VolumesGetTestJSON-1059309665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:30:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-cb3b0d5a-2c7a-4257-8cf6-024166365920 req-34b610f4-d7da-4003-b2da-d33a0d693017 tempest-VolumesGetTestJSON-1059309665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:30:53 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [req-cb3b0d5a-2c7a-4257-8cf6-024166365920 req-34b610f4-d7da-4003-b2da-d33a0d693017 tempest-VolumesGetTestJSON-1059309665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:30:53 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [req-cb3b0d5a-2c7a-4257-8cf6-024166365920 req-34b610f4-d7da-4003-b2da-d33a0d693017 tempest-VolumesGetTestJSON-1059309665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:30:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-cb3b0d5a-2c7a-4257-8cf6-024166365920 req-34b610f4-d7da-4003-b2da-d33a0d693017 tempest-VolumesGetTestJSON-1059309665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:30:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-cb3b0d5a-2c7a-4257-8cf6-024166365920 req-34b610f4-d7da-4003-b2da-d33a0d693017 tempest-VolumesGetTestJSON-1059309665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:53 devstack sudo[97210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:30:53 devstack sudo[97210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:53 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-8a850bb0-0e02-4d04-8bce-67c3a012783f tempest-GroupsTest-1352684624 None] Created reservations ['10a21830-9ba7-4ce1-b305-be9a1bbb85ea'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:30:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-8a850bb0-0e02-4d04-8bce-67c3a012783f tempest-GroupsTest-1352684624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:30:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-8a850bb0-0e02-4d04-8bce-67c3a012783f tempest-GroupsTest-1352684624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:30:53 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-8a850bb0-0e02-4d04-8bce-67c3a012783f tempest-GroupsTest-1352684624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:30:53 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-8a850bb0-0e02-4d04-8bce-67c3a012783f tempest-GroupsTest-1352684624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:30:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-8a850bb0-0e02-4d04-8bce-67c3a012783f tempest-GroupsTest-1352684624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:30:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-8a850bb0-0e02-4d04-8bce-67c3a012783f tempest-GroupsTest-1352684624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:53 devstack sudo[97212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:30:53 devstack sudo[97212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:54 devstack sudo[97210]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-cb3b0d5a-2c7a-4257-8cf6-024166365920 req-34b610f4-d7da-4003-b2da-d33a0d693017 tempest-VolumesGetTestJSON-1059309665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.367s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:54 devstack cinder-volume[87166]: DEBUG cinder.manager [req-cb3b0d5a-2c7a-4257-8cf6-024166365920 req-34b610f4-d7da-4003-b2da-d33a0d693017 tempest-VolumesGetTestJSON-1059309665 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:30:54 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-cb3b0d5a-2c7a-4257-8cf6-024166365920 req-34b610f4-d7da-4003-b2da-d33a0d693017 tempest-VolumesGetTestJSON-1059309665 None] Deleted volume successfully.
Jul 14 16:30:54 devstack cinder-volume[87166]: DEBUG cinder.coordination [req-cb3b0d5a-2c7a-4257-8cf6-024166365920 req-34b610f4-d7da-4003-b2da-d33a0d693017 tempest-VolumesGetTestJSON-1059309665 None] Lock "cinder-6e711871-c852-4070-b916-c8c9a690ec48-delete_volume" released by "delete_volume" :: held 1.394s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:30:54 devstack sudo[97212]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-8a850bb0-0e02-4d04-8bce-67c3a012783f tempest-GroupsTest-1352684624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.323s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:54 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-8a850bb0-0e02-4d04-8bce-67c3a012783f tempest-GroupsTest-1352684624 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:30:54 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-8a850bb0-0e02-4d04-8bce-67c3a012783f tempest-GroupsTest-1352684624 None] Delete group completed successfully.
Jul 14 16:30:55 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-0145b04f-d65c-48d1-9a35-d001cf39106a tempest-GroupsTest-1352684624 None] Group tempest-GroupsTest-Group-660325203: creating
Jul 14 16:30:55 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-0145b04f-d65c-48d1-9a35-d001cf39106a tempest-GroupsTest-1352684624 None] Group tempest-GroupsTest-Group-660325203: created successfully
Jul 14 16:30:55 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-0145b04f-d65c-48d1-9a35-d001cf39106a tempest-GroupsTest-1352684624 None] Create group completed successfully.
Jul 14 16:30:57 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0a63c9c-9b97-408d-bd2e-809dc805b2a1 tempest-GroupsTest-1352684624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:30:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f0a63c9c-9b97-408d-bd2e-809dc805b2a1 tempest-GroupsTest-1352684624 None] Flow 'volume_create_manager' (cefddca2-c200-4543-be9c-eb6ab3d376d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:30:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f0a63c9c-9b97-408d-bd2e-809dc805b2a1 tempest-GroupsTest-1352684624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3024d5b-20f4-4b5f-84f4-74f5f1f5de25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:30:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f0a63c9c-9b97-408d-bd2e-809dc805b2a1 tempest-GroupsTest-1352684624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3024d5b-20f4-4b5f-84f4-74f5f1f5de25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:30:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-287778053',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=1966898f-2214-4d93-84f7-1a0c0930ecf1,host='devstack@QuobyteHD#QuobyteHD',id=509857f8-bc27-4357-9983-682bf6c0447e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04d3f58b152f41f1a7a79a03f3f09ebc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:30:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:30:57Z,use_quota=True,user_id='e67b22c439ad4acab61aa632936b5390',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27eac241-e579-4e28-b1cd-e68a7e7bf992),volume_type_id=27eac241-e579-4e28-b1cd-e68a7e7bf992)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:30:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f0a63c9c-9b97-408d-bd2e-809dc805b2a1 tempest-GroupsTest-1352684624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b05f7063-6e84-483f-bd0f-931709dcae77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:30:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f0a63c9c-9b97-408d-bd2e-809dc805b2a1 tempest-GroupsTest-1352684624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b05f7063-6e84-483f-bd0f-931709dcae77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:30:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f0a63c9c-9b97-408d-bd2e-809dc805b2a1 tempest-GroupsTest-1352684624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a55255ff-3233-401a-a51c-e20b3530185a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:30:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f0a63c9c-9b97-408d-bd2e-809dc805b2a1 tempest-GroupsTest-1352684624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a55255ff-3233-401a-a51c-e20b3530185a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '509857f8-bc27-4357-9983-682bf6c0447e', 'volume_name': 'volume-509857f8-bc27-4357-9983-682bf6c0447e', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:30:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f0a63c9c-9b97-408d-bd2e-809dc805b2a1 tempest-GroupsTest-1352684624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fe1bc47-c067-4492-aa0c-0c03c44dc031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:30:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f0a63c9c-9b97-408d-bd2e-809dc805b2a1 tempest-GroupsTest-1352684624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fe1bc47-c067-4492-aa0c-0c03c44dc031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:30:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f0a63c9c-9b97-408d-bd2e-809dc805b2a1 tempest-GroupsTest-1352684624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (050d8401-ed53-452e-8622-50f02952816e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:30:57 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-f0a63c9c-9b97-408d-bd2e-809dc805b2a1 tempest-GroupsTest-1352684624 None] Volume 509857f8-bc27-4357-9983-682bf6c0447e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-509857f8-bc27-4357-9983-682bf6c0447e', 'volume_size': 1}
Jul 14 16:30:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f0a63c9c-9b97-408d-bd2e-809dc805b2a1 tempest-GroupsTest-1352684624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:30:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f0a63c9c-9b97-408d-bd2e-809dc805b2a1 tempest-GroupsTest-1352684624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:30:57 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f0a63c9c-9b97-408d-bd2e-809dc805b2a1 tempest-GroupsTest-1352684624 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=1966898f-2214-4d93-84f7-1a0c0930ecf1,created_at=2026-07-14T14:30:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-287778053',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=1966898f-2214-4d93-84f7-1a0c0930ecf1,host='devstack@QuobyteHD#QuobyteHD',id=509857f8-bc27-4357-9983-682bf6c0447e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04d3f58b152f41f1a7a79a03f3f09ebc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:30:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:30:57Z,use_quota=True,user_id='e67b22c439ad4acab61aa632936b5390',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27eac241-e579-4e28-b1cd-e68a7e7bf992),volume_type_id=27eac241-e579-4e28-b1cd-e68a7e7bf992)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:30:57 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-f0a63c9c-9b97-408d-bd2e-809dc805b2a1 tempest-GroupsTest-1352684624 None] Creating volume 509857f8-bc27-4357-9983-682bf6c0447e {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:30:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f0a63c9c-9b97-408d-bd2e-809dc805b2a1 tempest-GroupsTest-1352684624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:30:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f0a63c9c-9b97-408d-bd2e-809dc805b2a1 tempest-GroupsTest-1352684624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:30:57 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f0a63c9c-9b97-408d-bd2e-809dc805b2a1 tempest-GroupsTest-1352684624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:30:57 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f0a63c9c-9b97-408d-bd2e-809dc805b2a1 tempest-GroupsTest-1352684624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:30:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f0a63c9c-9b97-408d-bd2e-809dc805b2a1 tempest-GroupsTest-1352684624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:30:57 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f0a63c9c-9b97-408d-bd2e-809dc805b2a1 tempest-GroupsTest-1352684624 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:30:57 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-f0a63c9c-9b97-408d-bd2e-809dc805b2a1 tempest-GroupsTest-1352684624 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:30:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f0a63c9c-9b97-408d-bd2e-809dc805b2a1 tempest-GroupsTest-1352684624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-509857f8-bc27-4357-9983-682bf6c0447e 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:57 devstack sudo[97219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-509857f8-bc27-4357-9983-682bf6c0447e 1073741824
Jul 14 16:30:57 devstack sudo[97219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:58 devstack sudo[97219]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f0a63c9c-9b97-408d-bd2e-809dc805b2a1 tempest-GroupsTest-1352684624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-509857f8-bc27-4357-9983-682bf6c0447e 1073741824" returned: 0 in 0.580s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f0a63c9c-9b97-408d-bd2e-809dc805b2a1 tempest-GroupsTest-1352684624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-509857f8-bc27-4357-9983-682bf6c0447e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:58 devstack sudo[97225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-509857f8-bc27-4357-9983-682bf6c0447e
Jul 14 16:30:58 devstack sudo[97225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:58 devstack sudo[97225]: pam_unix(sudo:session): session closed for user root
Jul 14 16:30:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f0a63c9c-9b97-408d-bd2e-809dc805b2a1 tempest-GroupsTest-1352684624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-509857f8-bc27-4357-9983-682bf6c0447e" returned: 0 in 0.280s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:30:58 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f0a63c9c-9b97-408d-bd2e-809dc805b2a1 tempest-GroupsTest-1352684624 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:30:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f0a63c9c-9b97-408d-bd2e-809dc805b2a1 tempest-GroupsTest-1352684624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:30:58 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f0a63c9c-9b97-408d-bd2e-809dc805b2a1 tempest-GroupsTest-1352684624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (050d8401-ed53-452e-8622-50f02952816e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-509857f8-bc27-4357-9983-682bf6c0447e', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:30:58 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f0a63c9c-9b97-408d-bd2e-809dc805b2a1 tempest-GroupsTest-1352684624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5948f86-11c4-4ec9-946c-40d08a0489c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:30:58 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-f0a63c9c-9b97-408d-bd2e-809dc805b2a1 tempest-GroupsTest-1352684624 None] Volume volume-509857f8-bc27-4357-9983-682bf6c0447e (509857f8-bc27-4357-9983-682bf6c0447e): created successfully
Jul 14 16:30:58 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f0a63c9c-9b97-408d-bd2e-809dc805b2a1 tempest-GroupsTest-1352684624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5948f86-11c4-4ec9-946c-40d08a0489c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:30:58 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f0a63c9c-9b97-408d-bd2e-809dc805b2a1 tempest-GroupsTest-1352684624 None] Flow 'volume_create_manager' (cefddca2-c200-4543-be9c-eb6ab3d376d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:30:58 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-f0a63c9c-9b97-408d-bd2e-809dc805b2a1 tempest-GroupsTest-1352684624 None] Created volume successfully.
Jul 14 16:30:59 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-affaf9a9-8fc5-4050-8df8-bd7def676e65 tempest-GroupsTest-1352684624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:30:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-affaf9a9-8fc5-4050-8df8-bd7def676e65 tempest-GroupsTest-1352684624 None] Flow 'volume_create_manager' (588f06db-adc6-4c39-9556-1b5a788c213c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:30:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-affaf9a9-8fc5-4050-8df8-bd7def676e65 tempest-GroupsTest-1352684624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62abaf65-524b-44cf-9103-914c0c4733dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:30:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-affaf9a9-8fc5-4050-8df8-bd7def676e65 tempest-GroupsTest-1352684624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62abaf65-524b-44cf-9103-914c0c4733dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:30:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1381919849',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=1966898f-2214-4d93-84f7-1a0c0930ecf1,host='devstack@QuobyteHD#QuobyteHD',id=c0473850-7070-4de3-91ea-3e13edbb99fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04d3f58b152f41f1a7a79a03f3f09ebc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:30:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:30:59Z,use_quota=True,user_id='e67b22c439ad4acab61aa632936b5390',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27eac241-e579-4e28-b1cd-e68a7e7bf992),volume_type_id=27eac241-e579-4e28-b1cd-e68a7e7bf992)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:30:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-affaf9a9-8fc5-4050-8df8-bd7def676e65 tempest-GroupsTest-1352684624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb48745f-46d9-408e-be31-ac6c5a05b612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:30:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-affaf9a9-8fc5-4050-8df8-bd7def676e65 tempest-GroupsTest-1352684624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb48745f-46d9-408e-be31-ac6c5a05b612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:30:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-affaf9a9-8fc5-4050-8df8-bd7def676e65 tempest-GroupsTest-1352684624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bd329ba-c5bb-4bdd-b572-609aa74eaab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:30:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-affaf9a9-8fc5-4050-8df8-bd7def676e65 tempest-GroupsTest-1352684624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bd329ba-c5bb-4bdd-b572-609aa74eaab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0473850-7070-4de3-91ea-3e13edbb99fd', 'volume_name': 'volume-c0473850-7070-4de3-91ea-3e13edbb99fd', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:30:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-affaf9a9-8fc5-4050-8df8-bd7def676e65 tempest-GroupsTest-1352684624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7260928-15f8-4c84-91d3-c21e8168683a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:30:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-affaf9a9-8fc5-4050-8df8-bd7def676e65 tempest-GroupsTest-1352684624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7260928-15f8-4c84-91d3-c21e8168683a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:30:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-affaf9a9-8fc5-4050-8df8-bd7def676e65 tempest-GroupsTest-1352684624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa1e5a84-2da2-45e4-b29f-59c7b7ae9997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:30:59 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-affaf9a9-8fc5-4050-8df8-bd7def676e65 tempest-GroupsTest-1352684624 None] Volume c0473850-7070-4de3-91ea-3e13edbb99fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0473850-7070-4de3-91ea-3e13edbb99fd', 'volume_size': 1}
Jul 14 16:30:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-affaf9a9-8fc5-4050-8df8-bd7def676e65 tempest-GroupsTest-1352684624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:30:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-affaf9a9-8fc5-4050-8df8-bd7def676e65 tempest-GroupsTest-1352684624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:30:59 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-affaf9a9-8fc5-4050-8df8-bd7def676e65 tempest-GroupsTest-1352684624 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=1966898f-2214-4d93-84f7-1a0c0930ecf1,created_at=2026-07-14T14:30:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1381919849',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=1966898f-2214-4d93-84f7-1a0c0930ecf1,host='devstack@QuobyteHD#QuobyteHD',id=c0473850-7070-4de3-91ea-3e13edbb99fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04d3f58b152f41f1a7a79a03f3f09ebc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:30:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:30:59Z,use_quota=True,user_id='e67b22c439ad4acab61aa632936b5390',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27eac241-e579-4e28-b1cd-e68a7e7bf992),volume_type_id=27eac241-e579-4e28-b1cd-e68a7e7bf992)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:30:59 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-affaf9a9-8fc5-4050-8df8-bd7def676e65 tempest-GroupsTest-1352684624 None] Creating volume c0473850-7070-4de3-91ea-3e13edbb99fd {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:30:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-affaf9a9-8fc5-4050-8df8-bd7def676e65 tempest-GroupsTest-1352684624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:30:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-affaf9a9-8fc5-4050-8df8-bd7def676e65 tempest-GroupsTest-1352684624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:30:59 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-affaf9a9-8fc5-4050-8df8-bd7def676e65 tempest-GroupsTest-1352684624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:30:59 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-affaf9a9-8fc5-4050-8df8-bd7def676e65 tempest-GroupsTest-1352684624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:30:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-affaf9a9-8fc5-4050-8df8-bd7def676e65 tempest-GroupsTest-1352684624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:30:59 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-affaf9a9-8fc5-4050-8df8-bd7def676e65 tempest-GroupsTest-1352684624 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:30:59 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-affaf9a9-8fc5-4050-8df8-bd7def676e65 tempest-GroupsTest-1352684624 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:30:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-affaf9a9-8fc5-4050-8df8-bd7def676e65 tempest-GroupsTest-1352684624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c0473850-7070-4de3-91ea-3e13edbb99fd 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:30:59 devstack sudo[97230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c0473850-7070-4de3-91ea-3e13edbb99fd 1073741824
Jul 14 16:30:59 devstack sudo[97230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:30:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1ae24a22-5985-4d59-bdb3-03082ec2cfde tempest-BackendsCapabilitiesAdminTestsJSON-1329339170 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6650619506836, 'free_capacity_gb': 1775.6650619506836, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87166) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jul 14 16:31:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5bb46370-0e50-4105-80fc-65a6a15a8a0b tempest-BackendsCapabilitiesAdminTestsJSON-1329339170 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6650619506836, 'free_capacity_gb': 1775.6650619506836, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87166) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jul 14 16:31:00 devstack sudo[97230]: pam_unix(sudo:session): session closed for user root
Jul 14 16:31:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-affaf9a9-8fc5-4050-8df8-bd7def676e65 tempest-GroupsTest-1352684624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c0473850-7070-4de3-91ea-3e13edbb99fd 1073741824" returned: 0 in 0.586s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:31:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-affaf9a9-8fc5-4050-8df8-bd7def676e65 tempest-GroupsTest-1352684624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c0473850-7070-4de3-91ea-3e13edbb99fd {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:31:00 devstack sudo[97236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c0473850-7070-4de3-91ea-3e13edbb99fd
Jul 14 16:31:00 devstack sudo[97236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:31:00 devstack sudo[97236]: pam_unix(sudo:session): session closed for user root
Jul 14 16:31:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-affaf9a9-8fc5-4050-8df8-bd7def676e65 tempest-GroupsTest-1352684624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c0473850-7070-4de3-91ea-3e13edbb99fd" returned: 0 in 0.278s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:31:00 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-affaf9a9-8fc5-4050-8df8-bd7def676e65 tempest-GroupsTest-1352684624 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:31:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-affaf9a9-8fc5-4050-8df8-bd7def676e65 tempest-GroupsTest-1352684624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:31:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-affaf9a9-8fc5-4050-8df8-bd7def676e65 tempest-GroupsTest-1352684624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa1e5a84-2da2-45e4-b29f-59c7b7ae9997) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0473850-7070-4de3-91ea-3e13edbb99fd', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:31:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-affaf9a9-8fc5-4050-8df8-bd7def676e65 tempest-GroupsTest-1352684624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b6ae14c-0517-406e-9d94-062ad5afa172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:31:00 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-affaf9a9-8fc5-4050-8df8-bd7def676e65 tempest-GroupsTest-1352684624 None] Volume volume-c0473850-7070-4de3-91ea-3e13edbb99fd (c0473850-7070-4de3-91ea-3e13edbb99fd): created successfully
Jul 14 16:31:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-affaf9a9-8fc5-4050-8df8-bd7def676e65 tempest-GroupsTest-1352684624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b6ae14c-0517-406e-9d94-062ad5afa172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:31:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-affaf9a9-8fc5-4050-8df8-bd7def676e65 tempest-GroupsTest-1352684624 None] Flow 'volume_create_manager' (588f06db-adc6-4c39-9556-1b5a788c213c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:31:00 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-affaf9a9-8fc5-4050-8df8-bd7def676e65 tempest-GroupsTest-1352684624 None] Created volume successfully.
Jul 14 16:31:00 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-44c9f8bf-a167-4383-a6f4-72cc79256eb3 tempest-GroupsTest-1352684624 None] Update group completed successfully.
Jul 14 16:31:02 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-86abf059-4ae1-4c32-96fd-8a13ebd4c887 tempest-GroupsTest-1352684624 None] Update group completed successfully.
Jul 14 16:31:04 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b43936dd-3f98-40f4-96f7-8714e2178900 tempest-GroupsTest-1352684624 None] Acquiring lock "cinder-quobyte-509857f8-bc27-4357-9983-682bf6c0447e" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:31:04 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b43936dd-3f98-40f4-96f7-8714e2178900 tempest-GroupsTest-1352684624 None] Lock "cinder-quobyte-509857f8-bc27-4357-9983-682bf6c0447e" acquired by "delete_volume" :: waited 0.028s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:31:04 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c39ed1-2394-4a9d-b0f8-f3df844e8c08]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:31:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b43936dd-3f98-40f4-96f7-8714e2178900 tempest-GroupsTest-1352684624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-509857f8-bc27-4357-9983-682bf6c0447e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:31:04 devstack sudo[97277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-509857f8-bc27-4357-9983-682bf6c0447e
Jul 14 16:31:04 devstack sudo[97277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:31:05 devstack sudo[97277]: pam_unix(sudo:session): session closed for user root
Jul 14 16:31:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b43936dd-3f98-40f4-96f7-8714e2178900 tempest-GroupsTest-1352684624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-509857f8-bc27-4357-9983-682bf6c0447e" returned: 0 in 0.499s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:31:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b43936dd-3f98-40f4-96f7-8714e2178900 tempest-GroupsTest-1352684624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-509857f8-bc27-4357-9983-682bf6c0447e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:31:05 devstack sudo[97282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-509857f8-bc27-4357-9983-682bf6c0447e
Jul 14 16:31:05 devstack sudo[97282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:31:05 devstack sudo[97282]: pam_unix(sudo:session): session closed for user root
Jul 14 16:31:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b43936dd-3f98-40f4-96f7-8714e2178900 tempest-GroupsTest-1352684624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-509857f8-bc27-4357-9983-682bf6c0447e" returned: 0 in 0.284s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:31:05 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b43936dd-3f98-40f4-96f7-8714e2178900 tempest-GroupsTest-1352684624 None] Lock "cinder-quobyte-509857f8-bc27-4357-9983-682bf6c0447e" released by "delete_volume" :: held 0.875s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:31:05 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b43936dd-3f98-40f4-96f7-8714e2178900 tempest-GroupsTest-1352684624 None] Acquiring lock "cinder-quobyte-c0473850-7070-4de3-91ea-3e13edbb99fd" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:31:05 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b43936dd-3f98-40f4-96f7-8714e2178900 tempest-GroupsTest-1352684624 None] Lock "cinder-quobyte-c0473850-7070-4de3-91ea-3e13edbb99fd" acquired by "delete_volume" :: waited 0.022s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:31:05 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[3930572c-db3f-4442-9f36-2c0da5cf6224]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:31:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b43936dd-3f98-40f4-96f7-8714e2178900 tempest-GroupsTest-1352684624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c0473850-7070-4de3-91ea-3e13edbb99fd {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:31:05 devstack sudo[97285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c0473850-7070-4de3-91ea-3e13edbb99fd
Jul 14 16:31:05 devstack sudo[97285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:31:05 devstack sudo[97285]: pam_unix(sudo:session): session closed for user root
Jul 14 16:31:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b43936dd-3f98-40f4-96f7-8714e2178900 tempest-GroupsTest-1352684624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c0473850-7070-4de3-91ea-3e13edbb99fd" returned: 0 in 0.470s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:31:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b43936dd-3f98-40f4-96f7-8714e2178900 tempest-GroupsTest-1352684624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c0473850-7070-4de3-91ea-3e13edbb99fd {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:31:05 devstack sudo[97290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c0473850-7070-4de3-91ea-3e13edbb99fd
Jul 14 16:31:05 devstack sudo[97290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:31:06 devstack sudo[97290]: pam_unix(sudo:session): session closed for user root
Jul 14 16:31:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b43936dd-3f98-40f4-96f7-8714e2178900 tempest-GroupsTest-1352684624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c0473850-7070-4de3-91ea-3e13edbb99fd" returned: 0 in 0.266s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:31:06 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b43936dd-3f98-40f4-96f7-8714e2178900 tempest-GroupsTest-1352684624 None] Lock "cinder-quobyte-c0473850-7070-4de3-91ea-3e13edbb99fd" released by "delete_volume" :: held 0.784s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:31:06 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-b43936dd-3f98-40f4-96f7-8714e2178900 tempest-GroupsTest-1352684624 None] Created reservations ['c62fc11c-e7a9-4e8c-9417-f0d53241ebca'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:31:06 devstack cinder-volume[87166]: WARNING cinder.quota [None req-b43936dd-3f98-40f4-96f7-8714e2178900 tempest-GroupsTest-1352684624 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1850503544 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1850503544, it is now deprecated. Please use the default quota class for default quota.
Jul 14 16:31:06 devstack cinder-volume[87166]: WARNING cinder.quota [None req-b43936dd-3f98-40f4-96f7-8714e2178900 tempest-GroupsTest-1352684624 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1850503544 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1850503544, it is now deprecated. Please use the default quota class for default quota.
Jul 14 16:31:06 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-b43936dd-3f98-40f4-96f7-8714e2178900 tempest-GroupsTest-1352684624 None] Created reservations ['ec8fbab3-8890-44be-b6f1-fcaa0bd458af', 'f70e60b8-6776-48e2-8d89-410991b18341', 'f83305c7-1fd2-45a8-b59d-dc204ce0a28f', 'a456a7c7-74dc-4b97-9f7f-8c5f8f6837f7'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:31:06 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-b43936dd-3f98-40f4-96f7-8714e2178900 tempest-GroupsTest-1352684624 None] Created reservations ['b19c6b2a-b6ad-4ba7-8455-b32d4056a20e', 'd5e86f86-c9c3-419f-9932-7527d34d2da9', '27a44ea2-3a9d-4983-90ea-cd115828aaa0', '70a799d1-5243-42a1-bd6e-714ebe1e7a10'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:31:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b43936dd-3f98-40f4-96f7-8714e2178900 tempest-GroupsTest-1352684624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:31:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b43936dd-3f98-40f4-96f7-8714e2178900 tempest-GroupsTest-1352684624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:31:06 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-b43936dd-3f98-40f4-96f7-8714e2178900 tempest-GroupsTest-1352684624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:31:06 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-b43936dd-3f98-40f4-96f7-8714e2178900 tempest-GroupsTest-1352684624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:31:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b43936dd-3f98-40f4-96f7-8714e2178900 tempest-GroupsTest-1352684624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:31:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b43936dd-3f98-40f4-96f7-8714e2178900 tempest-GroupsTest-1352684624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:31:06 devstack sudo[97293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:31:06 devstack sudo[97293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:31:06 devstack sudo[97293]: pam_unix(sudo:session): session closed for user root
Jul 14 16:31:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b43936dd-3f98-40f4-96f7-8714e2178900 tempest-GroupsTest-1352684624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.314s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:31:07 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-b43936dd-3f98-40f4-96f7-8714e2178900 tempest-GroupsTest-1352684624 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:31:07 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-b43936dd-3f98-40f4-96f7-8714e2178900 tempest-GroupsTest-1352684624 None] Delete group completed successfully.
Jul 14 16:31:07 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-6cf5a167-e684-4385-b96d-ac0a88fad930 tempest-GroupSnapshotsV319Test-2070524315 None] Group tempest-GroupSnapshotsV319Test-Group-1837752749: creating
Jul 14 16:31:07 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-6cf5a167-e684-4385-b96d-ac0a88fad930 tempest-GroupSnapshotsV319Test-2070524315 None] Group tempest-GroupSnapshotsV319Test-Group-1837752749: created successfully
Jul 14 16:31:07 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-6cf5a167-e684-4385-b96d-ac0a88fad930 tempest-GroupSnapshotsV319Test-2070524315 None] Create group completed successfully.
Jul 14 16:31:09 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c6159ae-a215-407d-bcd6-66d450f006d5 tempest-GroupSnapshotsV319Test-2070524315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:31:09 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0c6159ae-a215-407d-bcd6-66d450f006d5 tempest-GroupSnapshotsV319Test-2070524315 None] Flow 'volume_create_manager' (22c78eaa-7978-433b-a2a8-d9079309401d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:31:09 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0c6159ae-a215-407d-bcd6-66d450f006d5 tempest-GroupSnapshotsV319Test-2070524315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d67a53e9-c93f-48dd-975f-65593c4ebd4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:31:09 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0c6159ae-a215-407d-bcd6-66d450f006d5 tempest-GroupSnapshotsV319Test-2070524315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d67a53e9-c93f-48dd-975f-65593c4ebd4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:31:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-630582625',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=74205419-5348-4d52-b4c1-b43e0bfcc361,host='devstack@QuobyteHD#QuobyteHD',id=61a6e51f-8a53-4d86-84f5-3733357d69d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db2fe46cdca148688d5f251caa760485',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:31:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:31:10Z,use_quota=True,user_id='4694a04ef1f9400faa803f73c5902cb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78f97e5a-c00d-44bf-bafd-484ccd48d6e5),volume_type_id=78f97e5a-c00d-44bf-bafd-484ccd48d6e5)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:31:09 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0c6159ae-a215-407d-bcd6-66d450f006d5 tempest-GroupSnapshotsV319Test-2070524315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa2960ed-e43b-434f-9d6f-92ad9661ccda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:31:09 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0c6159ae-a215-407d-bcd6-66d450f006d5 tempest-GroupSnapshotsV319Test-2070524315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa2960ed-e43b-434f-9d6f-92ad9661ccda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:31:09 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0c6159ae-a215-407d-bcd6-66d450f006d5 tempest-GroupSnapshotsV319Test-2070524315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84c0a89a-8e28-49de-ae64-55b0461bf50f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:31:09 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0c6159ae-a215-407d-bcd6-66d450f006d5 tempest-GroupSnapshotsV319Test-2070524315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84c0a89a-8e28-49de-ae64-55b0461bf50f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61a6e51f-8a53-4d86-84f5-3733357d69d6', 'volume_name': 'volume-61a6e51f-8a53-4d86-84f5-3733357d69d6', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:31:09 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0c6159ae-a215-407d-bcd6-66d450f006d5 tempest-GroupSnapshotsV319Test-2070524315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87403340-d2d0-49a8-b655-707cb5e50cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:31:09 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0c6159ae-a215-407d-bcd6-66d450f006d5 tempest-GroupSnapshotsV319Test-2070524315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87403340-d2d0-49a8-b655-707cb5e50cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:31:09 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0c6159ae-a215-407d-bcd6-66d450f006d5 tempest-GroupSnapshotsV319Test-2070524315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (432c2818-d34b-4620-b7ab-427ad54b23a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:31:09 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-0c6159ae-a215-407d-bcd6-66d450f006d5 tempest-GroupSnapshotsV319Test-2070524315 None] Volume 61a6e51f-8a53-4d86-84f5-3733357d69d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61a6e51f-8a53-4d86-84f5-3733357d69d6', 'volume_size': 1}
Jul 14 16:31:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0c6159ae-a215-407d-bcd6-66d450f006d5 tempest-GroupSnapshotsV319Test-2070524315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:31:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0c6159ae-a215-407d-bcd6-66d450f006d5 tempest-GroupSnapshotsV319Test-2070524315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:31:09 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0c6159ae-a215-407d-bcd6-66d450f006d5 tempest-GroupSnapshotsV319Test-2070524315 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=74205419-5348-4d52-b4c1-b43e0bfcc361,created_at=2026-07-14T14:31:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-630582625',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=74205419-5348-4d52-b4c1-b43e0bfcc361,host='devstack@QuobyteHD#QuobyteHD',id=61a6e51f-8a53-4d86-84f5-3733357d69d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db2fe46cdca148688d5f251caa760485',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:31:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:31:10Z,use_quota=True,user_id='4694a04ef1f9400faa803f73c5902cb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78f97e5a-c00d-44bf-bafd-484ccd48d6e5),volume_type_id=78f97e5a-c00d-44bf-bafd-484ccd48d6e5)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:31:09 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-0c6159ae-a215-407d-bcd6-66d450f006d5 tempest-GroupSnapshotsV319Test-2070524315 None] Creating volume 61a6e51f-8a53-4d86-84f5-3733357d69d6 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:31:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0c6159ae-a215-407d-bcd6-66d450f006d5 tempest-GroupSnapshotsV319Test-2070524315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:31:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0c6159ae-a215-407d-bcd6-66d450f006d5 tempest-GroupSnapshotsV319Test-2070524315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:31:09 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0c6159ae-a215-407d-bcd6-66d450f006d5 tempest-GroupSnapshotsV319Test-2070524315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:31:09 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0c6159ae-a215-407d-bcd6-66d450f006d5 tempest-GroupSnapshotsV319Test-2070524315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:31:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0c6159ae-a215-407d-bcd6-66d450f006d5 tempest-GroupSnapshotsV319Test-2070524315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:31:09 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0c6159ae-a215-407d-bcd6-66d450f006d5 tempest-GroupSnapshotsV319Test-2070524315 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:31:09 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-0c6159ae-a215-407d-bcd6-66d450f006d5 tempest-GroupSnapshotsV319Test-2070524315 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:31:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0c6159ae-a215-407d-bcd6-66d450f006d5 tempest-GroupSnapshotsV319Test-2070524315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-61a6e51f-8a53-4d86-84f5-3733357d69d6 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:31:10 devstack sudo[97298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-61a6e51f-8a53-4d86-84f5-3733357d69d6 1073741824
Jul 14 16:31:10 devstack sudo[97298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:31:10 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b779965-58ac-41c5-84f2-fd0209623b44 tempest-VolumeQuotasNegativeTestJSON-314251005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:31:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6b779965-58ac-41c5-84f2-fd0209623b44 tempest-VolumeQuotasNegativeTestJSON-314251005 None] Flow 'volume_create_manager' (59d9c994-83e6-4730-82e3-b57ea720548c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:31:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6b779965-58ac-41c5-84f2-fd0209623b44 tempest-VolumeQuotasNegativeTestJSON-314251005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (602cf1d8-fb5b-4a2b-ae08-5e53d39b49d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:31:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6b779965-58ac-41c5-84f2-fd0209623b44 tempest-VolumeQuotasNegativeTestJSON-314251005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (602cf1d8-fb5b-4a2b-ae08-5e53d39b49d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:31:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-97659722',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=701edff3-a915-4b81-9427-04be5a0ebec8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8924b1e9b764bd88d36f49ad72acffe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:31:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:31:10Z,use_quota=True,user_id='b082b649f49d4d6f9717118104a9b8b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:31:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6b779965-58ac-41c5-84f2-fd0209623b44 tempest-VolumeQuotasNegativeTestJSON-314251005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be7913a1-7bc1-48c1-bc00-0fd8f3e96a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:31:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6b779965-58ac-41c5-84f2-fd0209623b44 tempest-VolumeQuotasNegativeTestJSON-314251005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be7913a1-7bc1-48c1-bc00-0fd8f3e96a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:31:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6b779965-58ac-41c5-84f2-fd0209623b44 tempest-VolumeQuotasNegativeTestJSON-314251005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d0d624a-6450-4fa5-a629-685030533182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:31:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6b779965-58ac-41c5-84f2-fd0209623b44 tempest-VolumeQuotasNegativeTestJSON-314251005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d0d624a-6450-4fa5-a629-685030533182) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '701edff3-a915-4b81-9427-04be5a0ebec8', 'volume_name': 'volume-701edff3-a915-4b81-9427-04be5a0ebec8', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:31:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6b779965-58ac-41c5-84f2-fd0209623b44 tempest-VolumeQuotasNegativeTestJSON-314251005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8f8146d-506e-4fd3-80e3-dd9a50b0d1b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:31:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6b779965-58ac-41c5-84f2-fd0209623b44 tempest-VolumeQuotasNegativeTestJSON-314251005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8f8146d-506e-4fd3-80e3-dd9a50b0d1b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:31:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6b779965-58ac-41c5-84f2-fd0209623b44 tempest-VolumeQuotasNegativeTestJSON-314251005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec01eeda-1e2d-4448-82d2-2005dbccbed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:31:10 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-6b779965-58ac-41c5-84f2-fd0209623b44 tempest-VolumeQuotasNegativeTestJSON-314251005 None] Volume 701edff3-a915-4b81-9427-04be5a0ebec8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-701edff3-a915-4b81-9427-04be5a0ebec8', 'volume_size': 1}
Jul 14 16:31:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6b779965-58ac-41c5-84f2-fd0209623b44 tempest-VolumeQuotasNegativeTestJSON-314251005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:31:10 devstack sudo[97298]: pam_unix(sudo:session): session closed for user root
Jul 14 16:31:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0c6159ae-a215-407d-bcd6-66d450f006d5 tempest-GroupSnapshotsV319Test-2070524315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-61a6e51f-8a53-4d86-84f5-3733357d69d6 1073741824" returned: 0 in 0.597s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:31:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0c6159ae-a215-407d-bcd6-66d450f006d5 tempest-GroupSnapshotsV319Test-2070524315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-61a6e51f-8a53-4d86-84f5-3733357d69d6 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:31:10 devstack sudo[97304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-61a6e51f-8a53-4d86-84f5-3733357d69d6
Jul 14 16:31:10 devstack sudo[97304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:31:10 devstack sudo[97304]: pam_unix(sudo:session): session closed for user root
Jul 14 16:31:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0c6159ae-a215-407d-bcd6-66d450f006d5 tempest-GroupSnapshotsV319Test-2070524315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-61a6e51f-8a53-4d86-84f5-3733357d69d6" returned: 0 in 0.298s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:31:10 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0c6159ae-a215-407d-bcd6-66d450f006d5 tempest-GroupSnapshotsV319Test-2070524315 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:31:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0c6159ae-a215-407d-bcd6-66d450f006d5 tempest-GroupSnapshotsV319Test-2070524315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:31:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6b779965-58ac-41c5-84f2-fd0209623b44 tempest-VolumeQuotasNegativeTestJSON-314251005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.821s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:31:10 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6b779965-58ac-41c5-84f2-fd0209623b44 tempest-VolumeQuotasNegativeTestJSON-314251005 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:31:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-97659722',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=701edff3-a915-4b81-9427-04be5a0ebec8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8924b1e9b764bd88d36f49ad72acffe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:31:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:31:10Z,use_quota=True,user_id='b082b649f49d4d6f9717118104a9b8b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:31:10 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-6b779965-58ac-41c5-84f2-fd0209623b44 tempest-VolumeQuotasNegativeTestJSON-314251005 None] Creating volume 701edff3-a915-4b81-9427-04be5a0ebec8 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:31:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6b779965-58ac-41c5-84f2-fd0209623b44 tempest-VolumeQuotasNegativeTestJSON-314251005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:31:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6b779965-58ac-41c5-84f2-fd0209623b44 tempest-VolumeQuotasNegativeTestJSON-314251005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:31:10 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6b779965-58ac-41c5-84f2-fd0209623b44 tempest-VolumeQuotasNegativeTestJSON-314251005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:31:10 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6b779965-58ac-41c5-84f2-fd0209623b44 tempest-VolumeQuotasNegativeTestJSON-314251005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:31:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6b779965-58ac-41c5-84f2-fd0209623b44 tempest-VolumeQuotasNegativeTestJSON-314251005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:31:10 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6b779965-58ac-41c5-84f2-fd0209623b44 tempest-VolumeQuotasNegativeTestJSON-314251005 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:31:10 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-6b779965-58ac-41c5-84f2-fd0209623b44 tempest-VolumeQuotasNegativeTestJSON-314251005 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:31:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6b779965-58ac-41c5-84f2-fd0209623b44 tempest-VolumeQuotasNegativeTestJSON-314251005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-701edff3-a915-4b81-9427-04be5a0ebec8 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:31:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0c6159ae-a215-407d-bcd6-66d450f006d5 tempest-GroupSnapshotsV319Test-2070524315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (432c2818-d34b-4620-b7ab-427ad54b23a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61a6e51f-8a53-4d86-84f5-3733357d69d6', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:31:10 devstack sudo[97307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-701edff3-a915-4b81-9427-04be5a0ebec8 1073741824
Jul 14 16:31:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0c6159ae-a215-407d-bcd6-66d450f006d5 tempest-GroupSnapshotsV319Test-2070524315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f1265f5-5f0d-4b25-8597-7c478fdbc4a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:31:10 devstack sudo[97307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:31:11 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-0c6159ae-a215-407d-bcd6-66d450f006d5 tempest-GroupSnapshotsV319Test-2070524315 None] Volume volume-61a6e51f-8a53-4d86-84f5-3733357d69d6 (61a6e51f-8a53-4d86-84f5-3733357d69d6): created successfully
Jul 14 16:31:11 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0c6159ae-a215-407d-bcd6-66d450f006d5 tempest-GroupSnapshotsV319Test-2070524315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f1265f5-5f0d-4b25-8597-7c478fdbc4a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:31:11 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0c6159ae-a215-407d-bcd6-66d450f006d5 tempest-GroupSnapshotsV319Test-2070524315 None] Flow 'volume_create_manager' (22c78eaa-7978-433b-a2a8-d9079309401d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:31:11 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-0c6159ae-a215-407d-bcd6-66d450f006d5 tempest-GroupSnapshotsV319Test-2070524315 None] Created volume successfully.
Jul 14 16:31:11 devstack sudo[97307]: pam_unix(sudo:session): session closed for user root
Jul 14 16:31:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6b779965-58ac-41c5-84f2-fd0209623b44 tempest-VolumeQuotasNegativeTestJSON-314251005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-701edff3-a915-4b81-9427-04be5a0ebec8 1073741824" returned: 0 in 0.565s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:31:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6b779965-58ac-41c5-84f2-fd0209623b44 tempest-VolumeQuotasNegativeTestJSON-314251005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-701edff3-a915-4b81-9427-04be5a0ebec8 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:31:11 devstack sudo[97319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-701edff3-a915-4b81-9427-04be5a0ebec8
Jul 14 16:31:11 devstack sudo[97319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:31:11 devstack sudo[97319]: pam_unix(sudo:session): session closed for user root
Jul 14 16:31:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6b779965-58ac-41c5-84f2-fd0209623b44 tempest-VolumeQuotasNegativeTestJSON-314251005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-701edff3-a915-4b81-9427-04be5a0ebec8" returned: 0 in 0.293s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:31:11 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6b779965-58ac-41c5-84f2-fd0209623b44 tempest-VolumeQuotasNegativeTestJSON-314251005 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:31:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6b779965-58ac-41c5-84f2-fd0209623b44 tempest-VolumeQuotasNegativeTestJSON-314251005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:31:11 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6b779965-58ac-41c5-84f2-fd0209623b44 tempest-VolumeQuotasNegativeTestJSON-314251005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec01eeda-1e2d-4448-82d2-2005dbccbed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-701edff3-a915-4b81-9427-04be5a0ebec8', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:31:11 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6b779965-58ac-41c5-84f2-fd0209623b44 tempest-VolumeQuotasNegativeTestJSON-314251005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02a3e78c-66ad-4a15-a0a2-1fd7ce8ceddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:31:11 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-6b779965-58ac-41c5-84f2-fd0209623b44 tempest-VolumeQuotasNegativeTestJSON-314251005 None] Volume volume-701edff3-a915-4b81-9427-04be5a0ebec8 (701edff3-a915-4b81-9427-04be5a0ebec8): created successfully
Jul 14 16:31:11 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6b779965-58ac-41c5-84f2-fd0209623b44 tempest-VolumeQuotasNegativeTestJSON-314251005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02a3e78c-66ad-4a15-a0a2-1fd7ce8ceddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:31:11 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6b779965-58ac-41c5-84f2-fd0209623b44 tempest-VolumeQuotasNegativeTestJSON-314251005 None] Flow 'volume_create_manager' (59d9c994-83e6-4730-82e3-b57ea720548c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:31:11 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-6b779965-58ac-41c5-84f2-fd0209623b44 tempest-VolumeQuotasNegativeTestJSON-314251005 None] Created volume successfully.
Jul 14 16:31:12 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-04494b5d-cd8f-4bd5-ac99-9f19f90a7cf5 tempest-GroupSnapshotsV319Test-2070524315 None] GroupSnapshot 0559013b-d563-4b40-a227-56ed057e715f: creating.
Jul 14 16:31:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-04494b5d-cd8f-4bd5-ac99-9f19f90a7cf5 tempest-GroupSnapshotsV319Test-2070524315 None] Group snapshot 0559013b-d563-4b40-a227-56ed057e715f: creating. {{(pid=87166) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 14 16:31:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-04494b5d-cd8f-4bd5-ac99-9f19f90a7cf5 tempest-GroupSnapshotsV319Test-2070524315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:31:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-04494b5d-cd8f-4bd5-ac99-9f19f90a7cf5 tempest-GroupSnapshotsV319Test-2070524315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:31:12 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-04494b5d-cd8f-4bd5-ac99-9f19f90a7cf5 tempest-GroupSnapshotsV319Test-2070524315 None] Creating offline snapshot 07ca367b-f606-44c5-bec7-bf08a4870e42 of volume 61a6e51f-8a53-4d86-84f5-3733357d69d6 {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 16:31:12 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[2efe4fbf-5687-4599-8fd3-151d30d2fe13]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:31:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-04494b5d-cd8f-4bd5-ac99-9f19f90a7cf5 tempest-GroupSnapshotsV319Test-2070524315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-61a6e51f-8a53-4d86-84f5-3733357d69d6 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:31:12 devstack sudo[97322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-61a6e51f-8a53-4d86-84f5-3733357d69d6
Jul 14 16:31:12 devstack sudo[97322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:31:12 devstack sudo[97322]: pam_unix(sudo:session): session closed for user root
Jul 14 16:31:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-04494b5d-cd8f-4bd5-ac99-9f19f90a7cf5 tempest-GroupSnapshotsV319Test-2070524315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-61a6e51f-8a53-4d86-84f5-3733357d69d6" returned: 0 in 0.417s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:31:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-04494b5d-cd8f-4bd5-ac99-9f19f90a7cf5 tempest-GroupSnapshotsV319Test-2070524315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-61a6e51f-8a53-4d86-84f5-3733357d69d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-61a6e51f-8a53-4d86-84f5-3733357d69d6.07ca367b-f606-44c5-bec7-bf08a4870e42 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:31:12 devstack sudo[97328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-61a6e51f-8a53-4d86-84f5-3733357d69d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-61a6e51f-8a53-4d86-84f5-3733357d69d6.07ca367b-f606-44c5-bec7-bf08a4870e42 1G
Jul 14 16:31:12 devstack sudo[97328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:31:13 devstack sudo[97328]: pam_unix(sudo:session): session closed for user root
Jul 14 16:31:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-04494b5d-cd8f-4bd5-ac99-9f19f90a7cf5 tempest-GroupSnapshotsV319Test-2070524315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-61a6e51f-8a53-4d86-84f5-3733357d69d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-61a6e51f-8a53-4d86-84f5-3733357d69d6.07ca367b-f606-44c5-bec7-bf08a4870e42 1G" returned: 0 in 0.500s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:31:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-04494b5d-cd8f-4bd5-ac99-9f19f90a7cf5 tempest-GroupSnapshotsV319Test-2070524315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61a6e51f-8a53-4d86-84f5-3733357d69d6 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-61a6e51f-8a53-4d86-84f5-3733357d69d6.07ca367b-f606-44c5-bec7-bf08a4870e42 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:31:13 devstack sudo[97334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61a6e51f-8a53-4d86-84f5-3733357d69d6 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-61a6e51f-8a53-4d86-84f5-3733357d69d6.07ca367b-f606-44c5-bec7-bf08a4870e42
Jul 14 16:31:13 devstack sudo[97334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:31:13 devstack sudo[97334]: pam_unix(sudo:session): session closed for user root
Jul 14 16:31:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-04494b5d-cd8f-4bd5-ac99-9f19f90a7cf5 tempest-GroupSnapshotsV319Test-2070524315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61a6e51f-8a53-4d86-84f5-3733357d69d6 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-61a6e51f-8a53-4d86-84f5-3733357d69d6.07ca367b-f606-44c5-bec7-bf08a4870e42" returned: 0 in 0.435s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:31:13 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-04494b5d-cd8f-4bd5-ac99-9f19f90a7cf5 tempest-GroupSnapshotsV319Test-2070524315 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-61a6e51f-8a53-4d86-84f5-3733357d69d6.07ca367b-f606-44c5-bec7-bf08a4870e42 is being set with open permissions: ugo+rw: NotImplementedError
Jul 14 16:31:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-04494b5d-cd8f-4bd5-ac99-9f19f90a7cf5 tempest-GroupSnapshotsV319Test-2070524315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-61a6e51f-8a53-4d86-84f5-3733357d69d6.07ca367b-f606-44c5-bec7-bf08a4870e42 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:31:13 devstack sudo[97339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-61a6e51f-8a53-4d86-84f5-3733357d69d6.07ca367b-f606-44c5-bec7-bf08a4870e42
Jul 14 16:31:13 devstack sudo[97339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:31:14 devstack sudo[97339]: pam_unix(sudo:session): session closed for user root
Jul 14 16:31:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-04494b5d-cd8f-4bd5-ac99-9f19f90a7cf5 tempest-GroupSnapshotsV319Test-2070524315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-61a6e51f-8a53-4d86-84f5-3733357d69d6.07ca367b-f606-44c5-bec7-bf08a4870e42" returned: 0 in 0.385s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:31:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-04494b5d-cd8f-4bd5-ac99-9f19f90a7cf5 tempest-GroupSnapshotsV319Test-2070524315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-61a6e51f-8a53-4d86-84f5-3733357d69d6.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:31:14 devstack sudo[97342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-61a6e51f-8a53-4d86-84f5-3733357d69d6.info
Jul 14 16:31:14 devstack sudo[97342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:31:14 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f3521b7f-065d-4c9a-8652-af8ee36353f9 tempest-VolumeQuotasNegativeTestJSON-314251005 None] Acquiring lock "cinder-701edff3-a915-4b81-9427-04be5a0ebec8-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:31:14 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f3521b7f-065d-4c9a-8652-af8ee36353f9 tempest-VolumeQuotasNegativeTestJSON-314251005 None] Lock "cinder-701edff3-a915-4b81-9427-04be5a0ebec8-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:31:14 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f3521b7f-065d-4c9a-8652-af8ee36353f9 tempest-VolumeQuotasNegativeTestJSON-314251005 None] Acquiring lock "cinder-quobyte-701edff3-a915-4b81-9427-04be5a0ebec8" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:31:14 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f3521b7f-065d-4c9a-8652-af8ee36353f9 tempest-VolumeQuotasNegativeTestJSON-314251005 None] Lock "cinder-quobyte-701edff3-a915-4b81-9427-04be5a0ebec8" acquired by "delete_volume" :: waited 0.024s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:31:14 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[af4e4695-d725-451e-bd61-6cf5184746c6]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:31:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f3521b7f-065d-4c9a-8652-af8ee36353f9 tempest-VolumeQuotasNegativeTestJSON-314251005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-701edff3-a915-4b81-9427-04be5a0ebec8 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:31:14 devstack sudo[97342]: pam_unix(sudo:session): session closed for user root
Jul 14 16:31:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-04494b5d-cd8f-4bd5-ac99-9f19f90a7cf5 tempest-GroupSnapshotsV319Test-2070524315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-61a6e51f-8a53-4d86-84f5-3733357d69d6.info" returned: 0 in 0.349s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:31:14 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-04494b5d-cd8f-4bd5-ac99-9f19f90a7cf5 tempest-GroupSnapshotsV319Test-2070524315 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-61a6e51f-8a53-4d86-84f5-3733357d69d6.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 14 16:31:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-04494b5d-cd8f-4bd5-ac99-9f19f90a7cf5 tempest-GroupSnapshotsV319Test-2070524315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-61a6e51f-8a53-4d86-84f5-3733357d69d6.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:31:14 devstack sudo[97346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-61a6e51f-8a53-4d86-84f5-3733357d69d6.info
Jul 14 16:31:14 devstack sudo[97346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:31:14 devstack sudo[97344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-701edff3-a915-4b81-9427-04be5a0ebec8
Jul 14 16:31:14 devstack sudo[97344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:31:14 devstack sudo[97346]: pam_unix(sudo:session): session closed for user root
Jul 14 16:31:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-04494b5d-cd8f-4bd5-ac99-9f19f90a7cf5 tempest-GroupSnapshotsV319Test-2070524315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-61a6e51f-8a53-4d86-84f5-3733357d69d6.info" returned: 0 in 0.321s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:31:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-04494b5d-cd8f-4bd5-ac99-9f19f90a7cf5 tempest-GroupSnapshotsV319Test-2070524315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.537s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:31:15 devstack sudo[97344]: pam_unix(sudo:session): session closed for user root
Jul 14 16:31:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f3521b7f-065d-4c9a-8652-af8ee36353f9 tempest-VolumeQuotasNegativeTestJSON-314251005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-701edff3-a915-4b81-9427-04be5a0ebec8" returned: 0 in 0.503s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:31:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f3521b7f-065d-4c9a-8652-af8ee36353f9 tempest-VolumeQuotasNegativeTestJSON-314251005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-701edff3-a915-4b81-9427-04be5a0ebec8 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:31:15 devstack sudo[97353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-701edff3-a915-4b81-9427-04be5a0ebec8
Jul 14 16:31:15 devstack sudo[97353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:31:15 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-04494b5d-cd8f-4bd5-ac99-9f19f90a7cf5 tempest-GroupSnapshotsV319Test-2070524315 None] group_snapshot 0559013b-d563-4b40-a227-56ed057e715f: created successfully
Jul 14 16:31:15 devstack sudo[97353]: pam_unix(sudo:session): session closed for user root
Jul 14 16:31:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f3521b7f-065d-4c9a-8652-af8ee36353f9 tempest-VolumeQuotasNegativeTestJSON-314251005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-701edff3-a915-4b81-9427-04be5a0ebec8" returned: 0 in 0.274s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:31:15 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f3521b7f-065d-4c9a-8652-af8ee36353f9 tempest-VolumeQuotasNegativeTestJSON-314251005 None] Lock "cinder-quobyte-701edff3-a915-4b81-9427-04be5a0ebec8" released by "delete_volume" :: held 0.845s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:31:15 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-f3521b7f-065d-4c9a-8652-af8ee36353f9 tempest-VolumeQuotasNegativeTestJSON-314251005 None] Created reservations ['42bc85d8-d6d1-48ae-beb0-2f797409bf17', '8984b158-b22a-4a1c-97c4-897ead7049b8', '969f67e2-e854-4d8d-8773-da0dba628452', '067d1728-14a8-47ee-99d6-93df638b96fe'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:31:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f3521b7f-065d-4c9a-8652-af8ee36353f9 tempest-VolumeQuotasNegativeTestJSON-314251005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:31:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f3521b7f-065d-4c9a-8652-af8ee36353f9 tempest-VolumeQuotasNegativeTestJSON-314251005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:31:15 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f3521b7f-065d-4c9a-8652-af8ee36353f9 tempest-VolumeQuotasNegativeTestJSON-314251005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:31:15 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f3521b7f-065d-4c9a-8652-af8ee36353f9 tempest-VolumeQuotasNegativeTestJSON-314251005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:31:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f3521b7f-065d-4c9a-8652-af8ee36353f9 tempest-VolumeQuotasNegativeTestJSON-314251005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:31:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f3521b7f-065d-4c9a-8652-af8ee36353f9 tempest-VolumeQuotasNegativeTestJSON-314251005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:31:15 devstack sudo[97356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:31:15 devstack sudo[97356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:31:15 devstack sudo[97356]: pam_unix(sudo:session): session closed for user root
Jul 14 16:31:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f3521b7f-065d-4c9a-8652-af8ee36353f9 tempest-VolumeQuotasNegativeTestJSON-314251005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.430s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:31:15 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-f3521b7f-065d-4c9a-8652-af8ee36353f9 tempest-VolumeQuotasNegativeTestJSON-314251005 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:31:15 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-f3521b7f-065d-4c9a-8652-af8ee36353f9 tempest-VolumeQuotasNegativeTestJSON-314251005 None] Deleted volume successfully.
Jul 14 16:31:15 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f3521b7f-065d-4c9a-8652-af8ee36353f9 tempest-VolumeQuotasNegativeTestJSON-314251005 None] Lock "cinder-701edff3-a915-4b81-9427-04be5a0ebec8-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:31:16 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-73343600-ce01-4b9c-a0b5-8474e39bad67 tempest-GroupSnapshotsV319Test-2070524315 None] group_snapshot 0559013b-d563-4b40-a227-56ed057e715f: deleting
Jul 14 16:31:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-73343600-ce01-4b9c-a0b5-8474e39bad67 tempest-GroupSnapshotsV319Test-2070524315 None] group_snapshot 0559013b-d563-4b40-a227-56ed057e715f: deleting {{(pid=87166) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 14 16:31:16 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-73343600-ce01-4b9c-a0b5-8474e39bad67 tempest-GroupSnapshotsV319Test-2070524315 None] Acquiring lock "cinder-quobyte-61a6e51f-8a53-4d86-84f5-3733357d69d6" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:31:16 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-73343600-ce01-4b9c-a0b5-8474e39bad67 tempest-GroupSnapshotsV319Test-2070524315 None] Lock "cinder-quobyte-61a6e51f-8a53-4d86-84f5-3733357d69d6" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:31:16 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-73343600-ce01-4b9c-a0b5-8474e39bad67 tempest-GroupSnapshotsV319Test-2070524315 None] Acquiring lock "cinder-quobyte-07ca367b-f606-44c5-bec7-bf08a4870e42" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:31:16 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-73343600-ce01-4b9c-a0b5-8474e39bad67 tempest-GroupSnapshotsV319Test-2070524315 None] Lock "cinder-quobyte-07ca367b-f606-44c5-bec7-bf08a4870e42" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:31:16 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-73343600-ce01-4b9c-a0b5-8474e39bad67 tempest-GroupSnapshotsV319Test-2070524315 None] Deleting offline snapshot 07ca367b-f606-44c5-bec7-bf08a4870e42 of volume 61a6e51f-8a53-4d86-84f5-3733357d69d6 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 16:31:16 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-73343600-ce01-4b9c-a0b5-8474e39bad67 tempest-GroupSnapshotsV319Test-2070524315 None] snapshot_file for this snap is: volume-61a6e51f-8a53-4d86-84f5-3733357d69d6.07ca367b-f606-44c5-bec7-bf08a4870e42 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 16:31:16 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6348344-ad6a-42e8-9318-5bb130837e4a]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:31:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-73343600-ce01-4b9c-a0b5-8474e39bad67 tempest-GroupSnapshotsV319Test-2070524315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-61a6e51f-8a53-4d86-84f5-3733357d69d6.07ca367b-f606-44c5-bec7-bf08a4870e42 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:31:16 devstack sudo[97360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-61a6e51f-8a53-4d86-84f5-3733357d69d6.07ca367b-f606-44c5-bec7-bf08a4870e42
Jul 14 16:31:16 devstack sudo[97360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:31:16 devstack sudo[97360]: pam_unix(sudo:session): session closed for user root
Jul 14 16:31:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-73343600-ce01-4b9c-a0b5-8474e39bad67 tempest-GroupSnapshotsV319Test-2070524315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-61a6e51f-8a53-4d86-84f5-3733357d69d6.07ca367b-f606-44c5-bec7-bf08a4870e42" returned: 0 in 0.493s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:31:16 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-73343600-ce01-4b9c-a0b5-8474e39bad67 tempest-GroupSnapshotsV319Test-2070524315 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61a6e51f-8a53-4d86-84f5-3733357d69d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 16:31:17 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c09d56-2e97-4891-8658-94291c945859]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:31:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-73343600-ce01-4b9c-a0b5-8474e39bad67 tempest-GroupSnapshotsV319Test-2070524315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-61a6e51f-8a53-4d86-84f5-3733357d69d6 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:31:17 devstack sudo[97365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-61a6e51f-8a53-4d86-84f5-3733357d69d6
Jul 14 16:31:17 devstack sudo[97365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:31:17 devstack sudo[97365]: pam_unix(sudo:session): session closed for user root
Jul 14 16:31:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-73343600-ce01-4b9c-a0b5-8474e39bad67 tempest-GroupSnapshotsV319Test-2070524315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-61a6e51f-8a53-4d86-84f5-3733357d69d6" returned: 0 in 0.479s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:31:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-73343600-ce01-4b9c-a0b5-8474e39bad67 tempest-GroupSnapshotsV319Test-2070524315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-61a6e51f-8a53-4d86-84f5-3733357d69d6.07ca367b-f606-44c5-bec7-bf08a4870e42 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:31:17 devstack sudo[97371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-61a6e51f-8a53-4d86-84f5-3733357d69d6.07ca367b-f606-44c5-bec7-bf08a4870e42
Jul 14 16:31:17 devstack sudo[97371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:31:18 devstack sudo[97371]: pam_unix(sudo:session): session closed for user root
Jul 14 16:31:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-73343600-ce01-4b9c-a0b5-8474e39bad67 tempest-GroupSnapshotsV319Test-2070524315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-61a6e51f-8a53-4d86-84f5-3733357d69d6.07ca367b-f606-44c5-bec7-bf08a4870e42" returned: 0 in 0.579s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:31:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-73343600-ce01-4b9c-a0b5-8474e39bad67 tempest-GroupSnapshotsV319Test-2070524315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-61a6e51f-8a53-4d86-84f5-3733357d69d6.07ca367b-f606-44c5-bec7-bf08a4870e42 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:31:18 devstack sudo[97376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-61a6e51f-8a53-4d86-84f5-3733357d69d6.07ca367b-f606-44c5-bec7-bf08a4870e42
Jul 14 16:31:18 devstack sudo[97376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:31:18 devstack sudo[97376]: pam_unix(sudo:session): session closed for user root
Jul 14 16:31:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-73343600-ce01-4b9c-a0b5-8474e39bad67 tempest-GroupSnapshotsV319Test-2070524315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-61a6e51f-8a53-4d86-84f5-3733357d69d6.07ca367b-f606-44c5-bec7-bf08a4870e42" returned: 0 in 0.337s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:31:18 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-73343600-ce01-4b9c-a0b5-8474e39bad67 tempest-GroupSnapshotsV319Test-2070524315 None] Lock "cinder-quobyte-07ca367b-f606-44c5-bec7-bf08a4870e42" released by "_delete_snapshot" :: held 2.056s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:31:18 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-73343600-ce01-4b9c-a0b5-8474e39bad67 tempest-GroupSnapshotsV319Test-2070524315 None] Lock "cinder-quobyte-61a6e51f-8a53-4d86-84f5-3733357d69d6" released by "delete_snapshot" :: held 2.105s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:31:18 devstack cinder-volume[87166]: WARNING cinder.quota [None req-73343600-ce01-4b9c-a0b5-8474e39bad67 tempest-GroupSnapshotsV319Test-2070524315 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-627603075 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-627603075, it is now deprecated. Please use the default quota class for default quota.
Jul 14 16:31:18 devstack cinder-volume[87166]: WARNING cinder.quota [None req-73343600-ce01-4b9c-a0b5-8474e39bad67 tempest-GroupSnapshotsV319Test-2070524315 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-627603075 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-627603075, it is now deprecated. Please use the default quota class for default quota.
Jul 14 16:31:18 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-73343600-ce01-4b9c-a0b5-8474e39bad67 tempest-GroupSnapshotsV319Test-2070524315 None] Created reservations ['186bef10-7e20-4cbe-bb29-f408a970bec9', '4ac1fdb8-5213-49ee-8792-495e54bff71a', 'bbad2213-0731-40f9-880d-86ab8789625d', '00c8be93-1cdc-4342-8885-c6c77628bf9d'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:31:18 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-73343600-ce01-4b9c-a0b5-8474e39bad67 tempest-GroupSnapshotsV319Test-2070524315 None] group_snapshot 0559013b-d563-4b40-a227-56ed057e715f: deleted successfully
Jul 14 16:31:19 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d0017905-47e8-42cd-92f9-16bfee0ba8dd tempest-GroupSnapshotsV319Test-2070524315 None] Acquiring lock "cinder-quobyte-61a6e51f-8a53-4d86-84f5-3733357d69d6" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:31:19 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d0017905-47e8-42cd-92f9-16bfee0ba8dd tempest-GroupSnapshotsV319Test-2070524315 None] Lock "cinder-quobyte-61a6e51f-8a53-4d86-84f5-3733357d69d6" acquired by "delete_volume" :: waited 0.019s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:31:19 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[92bf0bfc-5121-411f-bfd9-dbe63811c3f3]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:31:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d0017905-47e8-42cd-92f9-16bfee0ba8dd tempest-GroupSnapshotsV319Test-2070524315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-61a6e51f-8a53-4d86-84f5-3733357d69d6 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:31:19 devstack sudo[97380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-61a6e51f-8a53-4d86-84f5-3733357d69d6
Jul 14 16:31:19 devstack sudo[97380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:31:19 devstack sudo[97380]: pam_unix(sudo:session): session closed for user root
Jul 14 16:31:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d0017905-47e8-42cd-92f9-16bfee0ba8dd tempest-GroupSnapshotsV319Test-2070524315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-61a6e51f-8a53-4d86-84f5-3733357d69d6" returned: 0 in 0.528s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:31:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d0017905-47e8-42cd-92f9-16bfee0ba8dd tempest-GroupSnapshotsV319Test-2070524315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-61a6e51f-8a53-4d86-84f5-3733357d69d6 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:31:19 devstack sudo[97385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-61a6e51f-8a53-4d86-84f5-3733357d69d6
Jul 14 16:31:19 devstack sudo[97385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:31:20 devstack sudo[97385]: pam_unix(sudo:session): session closed for user root
Jul 14 16:31:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d0017905-47e8-42cd-92f9-16bfee0ba8dd tempest-GroupSnapshotsV319Test-2070524315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-61a6e51f-8a53-4d86-84f5-3733357d69d6" returned: 0 in 0.556s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:31:20 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d0017905-47e8-42cd-92f9-16bfee0ba8dd tempest-GroupSnapshotsV319Test-2070524315 None] Lock "cinder-quobyte-61a6e51f-8a53-4d86-84f5-3733357d69d6" released by "delete_volume" :: held 1.176s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:31:20 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-d0017905-47e8-42cd-92f9-16bfee0ba8dd tempest-GroupSnapshotsV319Test-2070524315 None] Created reservations ['cfce3503-5e8c-404e-95fd-c967f8e45149'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:31:20 devstack cinder-volume[87166]: WARNING cinder.quota [None req-d0017905-47e8-42cd-92f9-16bfee0ba8dd tempest-GroupSnapshotsV319Test-2070524315 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-627603075 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-627603075, it is now deprecated. Please use the default quota class for default quota.
Jul 14 16:31:20 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-d0017905-47e8-42cd-92f9-16bfee0ba8dd tempest-GroupSnapshotsV319Test-2070524315 None] Created reservations ['2ae7c471-b7ff-4934-9a8c-f1c7b5f18a99', '1859afd1-443d-4ab2-bc58-f0965b86332c', '75e35a70-3380-426e-9243-dbdd94298d66', 'd0d54f47-47f2-4117-84c8-12e17c3c2286'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:31:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d0017905-47e8-42cd-92f9-16bfee0ba8dd tempest-GroupSnapshotsV319Test-2070524315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:31:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d0017905-47e8-42cd-92f9-16bfee0ba8dd tempest-GroupSnapshotsV319Test-2070524315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:31:20 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d0017905-47e8-42cd-92f9-16bfee0ba8dd tempest-GroupSnapshotsV319Test-2070524315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:31:20 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d0017905-47e8-42cd-92f9-16bfee0ba8dd tempest-GroupSnapshotsV319Test-2070524315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:31:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d0017905-47e8-42cd-92f9-16bfee0ba8dd tempest-GroupSnapshotsV319Test-2070524315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:31:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d0017905-47e8-42cd-92f9-16bfee0ba8dd tempest-GroupSnapshotsV319Test-2070524315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:31:20 devstack sudo[97388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:31:20 devstack sudo[97388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:31:21 devstack sudo[97388]: pam_unix(sudo:session): session closed for user root
Jul 14 16:31:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d0017905-47e8-42cd-92f9-16bfee0ba8dd tempest-GroupSnapshotsV319Test-2070524315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.300s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:31:21 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-d0017905-47e8-42cd-92f9-16bfee0ba8dd tempest-GroupSnapshotsV319Test-2070524315 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:31:21 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-d0017905-47e8-42cd-92f9-16bfee0ba8dd tempest-GroupSnapshotsV319Test-2070524315 None] Delete group completed successfully.
Jul 14 16:31:28 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8a867a6-c25c-4e87-ac5e-60198cbf29c4 tempest-VolumesListAdminTestJSON-11684788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:31:28 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a8a867a6-c25c-4e87-ac5e-60198cbf29c4 tempest-VolumesListAdminTestJSON-11684788 None] Flow 'volume_create_manager' (c4b95a45-f9e2-4e14-9dcd-76821c8a73ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:31:28 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a8a867a6-c25c-4e87-ac5e-60198cbf29c4 tempest-VolumesListAdminTestJSON-11684788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78f8cdda-0824-418a-b714-a46c399b0924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:31:28 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a8a867a6-c25c-4e87-ac5e-60198cbf29c4 tempest-VolumesListAdminTestJSON-11684788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78f8cdda-0824-418a-b714-a46c399b0924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:31:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1041801383',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80be107f-f157-48b3-97cb-a6852c5993b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc89effaaa4b4ed7b6a064733f932daa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:31:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:31:28Z,use_quota=True,user_id='7baded35edec4b21a78cf2efc323fdf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:31:28 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a8a867a6-c25c-4e87-ac5e-60198cbf29c4 tempest-VolumesListAdminTestJSON-11684788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (289f80e7-68b7-4339-b933-526b2c58e8e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:31:28 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a8a867a6-c25c-4e87-ac5e-60198cbf29c4 tempest-VolumesListAdminTestJSON-11684788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (289f80e7-68b7-4339-b933-526b2c58e8e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:31:28 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a8a867a6-c25c-4e87-ac5e-60198cbf29c4 tempest-VolumesListAdminTestJSON-11684788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11b80b8c-3601-4529-91ea-ed00925f06f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:31:28 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a8a867a6-c25c-4e87-ac5e-60198cbf29c4 tempest-VolumesListAdminTestJSON-11684788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11b80b8c-3601-4529-91ea-ed00925f06f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80be107f-f157-48b3-97cb-a6852c5993b3', 'volume_name': 'volume-80be107f-f157-48b3-97cb-a6852c5993b3', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:31:28 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a8a867a6-c25c-4e87-ac5e-60198cbf29c4 tempest-VolumesListAdminTestJSON-11684788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (021cac10-77df-4e3f-930f-adbe9770d8b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:31:28 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a8a867a6-c25c-4e87-ac5e-60198cbf29c4 tempest-VolumesListAdminTestJSON-11684788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (021cac10-77df-4e3f-930f-adbe9770d8b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:31:28 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a8a867a6-c25c-4e87-ac5e-60198cbf29c4 tempest-VolumesListAdminTestJSON-11684788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (562ed7c1-a3fc-4031-919d-54f708c24a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:31:28 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-a8a867a6-c25c-4e87-ac5e-60198cbf29c4 tempest-VolumesListAdminTestJSON-11684788 None] Volume 80be107f-f157-48b3-97cb-a6852c5993b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80be107f-f157-48b3-97cb-a6852c5993b3', 'volume_size': 1}
Jul 14 16:31:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a8a867a6-c25c-4e87-ac5e-60198cbf29c4 tempest-VolumesListAdminTestJSON-11684788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:31:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a8a867a6-c25c-4e87-ac5e-60198cbf29c4 tempest-VolumesListAdminTestJSON-11684788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:31:28 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a8a867a6-c25c-4e87-ac5e-60198cbf29c4 tempest-VolumesListAdminTestJSON-11684788 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:31:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1041801383',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80be107f-f157-48b3-97cb-a6852c5993b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc89effaaa4b4ed7b6a064733f932daa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:31:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:31:28Z,use_quota=True,user_id='7baded35edec4b21a78cf2efc323fdf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:31:28 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-a8a867a6-c25c-4e87-ac5e-60198cbf29c4 tempest-VolumesListAdminTestJSON-11684788 None] Creating volume 80be107f-f157-48b3-97cb-a6852c5993b3 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:31:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a8a867a6-c25c-4e87-ac5e-60198cbf29c4 tempest-VolumesListAdminTestJSON-11684788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:31:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a8a867a6-c25c-4e87-ac5e-60198cbf29c4 tempest-VolumesListAdminTestJSON-11684788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:31:28 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a8a867a6-c25c-4e87-ac5e-60198cbf29c4 tempest-VolumesListAdminTestJSON-11684788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:31:28 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a8a867a6-c25c-4e87-ac5e-60198cbf29c4 tempest-VolumesListAdminTestJSON-11684788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:31:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a8a867a6-c25c-4e87-ac5e-60198cbf29c4 tempest-VolumesListAdminTestJSON-11684788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:31:28 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a8a867a6-c25c-4e87-ac5e-60198cbf29c4 tempest-VolumesListAdminTestJSON-11684788 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:31:28 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-a8a867a6-c25c-4e87-ac5e-60198cbf29c4 tempest-VolumesListAdminTestJSON-11684788 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:31:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a8a867a6-c25c-4e87-ac5e-60198cbf29c4 tempest-VolumesListAdminTestJSON-11684788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-80be107f-f157-48b3-97cb-a6852c5993b3 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:31:28 devstack sudo[97391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-80be107f-f157-48b3-97cb-a6852c5993b3 1073741824
Jul 14 16:31:28 devstack sudo[97391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:31:29 devstack sudo[97391]: pam_unix(sudo:session): session closed for user root
Jul 14 16:31:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a8a867a6-c25c-4e87-ac5e-60198cbf29c4 tempest-VolumesListAdminTestJSON-11684788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-80be107f-f157-48b3-97cb-a6852c5993b3 1073741824" returned: 0 in 0.784s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:31:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a8a867a6-c25c-4e87-ac5e-60198cbf29c4 tempest-VolumesListAdminTestJSON-11684788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-80be107f-f157-48b3-97cb-a6852c5993b3 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:31:29 devstack sudo[97398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-80be107f-f157-48b3-97cb-a6852c5993b3
Jul 14 16:31:29 devstack sudo[97398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:31:29 devstack sudo[97398]: pam_unix(sudo:session): session closed for user root
Jul 14 16:31:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a8a867a6-c25c-4e87-ac5e-60198cbf29c4 tempest-VolumesListAdminTestJSON-11684788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-80be107f-f157-48b3-97cb-a6852c5993b3" returned: 0 in 0.380s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:31:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a8a867a6-c25c-4e87-ac5e-60198cbf29c4 tempest-VolumesListAdminTestJSON-11684788 None] <== create_volume: return (1229ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:31:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a8a867a6-c25c-4e87-ac5e-60198cbf29c4 tempest-VolumesListAdminTestJSON-11684788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.234s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:31:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a8a867a6-c25c-4e87-ac5e-60198cbf29c4 tempest-VolumesListAdminTestJSON-11684788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (562ed7c1-a3fc-4031-919d-54f708c24a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80be107f-f157-48b3-97cb-a6852c5993b3', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:31:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a8a867a6-c25c-4e87-ac5e-60198cbf29c4 tempest-VolumesListAdminTestJSON-11684788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c991a54-ad40-4de2-b24b-85d15ee79f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:31:29 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-a8a867a6-c25c-4e87-ac5e-60198cbf29c4 tempest-VolumesListAdminTestJSON-11684788 None] Volume volume-80be107f-f157-48b3-97cb-a6852c5993b3 (80be107f-f157-48b3-97cb-a6852c5993b3): created successfully
Jul 14 16:31:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a8a867a6-c25c-4e87-ac5e-60198cbf29c4 tempest-VolumesListAdminTestJSON-11684788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c991a54-ad40-4de2-b24b-85d15ee79f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:31:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a8a867a6-c25c-4e87-ac5e-60198cbf29c4 tempest-VolumesListAdminTestJSON-11684788 None] Flow 'volume_create_manager' (c4b95a45-f9e2-4e14-9dcd-76821c8a73ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:31:29 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-a8a867a6-c25c-4e87-ac5e-60198cbf29c4 tempest-VolumesListAdminTestJSON-11684788 None] Created volume successfully.
Jul 14 16:31:31 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c5faff5-3654-4df1-9fbb-a3df2f970f02 tempest-VolumesListAdminTestJSON-11684788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:31:31 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6c5faff5-3654-4df1-9fbb-a3df2f970f02 tempest-VolumesListAdminTestJSON-11684788 None] Flow 'volume_create_manager' (e58a9239-0666-4b2b-9910-7270d3b8fbb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:31:31 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6c5faff5-3654-4df1-9fbb-a3df2f970f02 tempest-VolumesListAdminTestJSON-11684788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37835dc6-100c-4228-8625-4ad8db506bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:31:31 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6c5faff5-3654-4df1-9fbb-a3df2f970f02 tempest-VolumesListAdminTestJSON-11684788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37835dc6-100c-4228-8625-4ad8db506bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:31:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-271813462',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd63253f-35e6-43a9-834d-709345a0ad0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc89effaaa4b4ed7b6a064733f932daa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:31:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:31:31Z,use_quota=True,user_id='7baded35edec4b21a78cf2efc323fdf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:31:31 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6c5faff5-3654-4df1-9fbb-a3df2f970f02 tempest-VolumesListAdminTestJSON-11684788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33df19d7-6ae7-4931-bfef-8c6fbb591d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:31:31 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6c5faff5-3654-4df1-9fbb-a3df2f970f02 tempest-VolumesListAdminTestJSON-11684788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33df19d7-6ae7-4931-bfef-8c6fbb591d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:31:31 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6c5faff5-3654-4df1-9fbb-a3df2f970f02 tempest-VolumesListAdminTestJSON-11684788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3851f52-eaa4-4b59-aab0-01e08c529c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:31:31 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6c5faff5-3654-4df1-9fbb-a3df2f970f02 tempest-VolumesListAdminTestJSON-11684788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3851f52-eaa4-4b59-aab0-01e08c529c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd63253f-35e6-43a9-834d-709345a0ad0a', 'volume_name': 'volume-cd63253f-35e6-43a9-834d-709345a0ad0a', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:31:31 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6c5faff5-3654-4df1-9fbb-a3df2f970f02 tempest-VolumesListAdminTestJSON-11684788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a36f4a7-f344-4fba-ba27-90502e5e5d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:31:31 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6c5faff5-3654-4df1-9fbb-a3df2f970f02 tempest-VolumesListAdminTestJSON-11684788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a36f4a7-f344-4fba-ba27-90502e5e5d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:31:31 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6c5faff5-3654-4df1-9fbb-a3df2f970f02 tempest-VolumesListAdminTestJSON-11684788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ffdeca1-1aa2-487c-a507-41660ae8dc52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:31:31 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-6c5faff5-3654-4df1-9fbb-a3df2f970f02 tempest-VolumesListAdminTestJSON-11684788 None] Volume cd63253f-35e6-43a9-834d-709345a0ad0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd63253f-35e6-43a9-834d-709345a0ad0a', 'volume_size': 1}
Jul 14 16:31:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6c5faff5-3654-4df1-9fbb-a3df2f970f02 tempest-VolumesListAdminTestJSON-11684788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:31:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6c5faff5-3654-4df1-9fbb-a3df2f970f02 tempest-VolumesListAdminTestJSON-11684788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:31:31 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6c5faff5-3654-4df1-9fbb-a3df2f970f02 tempest-VolumesListAdminTestJSON-11684788 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:31:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-271813462',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd63253f-35e6-43a9-834d-709345a0ad0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc89effaaa4b4ed7b6a064733f932daa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:31:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:31:31Z,use_quota=True,user_id='7baded35edec4b21a78cf2efc323fdf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:31:31 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-6c5faff5-3654-4df1-9fbb-a3df2f970f02 tempest-VolumesListAdminTestJSON-11684788 None] Creating volume cd63253f-35e6-43a9-834d-709345a0ad0a {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:31:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6c5faff5-3654-4df1-9fbb-a3df2f970f02 tempest-VolumesListAdminTestJSON-11684788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:31:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6c5faff5-3654-4df1-9fbb-a3df2f970f02 tempest-VolumesListAdminTestJSON-11684788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:31:31 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6c5faff5-3654-4df1-9fbb-a3df2f970f02 tempest-VolumesListAdminTestJSON-11684788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:31:31 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6c5faff5-3654-4df1-9fbb-a3df2f970f02 tempest-VolumesListAdminTestJSON-11684788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:31:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6c5faff5-3654-4df1-9fbb-a3df2f970f02 tempest-VolumesListAdminTestJSON-11684788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:31:31 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6c5faff5-3654-4df1-9fbb-a3df2f970f02 tempest-VolumesListAdminTestJSON-11684788 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:31:31 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-6c5faff5-3654-4df1-9fbb-a3df2f970f02 tempest-VolumesListAdminTestJSON-11684788 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:31:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6c5faff5-3654-4df1-9fbb-a3df2f970f02 tempest-VolumesListAdminTestJSON-11684788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cd63253f-35e6-43a9-834d-709345a0ad0a 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:31:31 devstack sudo[97402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cd63253f-35e6-43a9-834d-709345a0ad0a 1073741824
Jul 14 16:31:31 devstack sudo[97402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:31:31 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-95002ecc-4b30-452c-a83c-9fad70866b44 tempest-VolumesImageMetadata-1458491224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:31:31 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-95002ecc-4b30-452c-a83c-9fad70866b44 tempest-VolumesImageMetadata-1458491224 None] Flow 'volume_create_manager' (fd5b292e-1240-4970-a5a3-06f218bcc117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:31:31 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-95002ecc-4b30-452c-a83c-9fad70866b44 tempest-VolumesImageMetadata-1458491224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73e42441-16dd-4218-9b13-58fc7a252821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:31:31 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-95002ecc-4b30-452c-a83c-9fad70866b44 tempest-VolumesImageMetadata-1458491224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73e42441-16dd-4218-9b13-58fc7a252821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:31:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1561056360',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65126b2c-ab60-45ad-b2bd-a067c9c3bc8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d0bc064e2214e7f9c9fecea8baaa414',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:31:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:31:32Z,use_quota=True,user_id='e5e4fe0fc353460f92d6f053ea316f54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:31:31 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-95002ecc-4b30-452c-a83c-9fad70866b44 tempest-VolumesImageMetadata-1458491224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa7f737a-0d01-4607-9519-08325c0efb0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:31:31 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-95002ecc-4b30-452c-a83c-9fad70866b44 tempest-VolumesImageMetadata-1458491224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa7f737a-0d01-4607-9519-08325c0efb0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:31:31 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-95002ecc-4b30-452c-a83c-9fad70866b44 tempest-VolumesImageMetadata-1458491224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9318eaba-7008-4c46-8c5e-8c10d678bf30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:31:31 devstack cinder-volume[87166]: DEBUG cinder.image.glance [None req-95002ecc-4b30-452c-a83c-9fad70866b44 tempest-VolumesImageMetadata-1458491224 None] Creating Keystone auth plugin from conf {{(pid=87166) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 14 16:31:32 devstack sudo[97402]: pam_unix(sudo:session): session closed for user root
Jul 14 16:31:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6c5faff5-3654-4df1-9fbb-a3df2f970f02 tempest-VolumesListAdminTestJSON-11684788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cd63253f-35e6-43a9-834d-709345a0ad0a 1073741824" returned: 0 in 0.741s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:31:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6c5faff5-3654-4df1-9fbb-a3df2f970f02 tempest-VolumesListAdminTestJSON-11684788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cd63253f-35e6-43a9-834d-709345a0ad0a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:31:32 devstack sudo[97408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cd63253f-35e6-43a9-834d-709345a0ad0a
Jul 14 16:31:32 devstack sudo[97408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:31:32 devstack sudo[97408]: pam_unix(sudo:session): session closed for user root
Jul 14 16:31:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6c5faff5-3654-4df1-9fbb-a3df2f970f02 tempest-VolumesListAdminTestJSON-11684788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cd63253f-35e6-43a9-834d-709345a0ad0a" returned: 0 in 0.322s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:31:32 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6c5faff5-3654-4df1-9fbb-a3df2f970f02 tempest-VolumesListAdminTestJSON-11684788 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:31:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6c5faff5-3654-4df1-9fbb-a3df2f970f02 tempest-VolumesListAdminTestJSON-11684788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:31:32 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6c5faff5-3654-4df1-9fbb-a3df2f970f02 tempest-VolumesListAdminTestJSON-11684788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ffdeca1-1aa2-487c-a507-41660ae8dc52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd63253f-35e6-43a9-834d-709345a0ad0a', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:31:32 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6c5faff5-3654-4df1-9fbb-a3df2f970f02 tempest-VolumesListAdminTestJSON-11684788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8ec1f8a-ff00-4cf6-954b-9523917a12c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:31:32 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-6c5faff5-3654-4df1-9fbb-a3df2f970f02 tempest-VolumesListAdminTestJSON-11684788 None] Volume volume-cd63253f-35e6-43a9-834d-709345a0ad0a (cd63253f-35e6-43a9-834d-709345a0ad0a): created successfully
Jul 14 16:31:32 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6c5faff5-3654-4df1-9fbb-a3df2f970f02 tempest-VolumesListAdminTestJSON-11684788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8ec1f8a-ff00-4cf6-954b-9523917a12c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:31:32 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6c5faff5-3654-4df1-9fbb-a3df2f970f02 tempest-VolumesListAdminTestJSON-11684788 None] Flow 'volume_create_manager' (e58a9239-0666-4b2b-9910-7270d3b8fbb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:31:32 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-6c5faff5-3654-4df1-9fbb-a3df2f970f02 tempest-VolumesListAdminTestJSON-11684788 None] Created volume successfully.
Jul 14 16:31:32 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-95002ecc-4b30-452c-a83c-9fad70866b44 tempest-VolumesImageMetadata-1458491224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9318eaba-7008-4c46-8c5e-8c10d678bf30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '65126b2c-ab60-45ad-b2bd-a067c9c3bc8c', 'volume_name': 'volume-65126b2c-ab60-45ad-b2bd-a067c9c3bc8c', 'volume_size': 1, 'image_id': '9a5fa908-fde1-4478-9fb5-d52ec5aeacfd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9a5fa908-fde1-4478-9fb5-d52ec5aeacfd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6db24ec5a0f441c18a787b3e9a478713', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9a5fa908-fde1-4478-9fb5-d52ec5aeacfd', 'created_at': datetime.datetime(2026, 7, 14, 14, 17, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 14, 17, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9a5fa908-fde1-4478-9fb5-d52ec5aeacfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74f781093ce0>}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:31:32 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-95002ecc-4b30-452c-a83c-9fad70866b44 tempest-VolumesImageMetadata-1458491224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8651c0dc-d602-4c7a-984a-38aeeff36fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:31:32 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-95002ecc-4b30-452c-a83c-9fad70866b44 tempest-VolumesImageMetadata-1458491224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8651c0dc-d602-4c7a-984a-38aeeff36fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:31:32 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-95002ecc-4b30-452c-a83c-9fad70866b44 tempest-VolumesImageMetadata-1458491224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (894b2fdf-5731-479a-b299-d6dcc03bae54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:31:32 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-95002ecc-4b30-452c-a83c-9fad70866b44 tempest-VolumesImageMetadata-1458491224 None] Volume 65126b2c-ab60-45ad-b2bd-a067c9c3bc8c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-65126b2c-ab60-45ad-b2bd-a067c9c3bc8c', 'volume_size': 1, 'image_id': '9a5fa908-fde1-4478-9fb5-d52ec5aeacfd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9a5fa908-fde1-4478-9fb5-d52ec5aeacfd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6db24ec5a0f441c18a787b3e9a478713', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9a5fa908-fde1-4478-9fb5-d52ec5aeacfd', 'created_at': datetime.datetime(2026, 7, 14, 14, 17, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 14, 17, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9a5fa908-fde1-4478-9fb5-d52ec5aeacfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74f781093ce0>}
Jul 14 16:31:32 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-95002ecc-4b30-452c-a83c-9fad70866b44 tempest-VolumesImageMetadata-1458491224 None] Trying to clone 65126b2c-ab60-45ad-b2bd-a067c9c3bc8c from image 9a5fa908-fde1-4478-9fb5-d52ec5aeacfd at location (None, [{'url': 'file:///opt/stack/data/glance/images/9a5fa908-fde1-4478-9fb5-d52ec5aeacfd', 'metadata': {}}]). {{(pid=87166) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 14 16:31:33 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-95002ecc-4b30-452c-a83c-9fad70866b44 tempest-VolumesImageMetadata-1458491224 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_mnvo3_nkdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87166) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 14 16:31:33 devstack cinder-volume[87166]: INFO cinder.image.image_utils [None req-95002ecc-4b30-452c-a83c-9fad70866b44 tempest-VolumesImageMetadata-1458491224 None] Image download 20.69 MB at 20.69 MB/s
Jul 14 16:31:33 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a320c57-e47a-4545-ad6a-c89c438e30f9]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:31:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-95002ecc-4b30-452c-a83c-9fad70866b44 tempest-VolumesImageMetadata-1458491224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_mnvo3_nkdevstack@QuobyteHD {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:31:33 devstack sudo[97432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_mnvo3_nkdevstack@QuobyteHD
Jul 14 16:31:33 devstack sudo[97432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:31:33 devstack sudo[97432]: pam_unix(sudo:session): session closed for user root
Jul 14 16:31:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-95002ecc-4b30-452c-a83c-9fad70866b44 tempest-VolumesImageMetadata-1458491224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_mnvo3_nkdevstack@QuobyteHD" returned: 0 in 0.482s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:31:33 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-95002ecc-4b30-452c-a83c-9fad70866b44 tempest-VolumesImageMetadata-1458491224 None] Temporary image 9a5fa908-fde1-4478-9fb5-d52ec5aeacfd is fetched for user e5e4fe0fc353460f92d6f053ea316f54. {{(pid=87166) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 14 16:31:33 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e361195-0dcd-40a6-95a0-92a493ed3f93]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:31:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-95002ecc-4b30-452c-a83c-9fad70866b44 tempest-VolumesImageMetadata-1458491224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_mnvo3_nkdevstack@QuobyteHD {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:31:33 devstack sudo[97439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_mnvo3_nkdevstack@QuobyteHD
Jul 14 16:31:33 devstack sudo[97439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:31:34 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-467c649d-f1cc-4b9a-b26d-ba47abc7f8fe tempest-VolumesListAdminTestJSON-11684788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:31:34 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-467c649d-f1cc-4b9a-b26d-ba47abc7f8fe tempest-VolumesListAdminTestJSON-11684788 None] Flow 'volume_create_manager' (8b80f1cd-2705-483c-b914-b80a7a1dad81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:31:34 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-467c649d-f1cc-4b9a-b26d-ba47abc7f8fe tempest-VolumesListAdminTestJSON-11684788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e38e71f2-6955-46e5-8d80-e63a61f5494b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:31:34 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-467c649d-f1cc-4b9a-b26d-ba47abc7f8fe tempest-VolumesListAdminTestJSON-11684788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e38e71f2-6955-46e5-8d80-e63a61f5494b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:31:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-895442744',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=585f6342-be34-445f-9dc6-da885a93dfa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc89effaaa4b4ed7b6a064733f932daa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:31:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:31:34Z,use_quota=True,user_id='7baded35edec4b21a78cf2efc323fdf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:31:34 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-467c649d-f1cc-4b9a-b26d-ba47abc7f8fe tempest-VolumesListAdminTestJSON-11684788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55fc9568-7854-4596-ba22-72005a54ce73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:31:34 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-467c649d-f1cc-4b9a-b26d-ba47abc7f8fe tempest-VolumesListAdminTestJSON-11684788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55fc9568-7854-4596-ba22-72005a54ce73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:31:34 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-467c649d-f1cc-4b9a-b26d-ba47abc7f8fe tempest-VolumesListAdminTestJSON-11684788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a96c0f92-4ed2-45db-a71e-90fac020deec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:31:34 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-467c649d-f1cc-4b9a-b26d-ba47abc7f8fe tempest-VolumesListAdminTestJSON-11684788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a96c0f92-4ed2-45db-a71e-90fac020deec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '585f6342-be34-445f-9dc6-da885a93dfa9', 'volume_name': 'volume-585f6342-be34-445f-9dc6-da885a93dfa9', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:31:34 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-467c649d-f1cc-4b9a-b26d-ba47abc7f8fe tempest-VolumesListAdminTestJSON-11684788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ccda677-e19f-4683-b0c3-eb90a0674263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:31:34 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-467c649d-f1cc-4b9a-b26d-ba47abc7f8fe tempest-VolumesListAdminTestJSON-11684788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ccda677-e19f-4683-b0c3-eb90a0674263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:31:34 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-467c649d-f1cc-4b9a-b26d-ba47abc7f8fe tempest-VolumesListAdminTestJSON-11684788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfa3f9d1-0bad-4334-9cf3-f85e2dfd36af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:31:34 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-467c649d-f1cc-4b9a-b26d-ba47abc7f8fe tempest-VolumesListAdminTestJSON-11684788 None] Volume 585f6342-be34-445f-9dc6-da885a93dfa9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-585f6342-be34-445f-9dc6-da885a93dfa9', 'volume_size': 1}
Jul 14 16:31:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-467c649d-f1cc-4b9a-b26d-ba47abc7f8fe tempest-VolumesListAdminTestJSON-11684788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:31:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-467c649d-f1cc-4b9a-b26d-ba47abc7f8fe tempest-VolumesListAdminTestJSON-11684788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:31:34 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-467c649d-f1cc-4b9a-b26d-ba47abc7f8fe tempest-VolumesListAdminTestJSON-11684788 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:31:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-895442744',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=585f6342-be34-445f-9dc6-da885a93dfa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc89effaaa4b4ed7b6a064733f932daa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:31:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:31:34Z,use_quota=True,user_id='7baded35edec4b21a78cf2efc323fdf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:31:34 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-467c649d-f1cc-4b9a-b26d-ba47abc7f8fe tempest-VolumesListAdminTestJSON-11684788 None] Creating volume 585f6342-be34-445f-9dc6-da885a93dfa9 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:31:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-467c649d-f1cc-4b9a-b26d-ba47abc7f8fe tempest-VolumesListAdminTestJSON-11684788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:31:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-467c649d-f1cc-4b9a-b26d-ba47abc7f8fe tempest-VolumesListAdminTestJSON-11684788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:31:34 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-467c649d-f1cc-4b9a-b26d-ba47abc7f8fe tempest-VolumesListAdminTestJSON-11684788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:31:34 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-467c649d-f1cc-4b9a-b26d-ba47abc7f8fe tempest-VolumesListAdminTestJSON-11684788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:31:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-467c649d-f1cc-4b9a-b26d-ba47abc7f8fe tempest-VolumesListAdminTestJSON-11684788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:31:34 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-467c649d-f1cc-4b9a-b26d-ba47abc7f8fe tempest-VolumesListAdminTestJSON-11684788 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:31:34 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-467c649d-f1cc-4b9a-b26d-ba47abc7f8fe tempest-VolumesListAdminTestJSON-11684788 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:31:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-467c649d-f1cc-4b9a-b26d-ba47abc7f8fe tempest-VolumesListAdminTestJSON-11684788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-585f6342-be34-445f-9dc6-da885a93dfa9 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:31:34 devstack sudo[97439]: pam_unix(sudo:session): session closed for user root
Jul 14 16:31:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-95002ecc-4b30-452c-a83c-9fad70866b44 tempest-VolumesImageMetadata-1458491224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_mnvo3_nkdevstack@QuobyteHD" returned: 0 in 0.392s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:31:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-95002ecc-4b30-452c-a83c-9fad70866b44 tempest-VolumesImageMetadata-1458491224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:31:34 devstack sudo[97444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-585f6342-be34-445f-9dc6-da885a93dfa9 1073741824
Jul 14 16:31:34 devstack sudo[97444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:31:34 devstack sudo[97444]: pam_unix(sudo:session): session closed for user root
Jul 14 16:31:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-467c649d-f1cc-4b9a-b26d-ba47abc7f8fe tempest-VolumesListAdminTestJSON-11684788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-585f6342-be34-445f-9dc6-da885a93dfa9 1073741824" returned: 0 in 0.550s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:31:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-467c649d-f1cc-4b9a-b26d-ba47abc7f8fe tempest-VolumesListAdminTestJSON-11684788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-585f6342-be34-445f-9dc6-da885a93dfa9 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:31:34 devstack sudo[97450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-585f6342-be34-445f-9dc6-da885a93dfa9
Jul 14 16:31:34 devstack sudo[97450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:31:35 devstack sudo[97450]: pam_unix(sudo:session): session closed for user root
Jul 14 16:31:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-467c649d-f1cc-4b9a-b26d-ba47abc7f8fe tempest-VolumesListAdminTestJSON-11684788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-585f6342-be34-445f-9dc6-da885a93dfa9" returned: 0 in 0.433s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:31:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-467c649d-f1cc-4b9a-b26d-ba47abc7f8fe tempest-VolumesListAdminTestJSON-11684788 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:31:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-467c649d-f1cc-4b9a-b26d-ba47abc7f8fe tempest-VolumesListAdminTestJSON-11684788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:31:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-95002ecc-4b30-452c-a83c-9fad70866b44 tempest-VolumesImageMetadata-1458491224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.014s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:31:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-95002ecc-4b30-452c-a83c-9fad70866b44 tempest-VolumesImageMetadata-1458491224 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:31:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1561056360',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65126b2c-ab60-45ad-b2bd-a067c9c3bc8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d0bc064e2214e7f9c9fecea8baaa414',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:31:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:31:32Z,use_quota=True,user_id='e5e4fe0fc353460f92d6f053ea316f54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:31:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-95002ecc-4b30-452c-a83c-9fad70866b44 tempest-VolumesImageMetadata-1458491224 None] Creating volume 65126b2c-ab60-45ad-b2bd-a067c9c3bc8c {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:31:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-95002ecc-4b30-452c-a83c-9fad70866b44 tempest-VolumesImageMetadata-1458491224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:31:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-95002ecc-4b30-452c-a83c-9fad70866b44 tempest-VolumesImageMetadata-1458491224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:31:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-95002ecc-4b30-452c-a83c-9fad70866b44 tempest-VolumesImageMetadata-1458491224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:31:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-95002ecc-4b30-452c-a83c-9fad70866b44 tempest-VolumesImageMetadata-1458491224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:31:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-95002ecc-4b30-452c-a83c-9fad70866b44 tempest-VolumesImageMetadata-1458491224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:31:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-95002ecc-4b30-452c-a83c-9fad70866b44 tempest-VolumesImageMetadata-1458491224 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:31:35 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-95002ecc-4b30-452c-a83c-9fad70866b44 tempest-VolumesImageMetadata-1458491224 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:31:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-95002ecc-4b30-452c-a83c-9fad70866b44 tempest-VolumesImageMetadata-1458491224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-65126b2c-ab60-45ad-b2bd-a067c9c3bc8c 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:31:35 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-467c649d-f1cc-4b9a-b26d-ba47abc7f8fe tempest-VolumesListAdminTestJSON-11684788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfa3f9d1-0bad-4334-9cf3-f85e2dfd36af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-585f6342-be34-445f-9dc6-da885a93dfa9', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:31:35 devstack sudo[97453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-65126b2c-ab60-45ad-b2bd-a067c9c3bc8c 1073741824
Jul 14 16:31:35 devstack sudo[97453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:31:35 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-467c649d-f1cc-4b9a-b26d-ba47abc7f8fe tempest-VolumesListAdminTestJSON-11684788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c15ed9b-86ed-46d9-8bb3-c170f11367ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:31:35 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-467c649d-f1cc-4b9a-b26d-ba47abc7f8fe tempest-VolumesListAdminTestJSON-11684788 None] Volume volume-585f6342-be34-445f-9dc6-da885a93dfa9 (585f6342-be34-445f-9dc6-da885a93dfa9): created successfully
Jul 14 16:31:35 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-467c649d-f1cc-4b9a-b26d-ba47abc7f8fe tempest-VolumesListAdminTestJSON-11684788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c15ed9b-86ed-46d9-8bb3-c170f11367ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:31:35 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-467c649d-f1cc-4b9a-b26d-ba47abc7f8fe tempest-VolumesListAdminTestJSON-11684788 None] Flow 'volume_create_manager' (8b80f1cd-2705-483c-b914-b80a7a1dad81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:31:35 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-467c649d-f1cc-4b9a-b26d-ba47abc7f8fe tempest-VolumesListAdminTestJSON-11684788 None] Created volume successfully.
Jul 14 16:31:35 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 16:31:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:31:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:31:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:31:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:31:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:31:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:31:35 devstack sudo[97455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:31:35 devstack sudo[97455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:31:35 devstack sudo[97455]: pam_unix(sudo:session): session closed for user root
Jul 14 16:31:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.393s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:31:35 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:31:35 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Running periodic task VolumeManager._thread_info {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 16:31:35 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] thread count: 28 {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 14 16:31:35 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] thread info: [<_MainThread(MainThread, started 128606490927232)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128606415432960)>, <Thread(Thread-3 (stat_writer), started daemon 128606378859328)>, <Thread(Rabbit-heartbeat, started daemon 128606379646144)>, <Thread(Thread-5 (_runner), started daemon 128606377685824)>, <Thread(Thread-7 (_runner), started daemon 128606377701888)>, <Thread(fd_logger, started daemon 128606377091392)>, <Thread(privsep_reader, started daemon 128606375782080)>, <Thread(tpool_thread_0, started daemon 128606365607616)>, <Thread(tpool_thread_1, started daemon 128606357214912)>, <Thread(tpool_thread_2, started daemon 128606348822208)>, <Thread(tpool_thread_3, started daemon 128606340413120)>, <Thread(tpool_thread_4, started daemon 128606332004032)>, <Thread(tpool_thread_5, started daemon 128606323594944)>, <Thread(tpool_thread_6, started daemon 128606315185856)>, <Thread(tpool_thread_7, started daemon 128606306776768)>, <Thread(tpool_thread_8, started daemon 128606298367680)>, <Thread(tpool_thread_9, started daemon 128606289958592)>, <Thread(tpool_thread_10, started daemon 128606281549504)>, <Thread(tpool_thread_11, started daemon 128606273140416)>, <Thread(tpool_thread_12, started daemon 128606264731328)>, <Thread(tpool_thread_13, started daemon 128606256322240)>, <Thread(tpool_thread_14, started daemon 128606247913152)>, <Thread(tpool_thread_15, started daemon 128606239504064)>, <Thread(tpool_thread_16, started daemon 128606231094976)>, <Thread(tpool_thread_17, started daemon 128606222685888)>, <Thread(tpool_thread_18, started daemon 128606214276800)>, <Thread(tpool_thread_19, started daemon 128606205867712)>] {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 14 16:31:35 devstack sudo[97453]: pam_unix(sudo:session): session closed for user root
Jul 14 16:31:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-95002ecc-4b30-452c-a83c-9fad70866b44 tempest-VolumesImageMetadata-1458491224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-65126b2c-ab60-45ad-b2bd-a067c9c3bc8c 1073741824" returned: 0 in 0.682s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:31:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-95002ecc-4b30-452c-a83c-9fad70866b44 tempest-VolumesImageMetadata-1458491224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-65126b2c-ab60-45ad-b2bd-a067c9c3bc8c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:31:36 devstack sudo[97461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-65126b2c-ab60-45ad-b2bd-a067c9c3bc8c
Jul 14 16:31:36 devstack sudo[97461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:31:36 devstack sudo[97461]: pam_unix(sudo:session): session closed for user root
Jul 14 16:31:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-95002ecc-4b30-452c-a83c-9fad70866b44 tempest-VolumesImageMetadata-1458491224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-65126b2c-ab60-45ad-b2bd-a067c9c3bc8c" returned: 0 in 0.406s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:31:36 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-95002ecc-4b30-452c-a83c-9fad70866b44 tempest-VolumesImageMetadata-1458491224 None] <== create_volume: return (1156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:31:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-95002ecc-4b30-452c-a83c-9fad70866b44 tempest-VolumesImageMetadata-1458491224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.160s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:31:36 devstack cinder-volume[87166]: DEBUG cinder.volume.volume_utils [None req-95002ecc-4b30-452c-a83c-9fad70866b44 tempest-VolumesImageMetadata-1458491224 None] Attempting download of 9a5fa908-fde1-4478-9fb5-d52ec5aeacfd ((None, [{'url': 'file:///opt/stack/data/glance/images/9a5fa908-fde1-4478-9fb5-d52ec5aeacfd', 'metadata': {}}])) to volume 65126b2c-ab60-45ad-b2bd-a067c9c3bc8c. {{(pid=87166) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 14 16:31:36 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d3087f-4092-419d-9ff9-e52fa7b6d468]: (4, 'raw') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:31:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-95002ecc-4b30-452c-a83c-9fad70866b44 tempest-VolumesImageMetadata-1458491224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_zmr47m2k {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:31:36 devstack sudo[97466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_zmr47m2k
Jul 14 16:31:36 devstack sudo[97466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:31:36 devstack sudo[97466]: pam_unix(sudo:session): session closed for user root
Jul 14 16:31:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-95002ecc-4b30-452c-a83c-9fad70866b44 tempest-VolumesImageMetadata-1458491224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_zmr47m2k" returned: 0 in 0.409s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:31:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-95002ecc-4b30-452c-a83c-9fad70866b44 tempest-VolumesImageMetadata-1458491224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_zmr47m2k {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:31:37 devstack sudo[97470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_zmr47m2k
Jul 14 16:31:37 devstack sudo[97470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:31:37 devstack sudo[97470]: pam_unix(sudo:session): session closed for user root
Jul 14 16:31:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-95002ecc-4b30-452c-a83c-9fad70866b44 tempest-VolumesImageMetadata-1458491224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_zmr47m2k" returned: 1 in 0.501s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:31:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-95002ecc-4b30-452c-a83c-9fad70866b44 tempest-VolumesImageMetadata-1458491224 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_zmr47m2k' failed. Not Retrying. {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 16:31:37 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[16dfa500-3e3c-4f7e-b058-bdb6093b9bf9]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:31:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-95002ecc-4b30-452c-a83c-9fad70866b44 tempest-VolumesImageMetadata-1458491224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_mnvo3_nkdevstack@QuobyteHD {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:31:37 devstack sudo[97474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_mnvo3_nkdevstack@QuobyteHD
Jul 14 16:31:37 devstack sudo[97474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:31:37 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:SELECT=125,cinder:INSERT=36,cinder:UPDATE=158,cinder:DELETE=6 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 16:31:37 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:UPDATE=149,cinder:SELECT=124,cinder:DELETE=11,cinder:INSERT=36 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 16:31:37 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2dc7627-436b-4a38-bc40-d11b0c5b4309 tempest-VolumesListAdminTestJSON-1154068736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:31:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d2dc7627-436b-4a38-bc40-d11b0c5b4309 tempest-VolumesListAdminTestJSON-1154068736 None] Flow 'volume_create_manager' (5a61c10f-e6b3-4689-b14b-5e91c46e13d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:31:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d2dc7627-436b-4a38-bc40-d11b0c5b4309 tempest-VolumesListAdminTestJSON-1154068736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b69f52e3-1f8f-46af-939a-46ba758e40ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:31:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d2dc7627-436b-4a38-bc40-d11b0c5b4309 tempest-VolumesListAdminTestJSON-1154068736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b69f52e3-1f8f-46af-939a-46ba758e40ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:31:37Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c6e2e8d-25ff-4f8d-8814-aca2f20108ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21243256e87b49c383aa797a7d02a8a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:31:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:31:38Z,use_quota=True,user_id='323b6f84d1d9419daf0664e50873233a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:31:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d2dc7627-436b-4a38-bc40-d11b0c5b4309 tempest-VolumesListAdminTestJSON-1154068736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13a85b71-ec79-41aa-9ce8-9c434ee2236a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:31:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d2dc7627-436b-4a38-bc40-d11b0c5b4309 tempest-VolumesListAdminTestJSON-1154068736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13a85b71-ec79-41aa-9ce8-9c434ee2236a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:31:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d2dc7627-436b-4a38-bc40-d11b0c5b4309 tempest-VolumesListAdminTestJSON-1154068736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (089faa50-4563-41ed-82c8-1adf67628e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:31:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d2dc7627-436b-4a38-bc40-d11b0c5b4309 tempest-VolumesListAdminTestJSON-1154068736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (089faa50-4563-41ed-82c8-1adf67628e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c6e2e8d-25ff-4f8d-8814-aca2f20108ae', 'volume_name': 'volume-6c6e2e8d-25ff-4f8d-8814-aca2f20108ae', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:31:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d2dc7627-436b-4a38-bc40-d11b0c5b4309 tempest-VolumesListAdminTestJSON-1154068736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c90aedf-dc6e-4c58-8a93-185496ad1d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:31:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d2dc7627-436b-4a38-bc40-d11b0c5b4309 tempest-VolumesListAdminTestJSON-1154068736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c90aedf-dc6e-4c58-8a93-185496ad1d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:31:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d2dc7627-436b-4a38-bc40-d11b0c5b4309 tempest-VolumesListAdminTestJSON-1154068736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18290452-09da-41e3-a8ec-d462e4410ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:31:37 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-d2dc7627-436b-4a38-bc40-d11b0c5b4309 tempest-VolumesListAdminTestJSON-1154068736 None] Volume 6c6e2e8d-25ff-4f8d-8814-aca2f20108ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c6e2e8d-25ff-4f8d-8814-aca2f20108ae', 'volume_size': 1}
Jul 14 16:31:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d2dc7627-436b-4a38-bc40-d11b0c5b4309 tempest-VolumesListAdminTestJSON-1154068736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:31:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d2dc7627-436b-4a38-bc40-d11b0c5b4309 tempest-VolumesListAdminTestJSON-1154068736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:31:37 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d2dc7627-436b-4a38-bc40-d11b0c5b4309 tempest-VolumesListAdminTestJSON-1154068736 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:31:37Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c6e2e8d-25ff-4f8d-8814-aca2f20108ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21243256e87b49c383aa797a7d02a8a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:31:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:31:38Z,use_quota=True,user_id='323b6f84d1d9419daf0664e50873233a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:31:37 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-d2dc7627-436b-4a38-bc40-d11b0c5b4309 tempest-VolumesListAdminTestJSON-1154068736 None] Creating volume 6c6e2e8d-25ff-4f8d-8814-aca2f20108ae {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:31:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d2dc7627-436b-4a38-bc40-d11b0c5b4309 tempest-VolumesListAdminTestJSON-1154068736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:31:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d2dc7627-436b-4a38-bc40-d11b0c5b4309 tempest-VolumesListAdminTestJSON-1154068736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:31:37 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d2dc7627-436b-4a38-bc40-d11b0c5b4309 tempest-VolumesListAdminTestJSON-1154068736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:31:37 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d2dc7627-436b-4a38-bc40-d11b0c5b4309 tempest-VolumesListAdminTestJSON-1154068736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:31:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d2dc7627-436b-4a38-bc40-d11b0c5b4309 tempest-VolumesListAdminTestJSON-1154068736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:31:37 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d2dc7627-436b-4a38-bc40-d11b0c5b4309 tempest-VolumesListAdminTestJSON-1154068736 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:31:37 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-d2dc7627-436b-4a38-bc40-d11b0c5b4309 tempest-VolumesListAdminTestJSON-1154068736 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:31:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d2dc7627-436b-4a38-bc40-d11b0c5b4309 tempest-VolumesListAdminTestJSON-1154068736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6c6e2e8d-25ff-4f8d-8814-aca2f20108ae 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:31:37 devstack sudo[97479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6c6e2e8d-25ff-4f8d-8814-aca2f20108ae 1073741824
Jul 14 16:31:37 devstack sudo[97479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:31:37 devstack sudo[97474]: pam_unix(sudo:session): session closed for user root
Jul 14 16:31:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-95002ecc-4b30-452c-a83c-9fad70866b44 tempest-VolumesImageMetadata-1458491224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_mnvo3_nkdevstack@QuobyteHD" returned: 0 in 0.493s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:31:37 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-95002ecc-4b30-452c-a83c-9fad70866b44 tempest-VolumesImageMetadata-1458491224 None] 9a5fa908-fde1-4478-9fb5-d52ec5aeacfd was qcow2, converting to raw {{(pid=87166) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 14 16:31:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-95002ecc-4b30-452c-a83c-9fad70866b44 tempest-VolumesImageMetadata-1458491224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_mnvo3_nkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-65126b2c-ab60-45ad-b2bd-a067c9c3bc8c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:31:37 devstack sudo[97481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_mnvo3_nkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-65126b2c-ab60-45ad-b2bd-a067c9c3bc8c
Jul 14 16:31:37 devstack sudo[97481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:31:38 devstack sudo[97479]: pam_unix(sudo:session): session closed for user root
Jul 14 16:31:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d2dc7627-436b-4a38-bc40-d11b0c5b4309 tempest-VolumesListAdminTestJSON-1154068736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6c6e2e8d-25ff-4f8d-8814-aca2f20108ae 1073741824" returned: 0 in 0.487s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:31:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d2dc7627-436b-4a38-bc40-d11b0c5b4309 tempest-VolumesListAdminTestJSON-1154068736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6c6e2e8d-25ff-4f8d-8814-aca2f20108ae {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:31:38 devstack sudo[97493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6c6e2e8d-25ff-4f8d-8814-aca2f20108ae
Jul 14 16:31:38 devstack sudo[97493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:31:38 devstack sudo[97493]: pam_unix(sudo:session): session closed for user root
Jul 14 16:31:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d2dc7627-436b-4a38-bc40-d11b0c5b4309 tempest-VolumesListAdminTestJSON-1154068736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6c6e2e8d-25ff-4f8d-8814-aca2f20108ae" returned: 0 in 0.318s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:31:38 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d2dc7627-436b-4a38-bc40-d11b0c5b4309 tempest-VolumesListAdminTestJSON-1154068736 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:31:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d2dc7627-436b-4a38-bc40-d11b0c5b4309 tempest-VolumesListAdminTestJSON-1154068736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:31:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d2dc7627-436b-4a38-bc40-d11b0c5b4309 tempest-VolumesListAdminTestJSON-1154068736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18290452-09da-41e3-a8ec-d462e4410ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c6e2e8d-25ff-4f8d-8814-aca2f20108ae', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:31:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d2dc7627-436b-4a38-bc40-d11b0c5b4309 tempest-VolumesListAdminTestJSON-1154068736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (118895e2-b465-4577-8985-1dffb5415d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:31:38 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-d2dc7627-436b-4a38-bc40-d11b0c5b4309 tempest-VolumesListAdminTestJSON-1154068736 None] Volume volume-6c6e2e8d-25ff-4f8d-8814-aca2f20108ae (6c6e2e8d-25ff-4f8d-8814-aca2f20108ae): created successfully
Jul 14 16:31:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d2dc7627-436b-4a38-bc40-d11b0c5b4309 tempest-VolumesListAdminTestJSON-1154068736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (118895e2-b465-4577-8985-1dffb5415d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:31:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d2dc7627-436b-4a38-bc40-d11b0c5b4309 tempest-VolumesListAdminTestJSON-1154068736 None] Flow 'volume_create_manager' (5a61c10f-e6b3-4689-b14b-5e91c46e13d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:31:38 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-d2dc7627-436b-4a38-bc40-d11b0c5b4309 tempest-VolumesListAdminTestJSON-1154068736 None] Created volume successfully.
Jul 14 16:31:39 devstack sudo[97481]: pam_unix(sudo:session): session closed for user root
Jul 14 16:31:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-95002ecc-4b30-452c-a83c-9fad70866b44 tempest-VolumesImageMetadata-1458491224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_mnvo3_nkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-65126b2c-ab60-45ad-b2bd-a067c9c3bc8c" returned: 0 in 1.859s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:31:39 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-95002ecc-4b30-452c-a83c-9fad70866b44 tempest-VolumesImageMetadata-1458491224 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_mnvo3_nkdevstack@QuobyteHD, size 112.00 MB, duration 1.86 sec, destination /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-65126b2c-ab60-45ad-b2bd-a067c9c3bc8c {{(pid=87166) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 14 16:31:39 devstack cinder-volume[87166]: INFO cinder.image.image_utils [None req-95002ecc-4b30-452c-a83c-9fad70866b44 tempest-VolumesImageMetadata-1458491224 None] Converted 112.00 MB image at 60.23 MB/s
Jul 14 16:31:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-95002ecc-4b30-452c-a83c-9fad70866b44 tempest-VolumesImageMetadata-1458491224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-65126b2c-ab60-45ad-b2bd-a067c9c3bc8c 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:31:39 devstack sudo[97497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-65126b2c-ab60-45ad-b2bd-a067c9c3bc8c 1G
Jul 14 16:31:39 devstack sudo[97497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:31:39 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-860b334c-57c6-43bb-a619-a660a01b5755 tempest-VolumesListAdminTestJSON-1154068736 None] Acquiring lock "cinder-6c6e2e8d-25ff-4f8d-8814-aca2f20108ae-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:31:39 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-860b334c-57c6-43bb-a619-a660a01b5755 tempest-VolumesListAdminTestJSON-1154068736 None] Lock "cinder-6c6e2e8d-25ff-4f8d-8814-aca2f20108ae-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:31:39 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-860b334c-57c6-43bb-a619-a660a01b5755 tempest-VolumesListAdminTestJSON-1154068736 None] Acquiring lock "cinder-quobyte-6c6e2e8d-25ff-4f8d-8814-aca2f20108ae" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:31:39 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-860b334c-57c6-43bb-a619-a660a01b5755 tempest-VolumesListAdminTestJSON-1154068736 None] Lock "cinder-quobyte-6c6e2e8d-25ff-4f8d-8814-aca2f20108ae" acquired by "delete_volume" :: waited 0.019s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:31:40 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed42140-01e1-440a-8c61-6712485a92ca]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:31:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-860b334c-57c6-43bb-a619-a660a01b5755 tempest-VolumesListAdminTestJSON-1154068736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6c6e2e8d-25ff-4f8d-8814-aca2f20108ae {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:31:40 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c8b60ddf-ca41-4767-85a9-9e3d4412a6dd tempest-VolumesListAdminTestJSON-11684788 None] Acquiring lock "cinder-585f6342-be34-445f-9dc6-da885a93dfa9-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:31:40 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c8b60ddf-ca41-4767-85a9-9e3d4412a6dd tempest-VolumesListAdminTestJSON-11684788 None] Lock "cinder-585f6342-be34-445f-9dc6-da885a93dfa9-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:31:40 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c8b60ddf-ca41-4767-85a9-9e3d4412a6dd tempest-VolumesListAdminTestJSON-11684788 None] Acquiring lock "cinder-quobyte-585f6342-be34-445f-9dc6-da885a93dfa9" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:31:40 devstack sudo[97499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6c6e2e8d-25ff-4f8d-8814-aca2f20108ae
Jul 14 16:31:40 devstack sudo[97499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:31:40 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c8b60ddf-ca41-4767-85a9-9e3d4412a6dd tempest-VolumesListAdminTestJSON-11684788 None] Lock "cinder-quobyte-585f6342-be34-445f-9dc6-da885a93dfa9" acquired by "delete_volume" :: waited 0.021s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:31:40 devstack sudo[97497]: pam_unix(sudo:session): session closed for user root
Jul 14 16:31:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-95002ecc-4b30-452c-a83c-9fad70866b44 tempest-VolumesImageMetadata-1458491224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-65126b2c-ab60-45ad-b2bd-a067c9c3bc8c 1G" returned: 0 in 0.458s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:31:40 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[262b1ca1-002d-4395-91af-ff07b43c28e3]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:31:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c8b60ddf-ca41-4767-85a9-9e3d4412a6dd tempest-VolumesListAdminTestJSON-11684788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-585f6342-be34-445f-9dc6-da885a93dfa9 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:31:40 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[a741ac37-edb0-42fc-bd41-ac2ecb73595b]: (4, 'raw') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:31:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-95002ecc-4b30-452c-a83c-9fad70866b44 tempest-VolumesImageMetadata-1458491224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-65126b2c-ab60-45ad-b2bd-a067c9c3bc8c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:31:40 devstack sudo[97505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-65126b2c-ab60-45ad-b2bd-a067c9c3bc8c
Jul 14 16:31:40 devstack sudo[97505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:31:40 devstack sudo[97504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-585f6342-be34-445f-9dc6-da885a93dfa9
Jul 14 16:31:40 devstack sudo[97504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:31:40 devstack sudo[97499]: pam_unix(sudo:session): session closed for user root
Jul 14 16:31:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-860b334c-57c6-43bb-a619-a660a01b5755 tempest-VolumesListAdminTestJSON-1154068736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6c6e2e8d-25ff-4f8d-8814-aca2f20108ae" returned: 0 in 0.440s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:31:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-860b334c-57c6-43bb-a619-a660a01b5755 tempest-VolumesListAdminTestJSON-1154068736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6c6e2e8d-25ff-4f8d-8814-aca2f20108ae {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:31:40 devstack sudo[97513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6c6e2e8d-25ff-4f8d-8814-aca2f20108ae
Jul 14 16:31:40 devstack sudo[97513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:31:40 devstack sudo[97505]: pam_unix(sudo:session): session closed for user root
Jul 14 16:31:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-95002ecc-4b30-452c-a83c-9fad70866b44 tempest-VolumesImageMetadata-1458491224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-65126b2c-ab60-45ad-b2bd-a067c9c3bc8c" returned: 0 in 0.405s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:31:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-95002ecc-4b30-452c-a83c-9fad70866b44 tempest-VolumesImageMetadata-1458491224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-65126b2c-ab60-45ad-b2bd-a067c9c3bc8c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:31:40 devstack sudo[97504]: pam_unix(sudo:session): session closed for user root
Jul 14 16:31:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c8b60ddf-ca41-4767-85a9-9e3d4412a6dd tempest-VolumesListAdminTestJSON-11684788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-585f6342-be34-445f-9dc6-da885a93dfa9" returned: 0 in 0.533s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:31:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c8b60ddf-ca41-4767-85a9-9e3d4412a6dd tempest-VolumesListAdminTestJSON-11684788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-585f6342-be34-445f-9dc6-da885a93dfa9 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:31:40 devstack sudo[97524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-585f6342-be34-445f-9dc6-da885a93dfa9
Jul 14 16:31:40 devstack sudo[97524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:31:40 devstack sudo[97522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-65126b2c-ab60-45ad-b2bd-a067c9c3bc8c
Jul 14 16:31:40 devstack sudo[97522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:31:40 devstack sudo[97513]: pam_unix(sudo:session): session closed for user root
Jul 14 16:31:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-860b334c-57c6-43bb-a619-a660a01b5755 tempest-VolumesListAdminTestJSON-1154068736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6c6e2e8d-25ff-4f8d-8814-aca2f20108ae" returned: 0 in 0.364s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:31:40 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-860b334c-57c6-43bb-a619-a660a01b5755 tempest-VolumesListAdminTestJSON-1154068736 None] Lock "cinder-quobyte-6c6e2e8d-25ff-4f8d-8814-aca2f20108ae" released by "delete_volume" :: held 0.870s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:31:40 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-860b334c-57c6-43bb-a619-a660a01b5755 tempest-VolumesListAdminTestJSON-1154068736 None] Created reservations ['9e9edd94-593f-451b-8a44-4697260a6451', 'ec937abe-4100-4df0-8e48-e03c5d78539c', 'c427a29f-1297-454a-9f75-bb6b6a01f658', '579bddc2-313e-46ac-8f0d-9af2edbccf43'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:31:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-860b334c-57c6-43bb-a619-a660a01b5755 tempest-VolumesListAdminTestJSON-1154068736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:31:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-860b334c-57c6-43bb-a619-a660a01b5755 tempest-VolumesListAdminTestJSON-1154068736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:31:41 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-860b334c-57c6-43bb-a619-a660a01b5755 tempest-VolumesListAdminTestJSON-1154068736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:31:41 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-860b334c-57c6-43bb-a619-a660a01b5755 tempest-VolumesListAdminTestJSON-1154068736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:31:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-860b334c-57c6-43bb-a619-a660a01b5755 tempest-VolumesListAdminTestJSON-1154068736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:31:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-860b334c-57c6-43bb-a619-a660a01b5755 tempest-VolumesListAdminTestJSON-1154068736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:31:41 devstack sudo[97524]: pam_unix(sudo:session): session closed for user root
Jul 14 16:31:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c8b60ddf-ca41-4767-85a9-9e3d4412a6dd tempest-VolumesListAdminTestJSON-11684788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-585f6342-be34-445f-9dc6-da885a93dfa9" returned: 0 in 0.314s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:31:41 devstack sudo[97529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:31:41 devstack sudo[97529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:31:41 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c8b60ddf-ca41-4767-85a9-9e3d4412a6dd tempest-VolumesListAdminTestJSON-11684788 None] Lock "cinder-quobyte-585f6342-be34-445f-9dc6-da885a93dfa9" released by "delete_volume" :: held 0.917s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:31:41 devstack sudo[97522]: pam_unix(sudo:session): session closed for user root
Jul 14 16:31:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-95002ecc-4b30-452c-a83c-9fad70866b44 tempest-VolumesImageMetadata-1458491224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-65126b2c-ab60-45ad-b2bd-a067c9c3bc8c" returned: 1 in 0.564s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:31:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-95002ecc-4b30-452c-a83c-9fad70866b44 tempest-VolumesImageMetadata-1458491224 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-65126b2c-ab60-45ad-b2bd-a067c9c3bc8c' failed. Not Retrying. {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 16:31:41 devstack cinder-volume[87166]: DEBUG cinder.volume.volume_utils [None req-95002ecc-4b30-452c-a83c-9fad70866b44 tempest-VolumesImageMetadata-1458491224 None] Downloaded image 9a5fa908-fde1-4478-9fb5-d52ec5aeacfd ((None, [{'url': 'file:///opt/stack/data/glance/images/9a5fa908-fde1-4478-9fb5-d52ec5aeacfd', 'metadata': {}}])) to volume 65126b2c-ab60-45ad-b2bd-a067c9c3bc8c successfully. {{(pid=87166) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 14 16:31:41 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-95002ecc-4b30-452c-a83c-9fad70866b44 tempest-VolumesImageMetadata-1458491224 None] Temporary image 9a5fa908-fde1-4478-9fb5-d52ec5aeacfd for user e5e4fe0fc353460f92d6f053ea316f54 is deleted. {{(pid=87166) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 14 16:31:41 devstack cinder-volume[87166]: DEBUG cinder.volume.volume_utils [None req-95002ecc-4b30-452c-a83c-9fad70866b44 tempest-VolumesImageMetadata-1458491224 None] Marking volume 65126b2c-ab60-45ad-b2bd-a067c9c3bc8c as bootable. {{(pid=87166) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 14 16:31:41 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-c8b60ddf-ca41-4767-85a9-9e3d4412a6dd tempest-VolumesListAdminTestJSON-11684788 None] Created reservations ['58ea0ccc-98f4-45b9-baa1-a6c7f792586c', '00e186d1-3680-4a1c-9dfb-a92222d8d0d1', '83d5879b-f5ee-46c0-9c40-817372ec3fbf', 'd4742061-2a40-42ee-bc31-cc7d80d3d047'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:31:41 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-95002ecc-4b30-452c-a83c-9fad70866b44 tempest-VolumesImageMetadata-1458491224 None] Copying metadata from image 9a5fa908-fde1-4478-9fb5-d52ec5aeacfd to 65126b2c-ab60-45ad-b2bd-a067c9c3bc8c. {{(pid=87166) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 14 16:31:41 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-95002ecc-4b30-452c-a83c-9fad70866b44 tempest-VolumesImageMetadata-1458491224 None] Creating volume glance metadata for volume 65126b2c-ab60-45ad-b2bd-a067c9c3bc8c backed by image 9a5fa908-fde1-4478-9fb5-d52ec5aeacfd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9a5fa908-fde1-4478-9fb5-d52ec5aeacfd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87166) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 14 16:31:41 devstack sudo[97529]: pam_unix(sudo:session): session closed for user root
Jul 14 16:31:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-860b334c-57c6-43bb-a619-a660a01b5755 tempest-VolumesListAdminTestJSON-1154068736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.352s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:31:41 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-860b334c-57c6-43bb-a619-a660a01b5755 tempest-VolumesListAdminTestJSON-1154068736 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:31:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c8b60ddf-ca41-4767-85a9-9e3d4412a6dd tempest-VolumesListAdminTestJSON-11684788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:31:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c8b60ddf-ca41-4767-85a9-9e3d4412a6dd tempest-VolumesListAdminTestJSON-11684788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:31:41 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-c8b60ddf-ca41-4767-85a9-9e3d4412a6dd tempest-VolumesListAdminTestJSON-11684788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:31:41 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-c8b60ddf-ca41-4767-85a9-9e3d4412a6dd tempest-VolumesListAdminTestJSON-11684788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:31:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c8b60ddf-ca41-4767-85a9-9e3d4412a6dd tempest-VolumesListAdminTestJSON-11684788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:31:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c8b60ddf-ca41-4767-85a9-9e3d4412a6dd tempest-VolumesListAdminTestJSON-11684788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:31:41 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-860b334c-57c6-43bb-a619-a660a01b5755 tempest-VolumesListAdminTestJSON-1154068736 None] Deleted volume successfully.
Jul 14 16:31:41 devstack sudo[97535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:31:41 devstack sudo[97535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:31:41 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-860b334c-57c6-43bb-a619-a660a01b5755 tempest-VolumesListAdminTestJSON-1154068736 None] Lock "cinder-6c6e2e8d-25ff-4f8d-8814-aca2f20108ae-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:31:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-95002ecc-4b30-452c-a83c-9fad70866b44 tempest-VolumesImageMetadata-1458491224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (894b2fdf-5731-479a-b299-d6dcc03bae54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65126b2c-ab60-45ad-b2bd-a067c9c3bc8c', 'volume_size': 1, 'image_id': '9a5fa908-fde1-4478-9fb5-d52ec5aeacfd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9a5fa908-fde1-4478-9fb5-d52ec5aeacfd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6db24ec5a0f441c18a787b3e9a478713', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9a5fa908-fde1-4478-9fb5-d52ec5aeacfd', 'created_at': datetime.datetime(2026, 7, 14, 14, 17, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 14, 17, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9a5fa908-fde1-4478-9fb5-d52ec5aeacfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74f781093ce0>}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:31:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-95002ecc-4b30-452c-a83c-9fad70866b44 tempest-VolumesImageMetadata-1458491224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9c0a496-c92d-432c-820e-6f957adbb6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:31:41 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-95002ecc-4b30-452c-a83c-9fad70866b44 tempest-VolumesImageMetadata-1458491224 None] Volume volume-65126b2c-ab60-45ad-b2bd-a067c9c3bc8c (65126b2c-ab60-45ad-b2bd-a067c9c3bc8c): created successfully
Jul 14 16:31:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-95002ecc-4b30-452c-a83c-9fad70866b44 tempest-VolumesImageMetadata-1458491224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9c0a496-c92d-432c-820e-6f957adbb6a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:31:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-95002ecc-4b30-452c-a83c-9fad70866b44 tempest-VolumesImageMetadata-1458491224 None] Flow 'volume_create_manager' (fd5b292e-1240-4970-a5a3-06f218bcc117) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:31:41 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-95002ecc-4b30-452c-a83c-9fad70866b44 tempest-VolumesImageMetadata-1458491224 None] Created volume successfully.
Jul 14 16:31:41 devstack sudo[97535]: pam_unix(sudo:session): session closed for user root
Jul 14 16:31:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c8b60ddf-ca41-4767-85a9-9e3d4412a6dd tempest-VolumesListAdminTestJSON-11684788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.344s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:31:41 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-c8b60ddf-ca41-4767-85a9-9e3d4412a6dd tempest-VolumesListAdminTestJSON-11684788 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:31:41 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-c8b60ddf-ca41-4767-85a9-9e3d4412a6dd tempest-VolumesListAdminTestJSON-11684788 None] Deleted volume successfully.
Jul 14 16:31:41 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c8b60ddf-ca41-4767-85a9-9e3d4412a6dd tempest-VolumesListAdminTestJSON-11684788 None] Lock "cinder-585f6342-be34-445f-9dc6-da885a93dfa9-delete_volume" released by "delete_volume" :: held 1.710s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:31:42 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-96a03a61-2a61-4162-abe0-02de4d3b76ff tempest-VolumesImageMetadata-1458491224 None] Acquiring lock "cinder-65126b2c-ab60-45ad-b2bd-a067c9c3bc8c-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:31:42 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-96a03a61-2a61-4162-abe0-02de4d3b76ff tempest-VolumesImageMetadata-1458491224 None] Lock "cinder-65126b2c-ab60-45ad-b2bd-a067c9c3bc8c-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:31:42 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-96a03a61-2a61-4162-abe0-02de4d3b76ff tempest-VolumesImageMetadata-1458491224 None] Acquiring lock "cinder-quobyte-65126b2c-ab60-45ad-b2bd-a067c9c3bc8c" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:31:42 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-96a03a61-2a61-4162-abe0-02de4d3b76ff tempest-VolumesImageMetadata-1458491224 None] Lock "cinder-quobyte-65126b2c-ab60-45ad-b2bd-a067c9c3bc8c" acquired by "delete_volume" :: waited 0.030s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:31:42 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ff3ec156-24e3-47f9-b71c-db30bd13aac8 tempest-VolumesListAdminTestJSON-11684788 None] Acquiring lock "cinder-cd63253f-35e6-43a9-834d-709345a0ad0a-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:31:42 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7120497-0a9f-4dc0-b83c-5a4273a9dd63]: (4, 'raw') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:31:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-96a03a61-2a61-4162-abe0-02de4d3b76ff tempest-VolumesImageMetadata-1458491224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-65126b2c-ab60-45ad-b2bd-a067c9c3bc8c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:31:42 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ff3ec156-24e3-47f9-b71c-db30bd13aac8 tempest-VolumesListAdminTestJSON-11684788 None] Lock "cinder-cd63253f-35e6-43a9-834d-709345a0ad0a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:31:42 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ff3ec156-24e3-47f9-b71c-db30bd13aac8 tempest-VolumesListAdminTestJSON-11684788 None] Acquiring lock "cinder-quobyte-cd63253f-35e6-43a9-834d-709345a0ad0a" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:31:42 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ff3ec156-24e3-47f9-b71c-db30bd13aac8 tempest-VolumesListAdminTestJSON-11684788 None] Lock "cinder-quobyte-cd63253f-35e6-43a9-834d-709345a0ad0a" acquired by "delete_volume" :: waited 0.047s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:31:42 devstack sudo[97541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-65126b2c-ab60-45ad-b2bd-a067c9c3bc8c
Jul 14 16:31:42 devstack sudo[97541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:31:42 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc3d240-16b3-4063-8499-7734dbd6beea]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:31:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ff3ec156-24e3-47f9-b71c-db30bd13aac8 tempest-VolumesListAdminTestJSON-11684788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cd63253f-35e6-43a9-834d-709345a0ad0a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:31:42 devstack sudo[97544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cd63253f-35e6-43a9-834d-709345a0ad0a
Jul 14 16:31:42 devstack sudo[97544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:31:43 devstack sudo[97541]: pam_unix(sudo:session): session closed for user root
Jul 14 16:31:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-96a03a61-2a61-4162-abe0-02de4d3b76ff tempest-VolumesImageMetadata-1458491224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-65126b2c-ab60-45ad-b2bd-a067c9c3bc8c" returned: 0 in 0.453s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:31:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-96a03a61-2a61-4162-abe0-02de4d3b76ff tempest-VolumesImageMetadata-1458491224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-65126b2c-ab60-45ad-b2bd-a067c9c3bc8c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:31:43 devstack sudo[97555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-65126b2c-ab60-45ad-b2bd-a067c9c3bc8c
Jul 14 16:31:43 devstack sudo[97555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:31:43 devstack sudo[97544]: pam_unix(sudo:session): session closed for user root
Jul 14 16:31:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ff3ec156-24e3-47f9-b71c-db30bd13aac8 tempest-VolumesListAdminTestJSON-11684788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cd63253f-35e6-43a9-834d-709345a0ad0a" returned: 0 in 0.575s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:31:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ff3ec156-24e3-47f9-b71c-db30bd13aac8 tempest-VolumesListAdminTestJSON-11684788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cd63253f-35e6-43a9-834d-709345a0ad0a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:31:43 devstack sudo[97566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cd63253f-35e6-43a9-834d-709345a0ad0a
Jul 14 16:31:43 devstack sudo[97566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:31:43 devstack sudo[97555]: pam_unix(sudo:session): session closed for user root
Jul 14 16:31:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-96a03a61-2a61-4162-abe0-02de4d3b76ff tempest-VolumesImageMetadata-1458491224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-65126b2c-ab60-45ad-b2bd-a067c9c3bc8c" returned: 1 in 0.583s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:31:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-96a03a61-2a61-4162-abe0-02de4d3b76ff tempest-VolumesImageMetadata-1458491224 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-65126b2c-ab60-45ad-b2bd-a067c9c3bc8c' failed. Not Retrying. {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 16:31:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-96a03a61-2a61-4162-abe0-02de4d3b76ff tempest-VolumesImageMetadata-1458491224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-65126b2c-ab60-45ad-b2bd-a067c9c3bc8c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:31:43 devstack sudo[97572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-65126b2c-ab60-45ad-b2bd-a067c9c3bc8c
Jul 14 16:31:43 devstack sudo[97572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:31:43 devstack sudo[97566]: pam_unix(sudo:session): session closed for user root
Jul 14 16:31:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ff3ec156-24e3-47f9-b71c-db30bd13aac8 tempest-VolumesListAdminTestJSON-11684788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cd63253f-35e6-43a9-834d-709345a0ad0a" returned: 0 in 0.361s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:31:43 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ff3ec156-24e3-47f9-b71c-db30bd13aac8 tempest-VolumesListAdminTestJSON-11684788 None] Lock "cinder-quobyte-cd63253f-35e6-43a9-834d-709345a0ad0a" released by "delete_volume" :: held 1.009s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:31:43 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-ff3ec156-24e3-47f9-b71c-db30bd13aac8 tempest-VolumesListAdminTestJSON-11684788 None] Created reservations ['b1c0f25e-43cd-4da6-ba07-46bb0b404c25', 'a3745877-63a5-479b-9e43-3d1cd74913bd', '0519a0ce-90f0-42f3-aefd-5beb41d0303f', 'a9413006-7063-45d0-9eae-8dd1b4461950'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:31:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ff3ec156-24e3-47f9-b71c-db30bd13aac8 tempest-VolumesListAdminTestJSON-11684788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:31:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ff3ec156-24e3-47f9-b71c-db30bd13aac8 tempest-VolumesListAdminTestJSON-11684788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:31:43 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ff3ec156-24e3-47f9-b71c-db30bd13aac8 tempest-VolumesListAdminTestJSON-11684788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:31:43 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ff3ec156-24e3-47f9-b71c-db30bd13aac8 tempest-VolumesListAdminTestJSON-11684788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:31:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ff3ec156-24e3-47f9-b71c-db30bd13aac8 tempest-VolumesListAdminTestJSON-11684788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:31:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ff3ec156-24e3-47f9-b71c-db30bd13aac8 tempest-VolumesListAdminTestJSON-11684788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:31:43 devstack sudo[97574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:31:43 devstack sudo[97574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:31:44 devstack sudo[97572]: pam_unix(sudo:session): session closed for user root
Jul 14 16:31:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-96a03a61-2a61-4162-abe0-02de4d3b76ff tempest-VolumesImageMetadata-1458491224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-65126b2c-ab60-45ad-b2bd-a067c9c3bc8c" returned: 0 in 0.408s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:31:44 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-96a03a61-2a61-4162-abe0-02de4d3b76ff tempest-VolumesImageMetadata-1458491224 None] Lock "cinder-quobyte-65126b2c-ab60-45ad-b2bd-a067c9c3bc8c" released by "delete_volume" :: held 1.587s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:31:44 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-96a03a61-2a61-4162-abe0-02de4d3b76ff tempest-VolumesImageMetadata-1458491224 None] Created reservations ['b10e2622-bafc-460b-9010-c7339dca31f0', '1566d022-e8b2-4a49-84c0-208b8ef59b4a', 'e1499feb-989a-4191-a272-040f57e7007a', '1ef8d60f-22ab-4a7d-b2c2-efee6b193347'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:31:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-96a03a61-2a61-4162-abe0-02de4d3b76ff tempest-VolumesImageMetadata-1458491224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:31:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-96a03a61-2a61-4162-abe0-02de4d3b76ff tempest-VolumesImageMetadata-1458491224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:31:44 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-96a03a61-2a61-4162-abe0-02de4d3b76ff tempest-VolumesImageMetadata-1458491224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:31:44 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-96a03a61-2a61-4162-abe0-02de4d3b76ff tempest-VolumesImageMetadata-1458491224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:31:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-96a03a61-2a61-4162-abe0-02de4d3b76ff tempest-VolumesImageMetadata-1458491224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:31:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-96a03a61-2a61-4162-abe0-02de4d3b76ff tempest-VolumesImageMetadata-1458491224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:31:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ff3ec156-24e3-47f9-b71c-db30bd13aac8 tempest-VolumesListAdminTestJSON-11684788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.323s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:31:44 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-ff3ec156-24e3-47f9-b71c-db30bd13aac8 tempest-VolumesListAdminTestJSON-11684788 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:31:44 devstack sudo[97574]: pam_unix(sudo:session): session closed for user root
Jul 14 16:31:44 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-ff3ec156-24e3-47f9-b71c-db30bd13aac8 tempest-VolumesListAdminTestJSON-11684788 None] Deleted volume successfully.
Jul 14 16:31:44 devstack sudo[97578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:31:44 devstack sudo[97578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:31:44 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ff3ec156-24e3-47f9-b71c-db30bd13aac8 tempest-VolumesListAdminTestJSON-11684788 None] Lock "cinder-cd63253f-35e6-43a9-834d-709345a0ad0a-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:31:44 devstack sudo[97578]: pam_unix(sudo:session): session closed for user root
Jul 14 16:31:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-96a03a61-2a61-4162-abe0-02de4d3b76ff tempest-VolumesImageMetadata-1458491224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.286s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:31:44 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-96a03a61-2a61-4162-abe0-02de4d3b76ff tempest-VolumesImageMetadata-1458491224 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:31:44 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-96a03a61-2a61-4162-abe0-02de4d3b76ff tempest-VolumesImageMetadata-1458491224 None] Deleted volume successfully.
Jul 14 16:31:44 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-96a03a61-2a61-4162-abe0-02de4d3b76ff tempest-VolumesImageMetadata-1458491224 None] Lock "cinder-65126b2c-ab60-45ad-b2bd-a067c9c3bc8c-delete_volume" released by "delete_volume" :: held 2.137s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:31:45 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-aa23f5c7-9fb0-4a6f-9f75-d836004c6760 tempest-VolumesListAdminTestJSON-11684788 None] Acquiring lock "cinder-80be107f-f157-48b3-97cb-a6852c5993b3-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:31:45 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-aa23f5c7-9fb0-4a6f-9f75-d836004c6760 tempest-VolumesListAdminTestJSON-11684788 None] Lock "cinder-80be107f-f157-48b3-97cb-a6852c5993b3-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:31:45 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-aa23f5c7-9fb0-4a6f-9f75-d836004c6760 tempest-VolumesListAdminTestJSON-11684788 None] Acquiring lock "cinder-quobyte-80be107f-f157-48b3-97cb-a6852c5993b3" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:31:45 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-aa23f5c7-9fb0-4a6f-9f75-d836004c6760 tempest-VolumesListAdminTestJSON-11684788 None] Lock "cinder-quobyte-80be107f-f157-48b3-97cb-a6852c5993b3" acquired by "delete_volume" :: waited 0.025s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:31:45 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f4ef84-6d52-42ea-94da-023adb61f501]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:31:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-aa23f5c7-9fb0-4a6f-9f75-d836004c6760 tempest-VolumesListAdminTestJSON-11684788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-80be107f-f157-48b3-97cb-a6852c5993b3 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:31:45 devstack sudo[97582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-80be107f-f157-48b3-97cb-a6852c5993b3
Jul 14 16:31:45 devstack sudo[97582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:31:45 devstack sudo[97582]: pam_unix(sudo:session): session closed for user root
Jul 14 16:31:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-aa23f5c7-9fb0-4a6f-9f75-d836004c6760 tempest-VolumesListAdminTestJSON-11684788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-80be107f-f157-48b3-97cb-a6852c5993b3" returned: 0 in 0.551s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:31:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-aa23f5c7-9fb0-4a6f-9f75-d836004c6760 tempest-VolumesListAdminTestJSON-11684788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-80be107f-f157-48b3-97cb-a6852c5993b3 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:31:45 devstack sudo[97587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-80be107f-f157-48b3-97cb-a6852c5993b3
Jul 14 16:31:45 devstack sudo[97587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:31:46 devstack sudo[97587]: pam_unix(sudo:session): session closed for user root
Jul 14 16:31:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-aa23f5c7-9fb0-4a6f-9f75-d836004c6760 tempest-VolumesListAdminTestJSON-11684788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-80be107f-f157-48b3-97cb-a6852c5993b3" returned: 0 in 0.341s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:31:46 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-aa23f5c7-9fb0-4a6f-9f75-d836004c6760 tempest-VolumesListAdminTestJSON-11684788 None] Lock "cinder-quobyte-80be107f-f157-48b3-97cb-a6852c5993b3" released by "delete_volume" :: held 0.975s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:31:46 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-aa23f5c7-9fb0-4a6f-9f75-d836004c6760 tempest-VolumesListAdminTestJSON-11684788 None] Created reservations ['74e09de7-a7e6-4967-8f65-9e613420376e', '0c0193de-6d4e-46b5-8d03-29bd2f670dd0', '97b2b2b5-013b-4d36-a201-78288f4f5d99', '2d8366e8-1fbd-4bfb-9ed5-c3d9d74b5521'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:31:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-aa23f5c7-9fb0-4a6f-9f75-d836004c6760 tempest-VolumesListAdminTestJSON-11684788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:31:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-aa23f5c7-9fb0-4a6f-9f75-d836004c6760 tempest-VolumesListAdminTestJSON-11684788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:31:46 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-aa23f5c7-9fb0-4a6f-9f75-d836004c6760 tempest-VolumesListAdminTestJSON-11684788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:31:46 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-aa23f5c7-9fb0-4a6f-9f75-d836004c6760 tempest-VolumesListAdminTestJSON-11684788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:31:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-aa23f5c7-9fb0-4a6f-9f75-d836004c6760 tempest-VolumesListAdminTestJSON-11684788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:31:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-aa23f5c7-9fb0-4a6f-9f75-d836004c6760 tempest-VolumesListAdminTestJSON-11684788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:31:46 devstack sudo[97614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:31:46 devstack sudo[97614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:31:47 devstack sudo[97614]: pam_unix(sudo:session): session closed for user root
Jul 14 16:31:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-aa23f5c7-9fb0-4a6f-9f75-d836004c6760 tempest-VolumesListAdminTestJSON-11684788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.696s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:31:47 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-aa23f5c7-9fb0-4a6f-9f75-d836004c6760 tempest-VolumesListAdminTestJSON-11684788 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:31:47 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-aa23f5c7-9fb0-4a6f-9f75-d836004c6760 tempest-VolumesListAdminTestJSON-11684788 None] Deleted volume successfully.
Jul 14 16:31:47 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-aa23f5c7-9fb0-4a6f-9f75-d836004c6760 tempest-VolumesListAdminTestJSON-11684788 None] Lock "cinder-80be107f-f157-48b3-97cb-a6852c5993b3-delete_volume" released by "delete_volume" :: held 2.266s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:31:50 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-fab7df90-976e-465e-9db0-463e7a3a7c1f tempest-VolumesDeleteCascade-715576226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:31:50 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fab7df90-976e-465e-9db0-463e7a3a7c1f tempest-VolumesDeleteCascade-715576226 None] Flow 'volume_create_manager' (7be4c650-7d33-4f9b-98db-652e3b91096f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:31:50 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fab7df90-976e-465e-9db0-463e7a3a7c1f tempest-VolumesDeleteCascade-715576226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9819fd8e-ecf7-4300-8c9e-687d4fc105dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:31:50 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fab7df90-976e-465e-9db0-463e7a3a7c1f tempest-VolumesDeleteCascade-715576226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9819fd8e-ecf7-4300-8c9e-687d4fc105dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:31:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2040761146',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ff994a4-f726-4766-807a-ef71fcf1bbe8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e74c2ad7217481a9f31d066d412ae96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:31:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:31:51Z,use_quota=True,user_id='a72b59e85e1f4f1ea7aedbc379420875',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:31:50 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fab7df90-976e-465e-9db0-463e7a3a7c1f tempest-VolumesDeleteCascade-715576226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4501d0c0-ee4d-4d20-8c51-4b246fe01e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:31:50 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fab7df90-976e-465e-9db0-463e7a3a7c1f tempest-VolumesDeleteCascade-715576226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4501d0c0-ee4d-4d20-8c51-4b246fe01e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:31:50 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fab7df90-976e-465e-9db0-463e7a3a7c1f tempest-VolumesDeleteCascade-715576226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64b6bb4f-84e9-4628-bc9e-7b8927901c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:31:50 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fab7df90-976e-465e-9db0-463e7a3a7c1f tempest-VolumesDeleteCascade-715576226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64b6bb4f-84e9-4628-bc9e-7b8927901c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ff994a4-f726-4766-807a-ef71fcf1bbe8', 'volume_name': 'volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:31:50 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fab7df90-976e-465e-9db0-463e7a3a7c1f tempest-VolumesDeleteCascade-715576226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa1da82f-dc76-4692-87e3-d45d24cca2d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:31:50 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fab7df90-976e-465e-9db0-463e7a3a7c1f tempest-VolumesDeleteCascade-715576226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa1da82f-dc76-4692-87e3-d45d24cca2d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:31:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fab7df90-976e-465e-9db0-463e7a3a7c1f tempest-VolumesDeleteCascade-715576226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ab5a384-04a5-45ac-94fc-478e18aa5abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:31:51 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-fab7df90-976e-465e-9db0-463e7a3a7c1f tempest-VolumesDeleteCascade-715576226 None] Volume 1ff994a4-f726-4766-807a-ef71fcf1bbe8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8', 'volume_size': 1}
Jul 14 16:31:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-fab7df90-976e-465e-9db0-463e7a3a7c1f tempest-VolumesDeleteCascade-715576226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:31:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-fab7df90-976e-465e-9db0-463e7a3a7c1f tempest-VolumesDeleteCascade-715576226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:31:51 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-fab7df90-976e-465e-9db0-463e7a3a7c1f tempest-VolumesDeleteCascade-715576226 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:31:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2040761146',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ff994a4-f726-4766-807a-ef71fcf1bbe8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e74c2ad7217481a9f31d066d412ae96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:31:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:31:51Z,use_quota=True,user_id='a72b59e85e1f4f1ea7aedbc379420875',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:31:51 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-fab7df90-976e-465e-9db0-463e7a3a7c1f tempest-VolumesDeleteCascade-715576226 None] Creating volume 1ff994a4-f726-4766-807a-ef71fcf1bbe8 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:31:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-fab7df90-976e-465e-9db0-463e7a3a7c1f tempest-VolumesDeleteCascade-715576226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:31:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-fab7df90-976e-465e-9db0-463e7a3a7c1f tempest-VolumesDeleteCascade-715576226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:31:51 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-fab7df90-976e-465e-9db0-463e7a3a7c1f tempest-VolumesDeleteCascade-715576226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:31:51 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-fab7df90-976e-465e-9db0-463e7a3a7c1f tempest-VolumesDeleteCascade-715576226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:31:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-fab7df90-976e-465e-9db0-463e7a3a7c1f tempest-VolumesDeleteCascade-715576226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:31:51 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-fab7df90-976e-465e-9db0-463e7a3a7c1f tempest-VolumesDeleteCascade-715576226 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:31:51 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-fab7df90-976e-465e-9db0-463e7a3a7c1f tempest-VolumesDeleteCascade-715576226 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:31:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fab7df90-976e-465e-9db0-463e7a3a7c1f tempest-VolumesDeleteCascade-715576226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:31:51 devstack sudo[97663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8 1073741824
Jul 14 16:31:51 devstack sudo[97663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:31:51 devstack sudo[97663]: pam_unix(sudo:session): session closed for user root
Jul 14 16:31:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fab7df90-976e-465e-9db0-463e7a3a7c1f tempest-VolumesDeleteCascade-715576226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8 1073741824" returned: 0 in 0.656s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:31:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fab7df90-976e-465e-9db0-463e7a3a7c1f tempest-VolumesDeleteCascade-715576226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:31:51 devstack sudo[97670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8
Jul 14 16:31:51 devstack sudo[97670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:31:52 devstack sudo[97670]: pam_unix(sudo:session): session closed for user root
Jul 14 16:31:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fab7df90-976e-465e-9db0-463e7a3a7c1f tempest-VolumesDeleteCascade-715576226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8" returned: 0 in 0.343s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:31:52 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-fab7df90-976e-465e-9db0-463e7a3a7c1f tempest-VolumesDeleteCascade-715576226 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:31:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-fab7df90-976e-465e-9db0-463e7a3a7c1f tempest-VolumesDeleteCascade-715576226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:31:52 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fab7df90-976e-465e-9db0-463e7a3a7c1f tempest-VolumesDeleteCascade-715576226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ab5a384-04a5-45ac-94fc-478e18aa5abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:31:52 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fab7df90-976e-465e-9db0-463e7a3a7c1f tempest-VolumesDeleteCascade-715576226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f905c565-7df9-4748-bcc9-13705e6c5563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:31:52 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-fab7df90-976e-465e-9db0-463e7a3a7c1f tempest-VolumesDeleteCascade-715576226 None] Volume volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8 (1ff994a4-f726-4766-807a-ef71fcf1bbe8): created successfully
Jul 14 16:31:52 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fab7df90-976e-465e-9db0-463e7a3a7c1f tempest-VolumesDeleteCascade-715576226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f905c565-7df9-4748-bcc9-13705e6c5563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:31:52 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fab7df90-976e-465e-9db0-463e7a3a7c1f tempest-VolumesDeleteCascade-715576226 None] Flow 'volume_create_manager' (7be4c650-7d33-4f9b-98db-652e3b91096f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:31:52 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-fab7df90-976e-465e-9db0-463e7a3a7c1f tempest-VolumesDeleteCascade-715576226 None] Created volume successfully.
Jul 14 16:31:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-46a63eed-9ec3-4bd4-86b7-fb62ceef8ad3 tempest-VolumesDeleteCascade-715576226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:31:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-46a63eed-9ec3-4bd4-86b7-fb62ceef8ad3 tempest-VolumesDeleteCascade-715576226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:31:53 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-46a63eed-9ec3-4bd4-86b7-fb62ceef8ad3 tempest-VolumesDeleteCascade-715576226 None] Creating offline snapshot 2dd1968b-3496-4b94-87d8-2962baf4614f of volume 1ff994a4-f726-4766-807a-ef71fcf1bbe8 {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 16:31:53 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ab9b36-b050-448a-83f9-fb37f5d9308b]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:31:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-46a63eed-9ec3-4bd4-86b7-fb62ceef8ad3 tempest-VolumesDeleteCascade-715576226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:31:53 devstack sudo[97673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8
Jul 14 16:31:53 devstack sudo[97673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:31:53 devstack sudo[97673]: pam_unix(sudo:session): session closed for user root
Jul 14 16:31:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-46a63eed-9ec3-4bd4-86b7-fb62ceef8ad3 tempest-VolumesDeleteCascade-715576226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8" returned: 0 in 0.494s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:31:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-46a63eed-9ec3-4bd4-86b7-fb62ceef8ad3 tempest-VolumesDeleteCascade-715576226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8.2dd1968b-3496-4b94-87d8-2962baf4614f 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:31:53 devstack sudo[97678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8.2dd1968b-3496-4b94-87d8-2962baf4614f 1G
Jul 14 16:31:53 devstack sudo[97678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:31:54 devstack sudo[97678]: pam_unix(sudo:session): session closed for user root
Jul 14 16:31:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-46a63eed-9ec3-4bd4-86b7-fb62ceef8ad3 tempest-VolumesDeleteCascade-715576226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8.2dd1968b-3496-4b94-87d8-2962baf4614f 1G" returned: 0 in 0.619s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:31:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-46a63eed-9ec3-4bd4-86b7-fb62ceef8ad3 tempest-VolumesDeleteCascade-715576226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8.2dd1968b-3496-4b94-87d8-2962baf4614f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:31:54 devstack sudo[97683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8.2dd1968b-3496-4b94-87d8-2962baf4614f
Jul 14 16:31:54 devstack sudo[97683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:31:54 devstack sudo[97683]: pam_unix(sudo:session): session closed for user root
Jul 14 16:31:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-46a63eed-9ec3-4bd4-86b7-fb62ceef8ad3 tempest-VolumesDeleteCascade-715576226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8.2dd1968b-3496-4b94-87d8-2962baf4614f" returned: 0 in 0.423s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:31:54 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-46a63eed-9ec3-4bd4-86b7-fb62ceef8ad3 tempest-VolumesDeleteCascade-715576226 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8.2dd1968b-3496-4b94-87d8-2962baf4614f is being set with open permissions: ugo+rw
Jul 14 16:31:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-46a63eed-9ec3-4bd4-86b7-fb62ceef8ad3 tempest-VolumesDeleteCascade-715576226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8.2dd1968b-3496-4b94-87d8-2962baf4614f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:31:54 devstack sudo[97689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8.2dd1968b-3496-4b94-87d8-2962baf4614f
Jul 14 16:31:54 devstack sudo[97689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:31:55 devstack sudo[97689]: pam_unix(sudo:session): session closed for user root
Jul 14 16:31:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-46a63eed-9ec3-4bd4-86b7-fb62ceef8ad3 tempest-VolumesDeleteCascade-715576226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8.2dd1968b-3496-4b94-87d8-2962baf4614f" returned: 0 in 0.368s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:31:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-46a63eed-9ec3-4bd4-86b7-fb62ceef8ad3 tempest-VolumesDeleteCascade-715576226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:31:55 devstack sudo[97692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8.info
Jul 14 16:31:55 devstack sudo[97692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:31:55 devstack sudo[97692]: pam_unix(sudo:session): session closed for user root
Jul 14 16:31:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-46a63eed-9ec3-4bd4-86b7-fb62ceef8ad3 tempest-VolumesDeleteCascade-715576226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8.info" returned: 0 in 0.403s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:31:55 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-46a63eed-9ec3-4bd4-86b7-fb62ceef8ad3 tempest-VolumesDeleteCascade-715576226 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8.info is being set with open permissions: ugo+rw
Jul 14 16:31:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-46a63eed-9ec3-4bd4-86b7-fb62ceef8ad3 tempest-VolumesDeleteCascade-715576226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:31:55 devstack sudo[97695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8.info
Jul 14 16:31:55 devstack sudo[97695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:31:56 devstack sudo[97695]: pam_unix(sudo:session): session closed for user root
Jul 14 16:31:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-46a63eed-9ec3-4bd4-86b7-fb62ceef8ad3 tempest-VolumesDeleteCascade-715576226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8.info" returned: 0 in 0.356s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:31:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-46a63eed-9ec3-4bd4-86b7-fb62ceef8ad3 tempest-VolumesDeleteCascade-715576226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.834s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:31:56 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-46a63eed-9ec3-4bd4-86b7-fb62ceef8ad3 tempest-VolumesDeleteCascade-715576226 None] Create snapshot completed successfully
Jul 14 16:31:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b8351fdb-0c57-4f4e-aac4-a190e42d3f0e tempest-VolumesDeleteCascade-715576226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:31:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b8351fdb-0c57-4f4e-aac4-a190e42d3f0e tempest-VolumesDeleteCascade-715576226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:31:56 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-b8351fdb-0c57-4f4e-aac4-a190e42d3f0e tempest-VolumesDeleteCascade-715576226 None] Creating offline snapshot e01c3d12-8cb7-4718-8c31-36ed36deaaea of volume 1ff994a4-f726-4766-807a-ef71fcf1bbe8 {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 16:31:56 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f5b590c-ff8c-4ccf-844a-8e1981e43f9f]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:31:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b8351fdb-0c57-4f4e-aac4-a190e42d3f0e tempest-VolumesDeleteCascade-715576226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8.2dd1968b-3496-4b94-87d8-2962baf4614f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:31:57 devstack sudo[97708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8.2dd1968b-3496-4b94-87d8-2962baf4614f
Jul 14 16:31:57 devstack sudo[97708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:31:57 devstack sudo[97708]: pam_unix(sudo:session): session closed for user root
Jul 14 16:31:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b8351fdb-0c57-4f4e-aac4-a190e42d3f0e tempest-VolumesDeleteCascade-715576226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8.2dd1968b-3496-4b94-87d8-2962baf4614f" returned: 0 in 0.582s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:31:57 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-b8351fdb-0c57-4f4e-aac4-a190e42d3f0e tempest-VolumesDeleteCascade-715576226 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 16:31:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b8351fdb-0c57-4f4e-aac4-a190e42d3f0e tempest-VolumesDeleteCascade-715576226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8.2dd1968b-3496-4b94-87d8-2962baf4614f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8.e01c3d12-8cb7-4718-8c31-36ed36deaaea 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:31:57 devstack sudo[97713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8.2dd1968b-3496-4b94-87d8-2962baf4614f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8.e01c3d12-8cb7-4718-8c31-36ed36deaaea 1G
Jul 14 16:31:57 devstack sudo[97713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:31:58 devstack sudo[97713]: pam_unix(sudo:session): session closed for user root
Jul 14 16:31:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b8351fdb-0c57-4f4e-aac4-a190e42d3f0e tempest-VolumesDeleteCascade-715576226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8.2dd1968b-3496-4b94-87d8-2962baf4614f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8.e01c3d12-8cb7-4718-8c31-36ed36deaaea 1G" returned: 0 in 0.533s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:31:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b8351fdb-0c57-4f4e-aac4-a190e42d3f0e tempest-VolumesDeleteCascade-715576226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8.2dd1968b-3496-4b94-87d8-2962baf4614f -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8.e01c3d12-8cb7-4718-8c31-36ed36deaaea {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:31:58 devstack sudo[97720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8.2dd1968b-3496-4b94-87d8-2962baf4614f -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8.e01c3d12-8cb7-4718-8c31-36ed36deaaea
Jul 14 16:31:58 devstack sudo[97720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:31:58 devstack sudo[97720]: pam_unix(sudo:session): session closed for user root
Jul 14 16:31:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b8351fdb-0c57-4f4e-aac4-a190e42d3f0e tempest-VolumesDeleteCascade-715576226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8.2dd1968b-3496-4b94-87d8-2962baf4614f -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8.e01c3d12-8cb7-4718-8c31-36ed36deaaea" returned: 0 in 0.361s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:31:58 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-b8351fdb-0c57-4f4e-aac4-a190e42d3f0e tempest-VolumesDeleteCascade-715576226 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8.e01c3d12-8cb7-4718-8c31-36ed36deaaea is being set with open permissions: ugo+rw
Jul 14 16:31:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b8351fdb-0c57-4f4e-aac4-a190e42d3f0e tempest-VolumesDeleteCascade-715576226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8.e01c3d12-8cb7-4718-8c31-36ed36deaaea {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:31:58 devstack sudo[97726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8.e01c3d12-8cb7-4718-8c31-36ed36deaaea
Jul 14 16:31:58 devstack sudo[97726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:31:58 devstack sudo[97726]: pam_unix(sudo:session): session closed for user root
Jul 14 16:31:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b8351fdb-0c57-4f4e-aac4-a190e42d3f0e tempest-VolumesDeleteCascade-715576226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8.e01c3d12-8cb7-4718-8c31-36ed36deaaea" returned: 0 in 0.294s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:31:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b8351fdb-0c57-4f4e-aac4-a190e42d3f0e tempest-VolumesDeleteCascade-715576226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.939s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:31:58 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-b8351fdb-0c57-4f4e-aac4-a190e42d3f0e tempest-VolumesDeleteCascade-715576226 None] Create snapshot completed successfully
Jul 14 16:31:59 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-bebe0abe-309b-401c-a030-d3ad7e2f1f09 tempest-VolumesDeleteCascade-715576226 None] Acquiring lock "cinder-1ff994a4-f726-4766-807a-ef71fcf1bbe8-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:31:59 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-bebe0abe-309b-401c-a030-d3ad7e2f1f09 tempest-VolumesDeleteCascade-715576226 None] Lock "cinder-1ff994a4-f726-4766-807a-ef71fcf1bbe8-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:31:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-bebe0abe-309b-401c-a030-d3ad7e2f1f09 tempest-VolumesDeleteCascade-715576226 None] Performing cascade delete. {{(pid=87166) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Jul 14 16:31:59 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-bebe0abe-309b-401c-a030-d3ad7e2f1f09 tempest-VolumesDeleteCascade-715576226 None] Acquiring lock "cinder-2dd1968b-3496-4b94-87d8-2962baf4614f-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:31:59 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-bebe0abe-309b-401c-a030-d3ad7e2f1f09 tempest-VolumesDeleteCascade-715576226 None] Lock "cinder-2dd1968b-3496-4b94-87d8-2962baf4614f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:31:59 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-bebe0abe-309b-401c-a030-d3ad7e2f1f09 tempest-VolumesDeleteCascade-715576226 None] Acquiring lock "cinder-quobyte-1ff994a4-f726-4766-807a-ef71fcf1bbe8" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:31:59 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-bebe0abe-309b-401c-a030-d3ad7e2f1f09 tempest-VolumesDeleteCascade-715576226 None] Lock "cinder-quobyte-1ff994a4-f726-4766-807a-ef71fcf1bbe8" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:31:59 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-bebe0abe-309b-401c-a030-d3ad7e2f1f09 tempest-VolumesDeleteCascade-715576226 None] Acquiring lock "cinder-quobyte-2dd1968b-3496-4b94-87d8-2962baf4614f" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:31:59 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-bebe0abe-309b-401c-a030-d3ad7e2f1f09 tempest-VolumesDeleteCascade-715576226 None] Lock "cinder-quobyte-2dd1968b-3496-4b94-87d8-2962baf4614f" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:31:59 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-bebe0abe-309b-401c-a030-d3ad7e2f1f09 tempest-VolumesDeleteCascade-715576226 None] Deleting offline snapshot 2dd1968b-3496-4b94-87d8-2962baf4614f of volume 1ff994a4-f726-4766-807a-ef71fcf1bbe8 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 16:31:59 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-bebe0abe-309b-401c-a030-d3ad7e2f1f09 tempest-VolumesDeleteCascade-715576226 None] snapshot_file for this snap is: volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8.2dd1968b-3496-4b94-87d8-2962baf4614f {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 16:31:59 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce2aea2-52a4-4432-a149-c617a52728cd]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:31:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bebe0abe-309b-401c-a030-d3ad7e2f1f09 tempest-VolumesDeleteCascade-715576226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8.2dd1968b-3496-4b94-87d8-2962baf4614f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:31:59 devstack sudo[97730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8.2dd1968b-3496-4b94-87d8-2962baf4614f
Jul 14 16:31:59 devstack sudo[97730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:31:59 devstack sudo[97730]: pam_unix(sudo:session): session closed for user root
Jul 14 16:31:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bebe0abe-309b-401c-a030-d3ad7e2f1f09 tempest-VolumesDeleteCascade-715576226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8.2dd1968b-3496-4b94-87d8-2962baf4614f" returned: 0 in 0.483s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:31:59 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-bebe0abe-309b-401c-a030-d3ad7e2f1f09 tempest-VolumesDeleteCascade-715576226 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 16:31:59 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff53a36-6625-4fd5-821d-4a8009f18356]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:31:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bebe0abe-309b-401c-a030-d3ad7e2f1f09 tempest-VolumesDeleteCascade-715576226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:31:59 devstack sudo[97735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8
Jul 14 16:31:59 devstack sudo[97735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:00 devstack sudo[97735]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bebe0abe-309b-401c-a030-d3ad7e2f1f09 tempest-VolumesDeleteCascade-715576226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8" returned: 0 in 0.517s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:00 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[49242177-57d2-4e13-835a-c65a0b60ccde]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:32:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bebe0abe-309b-401c-a030-d3ad7e2f1f09 tempest-VolumesDeleteCascade-715576226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8.e01c3d12-8cb7-4718-8c31-36ed36deaaea {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:00 devstack sudo[97760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8.e01c3d12-8cb7-4718-8c31-36ed36deaaea
Jul 14 16:32:00 devstack sudo[97760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:00 devstack sudo[97760]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bebe0abe-309b-401c-a030-d3ad7e2f1f09 tempest-VolumesDeleteCascade-715576226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8.e01c3d12-8cb7-4718-8c31-36ed36deaaea" returned: 0 in 0.545s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:00 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-bebe0abe-309b-401c-a030-d3ad7e2f1f09 tempest-VolumesDeleteCascade-715576226 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 16:32:00 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[87973b43-66fb-4f27-9ed2-4dfd434e95c6]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:32:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bebe0abe-309b-401c-a030-d3ad7e2f1f09 tempest-VolumesDeleteCascade-715576226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8.2dd1968b-3496-4b94-87d8-2962baf4614f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:01 devstack sudo[97765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8.2dd1968b-3496-4b94-87d8-2962baf4614f
Jul 14 16:32:01 devstack sudo[97765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:01 devstack sudo[97765]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bebe0abe-309b-401c-a030-d3ad7e2f1f09 tempest-VolumesDeleteCascade-715576226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8.2dd1968b-3496-4b94-87d8-2962baf4614f" returned: 0 in 0.444s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:01 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-bebe0abe-309b-401c-a030-d3ad7e2f1f09 tempest-VolumesDeleteCascade-715576226 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 16:32:01 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a889345-f643-4205-bb2d-0232f5b44082]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:32:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bebe0abe-309b-401c-a030-d3ad7e2f1f09 tempest-VolumesDeleteCascade-715576226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:01 devstack sudo[97770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8
Jul 14 16:32:01 devstack sudo[97770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:01 devstack sudo[97770]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bebe0abe-309b-401c-a030-d3ad7e2f1f09 tempest-VolumesDeleteCascade-715576226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8" returned: 0 in 0.485s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bebe0abe-309b-401c-a030-d3ad7e2f1f09 tempest-VolumesDeleteCascade-715576226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8.2dd1968b-3496-4b94-87d8-2962baf4614f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:01 devstack sudo[97776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8.2dd1968b-3496-4b94-87d8-2962baf4614f
Jul 14 16:32:01 devstack sudo[97776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:02 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-d64478ef-f43a-4677-b6d3-e8073c680ffd tempest-VolumesCloneNegativeTest-1389822613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:32:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d64478ef-f43a-4677-b6d3-e8073c680ffd tempest-VolumesCloneNegativeTest-1389822613 None] Flow 'volume_create_manager' (cafbe385-4209-422a-924b-e7120f6042b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:32:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d64478ef-f43a-4677-b6d3-e8073c680ffd tempest-VolumesCloneNegativeTest-1389822613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33a58a2f-9628-4913-beb5-ea6895ce2970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d64478ef-f43a-4677-b6d3-e8073c680ffd tempest-VolumesCloneNegativeTest-1389822613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33a58a2f-9628-4913-beb5-ea6895ce2970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:32:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-832389836',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e10a714-e4f6-4bde-85da-2de449418bb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9ec9980ce1d45179c0ef6e3ceef5c79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:32:02Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:32:02Z,use_quota=True,user_id='1d8e974e3e964131a122402865398446',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d64478ef-f43a-4677-b6d3-e8073c680ffd tempest-VolumesCloneNegativeTest-1389822613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (006e9a6b-9eb9-4232-8fb9-b20dddd125de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d64478ef-f43a-4677-b6d3-e8073c680ffd tempest-VolumesCloneNegativeTest-1389822613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (006e9a6b-9eb9-4232-8fb9-b20dddd125de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d64478ef-f43a-4677-b6d3-e8073c680ffd tempest-VolumesCloneNegativeTest-1389822613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (827c3fdf-817c-4691-95c1-134cfe37cf11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d64478ef-f43a-4677-b6d3-e8073c680ffd tempest-VolumesCloneNegativeTest-1389822613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (827c3fdf-817c-4691-95c1-134cfe37cf11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e10a714-e4f6-4bde-85da-2de449418bb0', 'volume_name': 'volume-1e10a714-e4f6-4bde-85da-2de449418bb0', 'volume_size': 2}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d64478ef-f43a-4677-b6d3-e8073c680ffd tempest-VolumesCloneNegativeTest-1389822613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1237bc90-4885-4b52-808d-21285f83f7ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d64478ef-f43a-4677-b6d3-e8073c680ffd tempest-VolumesCloneNegativeTest-1389822613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1237bc90-4885-4b52-808d-21285f83f7ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d64478ef-f43a-4677-b6d3-e8073c680ffd tempest-VolumesCloneNegativeTest-1389822613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80cf1e04-bbf4-4aae-b443-ab72b93ce0ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:02 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-d64478ef-f43a-4677-b6d3-e8073c680ffd tempest-VolumesCloneNegativeTest-1389822613 None] Volume 1e10a714-e4f6-4bde-85da-2de449418bb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e10a714-e4f6-4bde-85da-2de449418bb0', 'volume_size': 2}
Jul 14 16:32:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d64478ef-f43a-4677-b6d3-e8073c680ffd tempest-VolumesCloneNegativeTest-1389822613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:32:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d64478ef-f43a-4677-b6d3-e8073c680ffd tempest-VolumesCloneNegativeTest-1389822613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:32:02 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d64478ef-f43a-4677-b6d3-e8073c680ffd tempest-VolumesCloneNegativeTest-1389822613 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:32:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-832389836',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e10a714-e4f6-4bde-85da-2de449418bb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9ec9980ce1d45179c0ef6e3ceef5c79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:32:02Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:32:02Z,use_quota=True,user_id='1d8e974e3e964131a122402865398446',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:32:02 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-d64478ef-f43a-4677-b6d3-e8073c680ffd tempest-VolumesCloneNegativeTest-1389822613 None] Creating volume 1e10a714-e4f6-4bde-85da-2de449418bb0 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:32:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d64478ef-f43a-4677-b6d3-e8073c680ffd tempest-VolumesCloneNegativeTest-1389822613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:32:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d64478ef-f43a-4677-b6d3-e8073c680ffd tempest-VolumesCloneNegativeTest-1389822613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:32:02 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d64478ef-f43a-4677-b6d3-e8073c680ffd tempest-VolumesCloneNegativeTest-1389822613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:32:02 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d64478ef-f43a-4677-b6d3-e8073c680ffd tempest-VolumesCloneNegativeTest-1389822613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:32:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d64478ef-f43a-4677-b6d3-e8073c680ffd tempest-VolumesCloneNegativeTest-1389822613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:32:02 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d64478ef-f43a-4677-b6d3-e8073c680ffd tempest-VolumesCloneNegativeTest-1389822613 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:32:02 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-d64478ef-f43a-4677-b6d3-e8073c680ffd tempest-VolumesCloneNegativeTest-1389822613 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:32:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d64478ef-f43a-4677-b6d3-e8073c680ffd tempest-VolumesCloneNegativeTest-1389822613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1e10a714-e4f6-4bde-85da-2de449418bb0 2147483648 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:02 devstack sudo[97778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1e10a714-e4f6-4bde-85da-2de449418bb0 2147483648
Jul 14 16:32:02 devstack sudo[97778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:02 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb9fcdb3-1d8c-4393-9b62-e2326539698b tempest-VolumeQuotasAdminTestJSON-1380193074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:32:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cb9fcdb3-1d8c-4393-9b62-e2326539698b tempest-VolumeQuotasAdminTestJSON-1380193074 None] Flow 'volume_create_manager' (905d347c-43ff-463b-9795-27be945436ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:32:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cb9fcdb3-1d8c-4393-9b62-e2326539698b tempest-VolumeQuotasAdminTestJSON-1380193074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c27f494a-3b30-4e2b-8998-76f7f1578b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cb9fcdb3-1d8c-4393-9b62-e2326539698b tempest-VolumeQuotasAdminTestJSON-1380193074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c27f494a-3b30-4e2b-8998-76f7f1578b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:32:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1843961739',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a247118a-a623-4220-bbf6-b33c187894ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a790af61d1b34482b82b59d0acc05e9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:32:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:32:02Z,use_quota=True,user_id='2aff79ac0c96452e8905a0fc47e6a4e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cb9fcdb3-1d8c-4393-9b62-e2326539698b tempest-VolumeQuotasAdminTestJSON-1380193074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d562791e-5e08-44a6-866c-79677aacc8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cb9fcdb3-1d8c-4393-9b62-e2326539698b tempest-VolumeQuotasAdminTestJSON-1380193074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d562791e-5e08-44a6-866c-79677aacc8bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cb9fcdb3-1d8c-4393-9b62-e2326539698b tempest-VolumeQuotasAdminTestJSON-1380193074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31265cfb-b2c4-4135-a907-d60a2a26223b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cb9fcdb3-1d8c-4393-9b62-e2326539698b tempest-VolumeQuotasAdminTestJSON-1380193074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31265cfb-b2c4-4135-a907-d60a2a26223b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a247118a-a623-4220-bbf6-b33c187894ca', 'volume_name': 'volume-a247118a-a623-4220-bbf6-b33c187894ca', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cb9fcdb3-1d8c-4393-9b62-e2326539698b tempest-VolumeQuotasAdminTestJSON-1380193074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (832e5d0a-d20a-43cc-80b1-71c021fbd4ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cb9fcdb3-1d8c-4393-9b62-e2326539698b tempest-VolumeQuotasAdminTestJSON-1380193074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (832e5d0a-d20a-43cc-80b1-71c021fbd4ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cb9fcdb3-1d8c-4393-9b62-e2326539698b tempest-VolumeQuotasAdminTestJSON-1380193074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (667ab338-6a25-4836-8ed9-23aef1a8eb55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:02 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-cb9fcdb3-1d8c-4393-9b62-e2326539698b tempest-VolumeQuotasAdminTestJSON-1380193074 None] Volume a247118a-a623-4220-bbf6-b33c187894ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a247118a-a623-4220-bbf6-b33c187894ca', 'volume_size': 1}
Jul 14 16:32:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cb9fcdb3-1d8c-4393-9b62-e2326539698b tempest-VolumeQuotasAdminTestJSON-1380193074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:32:02 devstack sudo[97776]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bebe0abe-309b-401c-a030-d3ad7e2f1f09 tempest-VolumesDeleteCascade-715576226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8.2dd1968b-3496-4b94-87d8-2962baf4614f" returned: 0 in 0.382s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bebe0abe-309b-401c-a030-d3ad7e2f1f09 tempest-VolumesDeleteCascade-715576226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8.2dd1968b-3496-4b94-87d8-2962baf4614f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:02 devstack sudo[97784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8.2dd1968b-3496-4b94-87d8-2962baf4614f
Jul 14 16:32:02 devstack sudo[97784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:02 devstack sudo[97784]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bebe0abe-309b-401c-a030-d3ad7e2f1f09 tempest-VolumesDeleteCascade-715576226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8.2dd1968b-3496-4b94-87d8-2962baf4614f" returned: 0 in 0.277s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bebe0abe-309b-401c-a030-d3ad7e2f1f09 tempest-VolumesDeleteCascade-715576226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8.e01c3d12-8cb7-4718-8c31-36ed36deaaea -F qcow2 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:02 devstack sudo[97791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8.e01c3d12-8cb7-4718-8c31-36ed36deaaea -F qcow2
Jul 14 16:32:02 devstack sudo[97791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:02 devstack sudo[97778]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d64478ef-f43a-4677-b6d3-e8073c680ffd tempest-VolumesCloneNegativeTest-1389822613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1e10a714-e4f6-4bde-85da-2de449418bb0 2147483648" returned: 0 in 0.544s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d64478ef-f43a-4677-b6d3-e8073c680ffd tempest-VolumesCloneNegativeTest-1389822613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1e10a714-e4f6-4bde-85da-2de449418bb0 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:02 devstack sudo[97793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1e10a714-e4f6-4bde-85da-2de449418bb0
Jul 14 16:32:02 devstack sudo[97793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:02 devstack sudo[97791]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bebe0abe-309b-401c-a030-d3ad7e2f1f09 tempest-VolumesDeleteCascade-715576226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8.e01c3d12-8cb7-4718-8c31-36ed36deaaea -F qcow2" returned: 0 in 0.373s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:02 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-bebe0abe-309b-401c-a030-d3ad7e2f1f09 tempest-VolumesDeleteCascade-715576226 None] Lock "cinder-quobyte-2dd1968b-3496-4b94-87d8-2962baf4614f" released by "_delete_snapshot" :: held 3.710s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:32:03 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-bebe0abe-309b-401c-a030-d3ad7e2f1f09 tempest-VolumesDeleteCascade-715576226 None] Lock "cinder-quobyte-1ff994a4-f726-4766-807a-ef71fcf1bbe8" released by "delete_snapshot" :: held 3.743s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:32:03 devstack sudo[97793]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d64478ef-f43a-4677-b6d3-e8073c680ffd tempest-VolumesCloneNegativeTest-1389822613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1e10a714-e4f6-4bde-85da-2de449418bb0" returned: 0 in 0.346s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d64478ef-f43a-4677-b6d3-e8073c680ffd tempest-VolumesCloneNegativeTest-1389822613 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:32:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d64478ef-f43a-4677-b6d3-e8073c680ffd tempest-VolumesCloneNegativeTest-1389822613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:32:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cb9fcdb3-1d8c-4393-9b62-e2326539698b tempest-VolumeQuotasAdminTestJSON-1380193074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.768s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:32:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-cb9fcdb3-1d8c-4393-9b62-e2326539698b tempest-VolumeQuotasAdminTestJSON-1380193074 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:32:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1843961739',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a247118a-a623-4220-bbf6-b33c187894ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a790af61d1b34482b82b59d0acc05e9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:32:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:32:02Z,use_quota=True,user_id='2aff79ac0c96452e8905a0fc47e6a4e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:32:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-cb9fcdb3-1d8c-4393-9b62-e2326539698b tempest-VolumeQuotasAdminTestJSON-1380193074 None] Creating volume a247118a-a623-4220-bbf6-b33c187894ca {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:32:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cb9fcdb3-1d8c-4393-9b62-e2326539698b tempest-VolumeQuotasAdminTestJSON-1380193074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:32:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cb9fcdb3-1d8c-4393-9b62-e2326539698b tempest-VolumeQuotasAdminTestJSON-1380193074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:32:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-cb9fcdb3-1d8c-4393-9b62-e2326539698b tempest-VolumeQuotasAdminTestJSON-1380193074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:32:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-cb9fcdb3-1d8c-4393-9b62-e2326539698b tempest-VolumeQuotasAdminTestJSON-1380193074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:32:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cb9fcdb3-1d8c-4393-9b62-e2326539698b tempest-VolumeQuotasAdminTestJSON-1380193074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:32:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-cb9fcdb3-1d8c-4393-9b62-e2326539698b tempest-VolumeQuotasAdminTestJSON-1380193074 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:32:03 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-cb9fcdb3-1d8c-4393-9b62-e2326539698b tempest-VolumeQuotasAdminTestJSON-1380193074 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:32:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cb9fcdb3-1d8c-4393-9b62-e2326539698b tempest-VolumeQuotasAdminTestJSON-1380193074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a247118a-a623-4220-bbf6-b33c187894ca 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:03 devstack sudo[97833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a247118a-a623-4220-bbf6-b33c187894ca 1073741824
Jul 14 16:32:03 devstack sudo[97833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d64478ef-f43a-4677-b6d3-e8073c680ffd tempest-VolumesCloneNegativeTest-1389822613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80cf1e04-bbf4-4aae-b443-ab72b93ce0ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e10a714-e4f6-4bde-85da-2de449418bb0', 'volume_size': 2}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d64478ef-f43a-4677-b6d3-e8073c680ffd tempest-VolumesCloneNegativeTest-1389822613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9959b0f8-5613-4140-b8ef-092026b8caa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:03 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-d64478ef-f43a-4677-b6d3-e8073c680ffd tempest-VolumesCloneNegativeTest-1389822613 None] Volume volume-1e10a714-e4f6-4bde-85da-2de449418bb0 (1e10a714-e4f6-4bde-85da-2de449418bb0): created successfully
Jul 14 16:32:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d64478ef-f43a-4677-b6d3-e8073c680ffd tempest-VolumesCloneNegativeTest-1389822613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9959b0f8-5613-4140-b8ef-092026b8caa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d64478ef-f43a-4677-b6d3-e8073c680ffd tempest-VolumesCloneNegativeTest-1389822613 None] Flow 'volume_create_manager' (cafbe385-4209-422a-924b-e7120f6042b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:32:03 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-bebe0abe-309b-401c-a030-d3ad7e2f1f09 tempest-VolumesDeleteCascade-715576226 None] Created reservations ['73b5ebe0-5dad-40d5-aba5-59878c4dcc23', '11f627d9-5b39-45f8-a8d0-d8a31f36855a', '409fffec-2397-4a2b-8d8f-5c0ef7a9b2e6', '393a67be-53c1-48d9-99cd-400ff9c0c769'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:32:03 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-d64478ef-f43a-4677-b6d3-e8073c680ffd tempest-VolumesCloneNegativeTest-1389822613 None] Created volume successfully.
Jul 14 16:32:03 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-bebe0abe-309b-401c-a030-d3ad7e2f1f09 tempest-VolumesDeleteCascade-715576226 None] Delete snapshot completed successfully.
Jul 14 16:32:03 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-bebe0abe-309b-401c-a030-d3ad7e2f1f09 tempest-VolumesDeleteCascade-715576226 None] Lock "cinder-2dd1968b-3496-4b94-87d8-2962baf4614f-delete_snapshot" released by "delete_snapshot" :: held 4.056s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:32:03 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-bebe0abe-309b-401c-a030-d3ad7e2f1f09 tempest-VolumesDeleteCascade-715576226 None] Acquiring lock "cinder-e01c3d12-8cb7-4718-8c31-36ed36deaaea-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:32:03 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-bebe0abe-309b-401c-a030-d3ad7e2f1f09 tempest-VolumesDeleteCascade-715576226 None] Lock "cinder-e01c3d12-8cb7-4718-8c31-36ed36deaaea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:32:03 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-bebe0abe-309b-401c-a030-d3ad7e2f1f09 tempest-VolumesDeleteCascade-715576226 None] Acquiring lock "cinder-quobyte-1ff994a4-f726-4766-807a-ef71fcf1bbe8" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:32:03 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-bebe0abe-309b-401c-a030-d3ad7e2f1f09 tempest-VolumesDeleteCascade-715576226 None] Lock "cinder-quobyte-1ff994a4-f726-4766-807a-ef71fcf1bbe8" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:32:03 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-bebe0abe-309b-401c-a030-d3ad7e2f1f09 tempest-VolumesDeleteCascade-715576226 None] Acquiring lock "cinder-quobyte-e01c3d12-8cb7-4718-8c31-36ed36deaaea" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:32:03 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-bebe0abe-309b-401c-a030-d3ad7e2f1f09 tempest-VolumesDeleteCascade-715576226 None] Lock "cinder-quobyte-e01c3d12-8cb7-4718-8c31-36ed36deaaea" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:32:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-bebe0abe-309b-401c-a030-d3ad7e2f1f09 tempest-VolumesDeleteCascade-715576226 None] Deleting offline snapshot e01c3d12-8cb7-4718-8c31-36ed36deaaea of volume 1ff994a4-f726-4766-807a-ef71fcf1bbe8 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 16:32:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-bebe0abe-309b-401c-a030-d3ad7e2f1f09 tempest-VolumesDeleteCascade-715576226 None] snapshot_file for this snap is: volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8.e01c3d12-8cb7-4718-8c31-36ed36deaaea {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 16:32:03 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cff2c69-a711-4ad3-94a6-803abd23a178]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:32:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bebe0abe-309b-401c-a030-d3ad7e2f1f09 tempest-VolumesDeleteCascade-715576226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8.e01c3d12-8cb7-4718-8c31-36ed36deaaea {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:03 devstack sudo[97840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8.e01c3d12-8cb7-4718-8c31-36ed36deaaea
Jul 14 16:32:03 devstack sudo[97840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:03 devstack sudo[97833]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cb9fcdb3-1d8c-4393-9b62-e2326539698b tempest-VolumeQuotasAdminTestJSON-1380193074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a247118a-a623-4220-bbf6-b33c187894ca 1073741824" returned: 0 in 0.542s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cb9fcdb3-1d8c-4393-9b62-e2326539698b tempest-VolumeQuotasAdminTestJSON-1380193074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a247118a-a623-4220-bbf6-b33c187894ca {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:03 devstack sudo[97843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a247118a-a623-4220-bbf6-b33c187894ca
Jul 14 16:32:03 devstack sudo[97843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:03 devstack sudo[97840]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bebe0abe-309b-401c-a030-d3ad7e2f1f09 tempest-VolumesDeleteCascade-715576226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8.e01c3d12-8cb7-4718-8c31-36ed36deaaea" returned: 0 in 0.377s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-bebe0abe-309b-401c-a030-d3ad7e2f1f09 tempest-VolumesDeleteCascade-715576226 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 16:32:03 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0adbdc4-6ff2-4b6e-af83-2f3fa3e907e5]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:32:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bebe0abe-309b-401c-a030-d3ad7e2f1f09 tempest-VolumesDeleteCascade-715576226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:03 devstack sudo[97848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8
Jul 14 16:32:03 devstack sudo[97848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:03 devstack sudo[97843]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cb9fcdb3-1d8c-4393-9b62-e2326539698b tempest-VolumeQuotasAdminTestJSON-1380193074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a247118a-a623-4220-bbf6-b33c187894ca" returned: 0 in 0.289s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-cb9fcdb3-1d8c-4393-9b62-e2326539698b tempest-VolumeQuotasAdminTestJSON-1380193074 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:32:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cb9fcdb3-1d8c-4393-9b62-e2326539698b tempest-VolumeQuotasAdminTestJSON-1380193074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:32:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cb9fcdb3-1d8c-4393-9b62-e2326539698b tempest-VolumeQuotasAdminTestJSON-1380193074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (667ab338-6a25-4836-8ed9-23aef1a8eb55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a247118a-a623-4220-bbf6-b33c187894ca', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cb9fcdb3-1d8c-4393-9b62-e2326539698b tempest-VolumeQuotasAdminTestJSON-1380193074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a8a6bd2-fa68-4ff1-96cd-e94bec4791af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:03 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-cb9fcdb3-1d8c-4393-9b62-e2326539698b tempest-VolumeQuotasAdminTestJSON-1380193074 None] Volume volume-a247118a-a623-4220-bbf6-b33c187894ca (a247118a-a623-4220-bbf6-b33c187894ca): created successfully
Jul 14 16:32:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cb9fcdb3-1d8c-4393-9b62-e2326539698b tempest-VolumeQuotasAdminTestJSON-1380193074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a8a6bd2-fa68-4ff1-96cd-e94bec4791af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cb9fcdb3-1d8c-4393-9b62-e2326539698b tempest-VolumeQuotasAdminTestJSON-1380193074 None] Flow 'volume_create_manager' (905d347c-43ff-463b-9795-27be945436ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:32:04 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-cb9fcdb3-1d8c-4393-9b62-e2326539698b tempest-VolumeQuotasAdminTestJSON-1380193074 None] Created volume successfully.
Jul 14 16:32:04 devstack sudo[97848]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bebe0abe-309b-401c-a030-d3ad7e2f1f09 tempest-VolumesDeleteCascade-715576226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8" returned: 0 in 0.383s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bebe0abe-309b-401c-a030-d3ad7e2f1f09 tempest-VolumesDeleteCascade-715576226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8.e01c3d12-8cb7-4718-8c31-36ed36deaaea {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:04 devstack sudo[97854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8.e01c3d12-8cb7-4718-8c31-36ed36deaaea
Jul 14 16:32:04 devstack sudo[97854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:04 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7fb58c05-b298-4b4b-822b-4db0d64ca50f tempest-VolumesCloneNegativeTest-1389822613 None] Acquiring lock "cinder-1e10a714-e4f6-4bde-85da-2de449418bb0-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:32:04 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7fb58c05-b298-4b4b-822b-4db0d64ca50f tempest-VolumesCloneNegativeTest-1389822613 None] Lock "cinder-1e10a714-e4f6-4bde-85da-2de449418bb0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:32:04 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7fb58c05-b298-4b4b-822b-4db0d64ca50f tempest-VolumesCloneNegativeTest-1389822613 None] Acquiring lock "cinder-quobyte-1e10a714-e4f6-4bde-85da-2de449418bb0" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:32:04 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b27255d5-d318-4e2b-b42e-89ba43688d51 tempest-VolumeQuotasAdminTestJSON-1380193074 None] Acquiring lock "cinder-a247118a-a623-4220-bbf6-b33c187894ca-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:32:04 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7fb58c05-b298-4b4b-822b-4db0d64ca50f tempest-VolumesCloneNegativeTest-1389822613 None] Lock "cinder-quobyte-1e10a714-e4f6-4bde-85da-2de449418bb0" acquired by "delete_volume" :: waited 0.036s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:32:04 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b27255d5-d318-4e2b-b42e-89ba43688d51 tempest-VolumeQuotasAdminTestJSON-1380193074 None] Lock "cinder-a247118a-a623-4220-bbf6-b33c187894ca-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:32:04 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a977df-1ec4-4823-a63f-8ca52c4f18b3]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:32:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7fb58c05-b298-4b4b-822b-4db0d64ca50f tempest-VolumesCloneNegativeTest-1389822613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1e10a714-e4f6-4bde-85da-2de449418bb0 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:04 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b27255d5-d318-4e2b-b42e-89ba43688d51 tempest-VolumeQuotasAdminTestJSON-1380193074 None] Acquiring lock "cinder-quobyte-a247118a-a623-4220-bbf6-b33c187894ca" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:32:04 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b27255d5-d318-4e2b-b42e-89ba43688d51 tempest-VolumeQuotasAdminTestJSON-1380193074 None] Lock "cinder-quobyte-a247118a-a623-4220-bbf6-b33c187894ca" acquired by "delete_volume" :: waited 0.024s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:32:04 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9f5698-e36a-4752-a0a2-76b255af51a6]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:32:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b27255d5-d318-4e2b-b42e-89ba43688d51 tempest-VolumeQuotasAdminTestJSON-1380193074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a247118a-a623-4220-bbf6-b33c187894ca {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:04 devstack sudo[97857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1e10a714-e4f6-4bde-85da-2de449418bb0
Jul 14 16:32:04 devstack sudo[97857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:04 devstack sudo[97854]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bebe0abe-309b-401c-a030-d3ad7e2f1f09 tempest-VolumesDeleteCascade-715576226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8.e01c3d12-8cb7-4718-8c31-36ed36deaaea" returned: 0 in 0.387s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bebe0abe-309b-401c-a030-d3ad7e2f1f09 tempest-VolumesDeleteCascade-715576226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8.e01c3d12-8cb7-4718-8c31-36ed36deaaea {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:04 devstack sudo[97863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8.e01c3d12-8cb7-4718-8c31-36ed36deaaea
Jul 14 16:32:04 devstack sudo[97863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:04 devstack sudo[97861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a247118a-a623-4220-bbf6-b33c187894ca
Jul 14 16:32:04 devstack sudo[97861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:04 devstack sudo[97857]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7fb58c05-b298-4b4b-822b-4db0d64ca50f tempest-VolumesCloneNegativeTest-1389822613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1e10a714-e4f6-4bde-85da-2de449418bb0" returned: 0 in 0.398s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7fb58c05-b298-4b4b-822b-4db0d64ca50f tempest-VolumesCloneNegativeTest-1389822613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1e10a714-e4f6-4bde-85da-2de449418bb0 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:04 devstack sudo[97869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1e10a714-e4f6-4bde-85da-2de449418bb0
Jul 14 16:32:04 devstack sudo[97869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:04 devstack sudo[97863]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bebe0abe-309b-401c-a030-d3ad7e2f1f09 tempest-VolumesDeleteCascade-715576226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8.e01c3d12-8cb7-4718-8c31-36ed36deaaea" returned: 0 in 0.305s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:04 devstack sudo[97861]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b27255d5-d318-4e2b-b42e-89ba43688d51 tempest-VolumeQuotasAdminTestJSON-1380193074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a247118a-a623-4220-bbf6-b33c187894ca" returned: 0 in 0.413s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b27255d5-d318-4e2b-b42e-89ba43688d51 tempest-VolumeQuotasAdminTestJSON-1380193074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a247118a-a623-4220-bbf6-b33c187894ca {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:04 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-bebe0abe-309b-401c-a030-d3ad7e2f1f09 tempest-VolumesDeleteCascade-715576226 None] Lock "cinder-quobyte-e01c3d12-8cb7-4718-8c31-36ed36deaaea" released by "_delete_snapshot" :: held 1.573s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:32:04 devstack sudo[97875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a247118a-a623-4220-bbf6-b33c187894ca
Jul 14 16:32:04 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-bebe0abe-309b-401c-a030-d3ad7e2f1f09 tempest-VolumesDeleteCascade-715576226 None] Lock "cinder-quobyte-1ff994a4-f726-4766-807a-ef71fcf1bbe8" released by "delete_snapshot" :: held 1.601s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:32:04 devstack sudo[97875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:04 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-bebe0abe-309b-401c-a030-d3ad7e2f1f09 tempest-VolumesDeleteCascade-715576226 None] Created reservations ['c21c4de4-0202-471a-91c8-136e6aefa608', '44e3717c-8d24-4e2b-925f-847cbf414cb9', 'ea6da56a-f850-407e-8ad1-44d2ce1fd023', '19d8f589-eb33-4df8-a52a-97b61bce9624'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:32:05 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-bebe0abe-309b-401c-a030-d3ad7e2f1f09 tempest-VolumesDeleteCascade-715576226 None] Delete snapshot completed successfully.
Jul 14 16:32:05 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-bebe0abe-309b-401c-a030-d3ad7e2f1f09 tempest-VolumesDeleteCascade-715576226 None] Lock "cinder-e01c3d12-8cb7-4718-8c31-36ed36deaaea-delete_snapshot" released by "delete_snapshot" :: held 1.776s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:32:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-bebe0abe-309b-401c-a030-d3ad7e2f1f09 tempest-VolumesDeleteCascade-715576226 None] Snapshots deleted, issuing volume delete {{(pid=87166) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Jul 14 16:32:05 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-bebe0abe-309b-401c-a030-d3ad7e2f1f09 tempest-VolumesDeleteCascade-715576226 None] Acquiring lock "cinder-quobyte-1ff994a4-f726-4766-807a-ef71fcf1bbe8" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:32:05 devstack sudo[97869]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:05 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-bebe0abe-309b-401c-a030-d3ad7e2f1f09 tempest-VolumesDeleteCascade-715576226 None] Lock "cinder-quobyte-1ff994a4-f726-4766-807a-ef71fcf1bbe8" acquired by "delete_volume" :: waited 0.019s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:32:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7fb58c05-b298-4b4b-822b-4db0d64ca50f tempest-VolumesCloneNegativeTest-1389822613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1e10a714-e4f6-4bde-85da-2de449418bb0" returned: 0 in 0.332s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:05 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7fb58c05-b298-4b4b-822b-4db0d64ca50f tempest-VolumesCloneNegativeTest-1389822613 None] Lock "cinder-quobyte-1e10a714-e4f6-4bde-85da-2de449418bb0" released by "delete_volume" :: held 0.798s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:32:05 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[13259758-2669-40b5-bd20-5dc0c1b9beb5]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:32:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bebe0abe-309b-401c-a030-d3ad7e2f1f09 tempest-VolumesDeleteCascade-715576226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:05 devstack sudo[97875]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b27255d5-d318-4e2b-b42e-89ba43688d51 tempest-VolumeQuotasAdminTestJSON-1380193074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a247118a-a623-4220-bbf6-b33c187894ca" returned: 0 in 0.270s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:05 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b27255d5-d318-4e2b-b42e-89ba43688d51 tempest-VolumeQuotasAdminTestJSON-1380193074 None] Lock "cinder-quobyte-a247118a-a623-4220-bbf6-b33c187894ca" released by "delete_volume" :: held 0.734s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:32:05 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-7fb58c05-b298-4b4b-822b-4db0d64ca50f tempest-VolumesCloneNegativeTest-1389822613 None] Created reservations ['fe598736-bbc0-457b-bcd3-dd79e7ee2191', '1abcdc42-fa0e-4f41-92c1-1850e3b100c8', '789e6cb9-19a2-44c3-8750-fd4ae1e3a786', 'c8272ec5-22ee-4718-bded-83592c3c1506'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:32:05 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-b27255d5-d318-4e2b-b42e-89ba43688d51 tempest-VolumeQuotasAdminTestJSON-1380193074 None] Created reservations ['f7a1ae67-8080-4b71-89dd-b7a9162f8b3b', 'ecfff26f-a2d2-46d6-accd-e1e093ce2a83', 'ec3a82df-911d-40ef-a5a2-d191bfe9c59c', '21b150c4-8414-4a6a-9b6a-d3e5bee5e170'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:32:05 devstack sudo[97879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8
Jul 14 16:32:05 devstack sudo[97879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-7fb58c05-b298-4b4b-822b-4db0d64ca50f tempest-VolumesCloneNegativeTest-1389822613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:32:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-7fb58c05-b298-4b4b-822b-4db0d64ca50f tempest-VolumesCloneNegativeTest-1389822613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:32:05 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-7fb58c05-b298-4b4b-822b-4db0d64ca50f tempest-VolumesCloneNegativeTest-1389822613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:32:05 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-7fb58c05-b298-4b4b-822b-4db0d64ca50f tempest-VolumesCloneNegativeTest-1389822613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:32:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-7fb58c05-b298-4b4b-822b-4db0d64ca50f tempest-VolumesCloneNegativeTest-1389822613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:32:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7fb58c05-b298-4b4b-822b-4db0d64ca50f tempest-VolumesCloneNegativeTest-1389822613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:05 devstack sudo[97881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:32:05 devstack sudo[97881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b27255d5-d318-4e2b-b42e-89ba43688d51 tempest-VolumeQuotasAdminTestJSON-1380193074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:32:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b27255d5-d318-4e2b-b42e-89ba43688d51 tempest-VolumeQuotasAdminTestJSON-1380193074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:32:05 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-b27255d5-d318-4e2b-b42e-89ba43688d51 tempest-VolumeQuotasAdminTestJSON-1380193074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:32:05 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-b27255d5-d318-4e2b-b42e-89ba43688d51 tempest-VolumeQuotasAdminTestJSON-1380193074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:32:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b27255d5-d318-4e2b-b42e-89ba43688d51 tempest-VolumeQuotasAdminTestJSON-1380193074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:32:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b27255d5-d318-4e2b-b42e-89ba43688d51 tempest-VolumeQuotasAdminTestJSON-1380193074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:05 devstack sudo[97883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:32:05 devstack sudo[97883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:05 devstack sudo[97879]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:05 devstack sudo[97881]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bebe0abe-309b-401c-a030-d3ad7e2f1f09 tempest-VolumesDeleteCascade-715576226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8" returned: 0 in 0.579s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bebe0abe-309b-401c-a030-d3ad7e2f1f09 tempest-VolumesDeleteCascade-715576226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7fb58c05-b298-4b4b-822b-4db0d64ca50f tempest-VolumesCloneNegativeTest-1389822613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.435s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:05 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-7fb58c05-b298-4b4b-822b-4db0d64ca50f tempest-VolumesCloneNegativeTest-1389822613 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:32:05 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-7fb58c05-b298-4b4b-822b-4db0d64ca50f tempest-VolumesCloneNegativeTest-1389822613 None] Deleted volume successfully.
Jul 14 16:32:05 devstack sudo[97883]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b27255d5-d318-4e2b-b42e-89ba43688d51 tempest-VolumeQuotasAdminTestJSON-1380193074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.415s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:05 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-b27255d5-d318-4e2b-b42e-89ba43688d51 tempest-VolumeQuotasAdminTestJSON-1380193074 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:32:05 devstack sudo[97890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8
Jul 14 16:32:05 devstack sudo[97890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:05 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-b27255d5-d318-4e2b-b42e-89ba43688d51 tempest-VolumeQuotasAdminTestJSON-1380193074 None] Deleted volume successfully.
Jul 14 16:32:05 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7fb58c05-b298-4b4b-822b-4db0d64ca50f tempest-VolumesCloneNegativeTest-1389822613 None] Lock "cinder-1e10a714-e4f6-4bde-85da-2de449418bb0-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:32:05 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b27255d5-d318-4e2b-b42e-89ba43688d51 tempest-VolumeQuotasAdminTestJSON-1380193074 None] Lock "cinder-a247118a-a623-4220-bbf6-b33c187894ca-delete_volume" released by "delete_volume" :: held 1.455s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:32:06 devstack sudo[97890]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bebe0abe-309b-401c-a030-d3ad7e2f1f09 tempest-VolumesDeleteCascade-715576226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ff994a4-f726-4766-807a-ef71fcf1bbe8" returned: 0 in 0.335s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:06 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-bebe0abe-309b-401c-a030-d3ad7e2f1f09 tempest-VolumesDeleteCascade-715576226 None] Lock "cinder-quobyte-1ff994a4-f726-4766-807a-ef71fcf1bbe8" released by "delete_volume" :: held 0.994s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:32:06 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-bebe0abe-309b-401c-a030-d3ad7e2f1f09 tempest-VolumesDeleteCascade-715576226 None] Created reservations ['d963e06d-e2b1-4ed6-ae7c-7865ea57791a', '58405ce3-9bdb-4a3a-9b75-d0552cc68cf2', '68bbcc6b-605f-4afb-87c6-60789c69a34f', 'bd771e88-bda4-4a0e-8358-49c9a6302108'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:32:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-bebe0abe-309b-401c-a030-d3ad7e2f1f09 tempest-VolumesDeleteCascade-715576226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:32:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-bebe0abe-309b-401c-a030-d3ad7e2f1f09 tempest-VolumesDeleteCascade-715576226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:32:06 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-bebe0abe-309b-401c-a030-d3ad7e2f1f09 tempest-VolumesDeleteCascade-715576226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:32:06 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-bebe0abe-309b-401c-a030-d3ad7e2f1f09 tempest-VolumesDeleteCascade-715576226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:32:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-bebe0abe-309b-401c-a030-d3ad7e2f1f09 tempest-VolumesDeleteCascade-715576226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:32:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bebe0abe-309b-401c-a030-d3ad7e2f1f09 tempest-VolumesDeleteCascade-715576226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:06 devstack sudo[97893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:32:06 devstack sudo[97893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:06 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-f07712e5-999c-458b-8616-1f283b6f64a5 tempest-VolumeQuotasAdminTestJSON-1380193074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:32:06 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f07712e5-999c-458b-8616-1f283b6f64a5 tempest-VolumeQuotasAdminTestJSON-1380193074 None] Flow 'volume_create_manager' (0c4b22dd-cbee-46a8-bc35-5dd7f54c1cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:32:06 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f07712e5-999c-458b-8616-1f283b6f64a5 tempest-VolumeQuotasAdminTestJSON-1380193074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd670c7a-f94f-46ac-add5-db170731c76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:06 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f07712e5-999c-458b-8616-1f283b6f64a5 tempest-VolumeQuotasAdminTestJSON-1380193074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd670c7a-f94f-46ac-add5-db170731c76f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:32:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2008574863',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0d75fbf-4d59-49da-bcc3-3c6e10b2dd1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a790af61d1b34482b82b59d0acc05e9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:32:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:32:06Z,use_quota=True,user_id='2aff79ac0c96452e8905a0fc47e6a4e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:06 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f07712e5-999c-458b-8616-1f283b6f64a5 tempest-VolumeQuotasAdminTestJSON-1380193074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b826b472-7ddd-4052-a7d3-b01fcb0a9eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:06 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f07712e5-999c-458b-8616-1f283b6f64a5 tempest-VolumeQuotasAdminTestJSON-1380193074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b826b472-7ddd-4052-a7d3-b01fcb0a9eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:06 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f07712e5-999c-458b-8616-1f283b6f64a5 tempest-VolumeQuotasAdminTestJSON-1380193074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf8a0404-654d-4e5b-85ca-5786396a57d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:06 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f07712e5-999c-458b-8616-1f283b6f64a5 tempest-VolumeQuotasAdminTestJSON-1380193074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf8a0404-654d-4e5b-85ca-5786396a57d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0d75fbf-4d59-49da-bcc3-3c6e10b2dd1e', 'volume_name': 'volume-b0d75fbf-4d59-49da-bcc3-3c6e10b2dd1e', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:06 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f07712e5-999c-458b-8616-1f283b6f64a5 tempest-VolumeQuotasAdminTestJSON-1380193074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57817b19-93a1-4eb5-a050-bb9c2554eed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:06 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f07712e5-999c-458b-8616-1f283b6f64a5 tempest-VolumeQuotasAdminTestJSON-1380193074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57817b19-93a1-4eb5-a050-bb9c2554eed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:06 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f07712e5-999c-458b-8616-1f283b6f64a5 tempest-VolumeQuotasAdminTestJSON-1380193074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ad3ef1f-ca40-4994-a730-0d79c08006c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:06 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-f07712e5-999c-458b-8616-1f283b6f64a5 tempest-VolumeQuotasAdminTestJSON-1380193074 None] Volume b0d75fbf-4d59-49da-bcc3-3c6e10b2dd1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0d75fbf-4d59-49da-bcc3-3c6e10b2dd1e', 'volume_size': 1}
Jul 14 16:32:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f07712e5-999c-458b-8616-1f283b6f64a5 tempest-VolumeQuotasAdminTestJSON-1380193074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:32:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f07712e5-999c-458b-8616-1f283b6f64a5 tempest-VolumeQuotasAdminTestJSON-1380193074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:32:06 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f07712e5-999c-458b-8616-1f283b6f64a5 tempest-VolumeQuotasAdminTestJSON-1380193074 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:32:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2008574863',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0d75fbf-4d59-49da-bcc3-3c6e10b2dd1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a790af61d1b34482b82b59d0acc05e9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:32:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:32:06Z,use_quota=True,user_id='2aff79ac0c96452e8905a0fc47e6a4e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:32:06 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-f07712e5-999c-458b-8616-1f283b6f64a5 tempest-VolumeQuotasAdminTestJSON-1380193074 None] Creating volume b0d75fbf-4d59-49da-bcc3-3c6e10b2dd1e {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:32:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f07712e5-999c-458b-8616-1f283b6f64a5 tempest-VolumeQuotasAdminTestJSON-1380193074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:32:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f07712e5-999c-458b-8616-1f283b6f64a5 tempest-VolumeQuotasAdminTestJSON-1380193074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:32:06 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f07712e5-999c-458b-8616-1f283b6f64a5 tempest-VolumeQuotasAdminTestJSON-1380193074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:32:06 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f07712e5-999c-458b-8616-1f283b6f64a5 tempest-VolumeQuotasAdminTestJSON-1380193074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:32:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f07712e5-999c-458b-8616-1f283b6f64a5 tempest-VolumeQuotasAdminTestJSON-1380193074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:32:06 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f07712e5-999c-458b-8616-1f283b6f64a5 tempest-VolumeQuotasAdminTestJSON-1380193074 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:32:06 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-f07712e5-999c-458b-8616-1f283b6f64a5 tempest-VolumeQuotasAdminTestJSON-1380193074 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:32:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f07712e5-999c-458b-8616-1f283b6f64a5 tempest-VolumeQuotasAdminTestJSON-1380193074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b0d75fbf-4d59-49da-bcc3-3c6e10b2dd1e 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:06 devstack sudo[97895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b0d75fbf-4d59-49da-bcc3-3c6e10b2dd1e 1073741824
Jul 14 16:32:06 devstack sudo[97895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:06 devstack sudo[97893]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bebe0abe-309b-401c-a030-d3ad7e2f1f09 tempest-VolumesDeleteCascade-715576226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.299s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:06 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-bebe0abe-309b-401c-a030-d3ad7e2f1f09 tempest-VolumesDeleteCascade-715576226 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:32:06 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-bebe0abe-309b-401c-a030-d3ad7e2f1f09 tempest-VolumesDeleteCascade-715576226 None] Deleted volume successfully.
Jul 14 16:32:06 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-bebe0abe-309b-401c-a030-d3ad7e2f1f09 tempest-VolumesDeleteCascade-715576226 None] Lock "cinder-1ff994a4-f726-4766-807a-ef71fcf1bbe8-delete_volume" released by "delete_volume" :: held 7.468s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:32:06 devstack sudo[97895]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f07712e5-999c-458b-8616-1f283b6f64a5 tempest-VolumeQuotasAdminTestJSON-1380193074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b0d75fbf-4d59-49da-bcc3-3c6e10b2dd1e 1073741824" returned: 0 in 0.565s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f07712e5-999c-458b-8616-1f283b6f64a5 tempest-VolumeQuotasAdminTestJSON-1380193074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b0d75fbf-4d59-49da-bcc3-3c6e10b2dd1e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:07 devstack sudo[97902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b0d75fbf-4d59-49da-bcc3-3c6e10b2dd1e
Jul 14 16:32:07 devstack sudo[97902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:07 devstack sudo[97902]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f07712e5-999c-458b-8616-1f283b6f64a5 tempest-VolumeQuotasAdminTestJSON-1380193074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b0d75fbf-4d59-49da-bcc3-3c6e10b2dd1e" returned: 0 in 0.300s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:07 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f07712e5-999c-458b-8616-1f283b6f64a5 tempest-VolumeQuotasAdminTestJSON-1380193074 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:32:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f07712e5-999c-458b-8616-1f283b6f64a5 tempest-VolumeQuotasAdminTestJSON-1380193074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:32:07 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f07712e5-999c-458b-8616-1f283b6f64a5 tempest-VolumeQuotasAdminTestJSON-1380193074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ad3ef1f-ca40-4994-a730-0d79c08006c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0d75fbf-4d59-49da-bcc3-3c6e10b2dd1e', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:07 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f07712e5-999c-458b-8616-1f283b6f64a5 tempest-VolumeQuotasAdminTestJSON-1380193074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61017a44-5c82-4c13-863b-2f15b2fb764a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:07 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-f07712e5-999c-458b-8616-1f283b6f64a5 tempest-VolumeQuotasAdminTestJSON-1380193074 None] Volume volume-b0d75fbf-4d59-49da-bcc3-3c6e10b2dd1e (b0d75fbf-4d59-49da-bcc3-3c6e10b2dd1e): created successfully
Jul 14 16:32:07 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f07712e5-999c-458b-8616-1f283b6f64a5 tempest-VolumeQuotasAdminTestJSON-1380193074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61017a44-5c82-4c13-863b-2f15b2fb764a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:07 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f07712e5-999c-458b-8616-1f283b6f64a5 tempest-VolumeQuotasAdminTestJSON-1380193074 None] Flow 'volume_create_manager' (0c4b22dd-cbee-46a8-bc35-5dd7f54c1cdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:32:07 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-f07712e5-999c-458b-8616-1f283b6f64a5 tempest-VolumeQuotasAdminTestJSON-1380193074 None] Created volume successfully.
Jul 14 16:32:07 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-30ac0ae4-be99-48b0-9650-5a098fd8b416 tempest-VolumesDeleteCascade-715576226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:32:07 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-30ac0ae4-be99-48b0-9650-5a098fd8b416 tempest-VolumesDeleteCascade-715576226 None] Flow 'volume_create_manager' (acf04daa-0a08-4018-844c-ca780764abd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:32:07 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-30ac0ae4-be99-48b0-9650-5a098fd8b416 tempest-VolumesDeleteCascade-715576226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90f383cd-f9ca-4fd2-a579-12c0ef02234f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:07 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-30ac0ae4-be99-48b0-9650-5a098fd8b416 tempest-VolumesDeleteCascade-715576226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90f383cd-f9ca-4fd2-a579-12c0ef02234f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:32:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1701848627',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47767d56-c1e5-4e73-a555-f2ff387981ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e74c2ad7217481a9f31d066d412ae96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:32:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:32:08Z,use_quota=True,user_id='a72b59e85e1f4f1ea7aedbc379420875',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:07 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-30ac0ae4-be99-48b0-9650-5a098fd8b416 tempest-VolumesDeleteCascade-715576226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c68d0f9a-d8a0-4b24-bba7-2672ad638418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:07 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-30ac0ae4-be99-48b0-9650-5a098fd8b416 tempest-VolumesDeleteCascade-715576226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c68d0f9a-d8a0-4b24-bba7-2672ad638418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:07 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-30ac0ae4-be99-48b0-9650-5a098fd8b416 tempest-VolumesDeleteCascade-715576226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4edebd4-06f2-4c36-8a8f-046703ec5e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:07 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-30ac0ae4-be99-48b0-9650-5a098fd8b416 tempest-VolumesDeleteCascade-715576226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4edebd4-06f2-4c36-8a8f-046703ec5e4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47767d56-c1e5-4e73-a555-f2ff387981ff', 'volume_name': 'volume-47767d56-c1e5-4e73-a555-f2ff387981ff', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:07 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-30ac0ae4-be99-48b0-9650-5a098fd8b416 tempest-VolumesDeleteCascade-715576226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2483ee8-c6e7-4f72-a555-5f326a41ca4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:07 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-30ac0ae4-be99-48b0-9650-5a098fd8b416 tempest-VolumesDeleteCascade-715576226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2483ee8-c6e7-4f72-a555-5f326a41ca4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:07 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-30ac0ae4-be99-48b0-9650-5a098fd8b416 tempest-VolumesDeleteCascade-715576226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a73a64db-9c0e-49f6-9df9-a3b0d50913ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:07 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-30ac0ae4-be99-48b0-9650-5a098fd8b416 tempest-VolumesDeleteCascade-715576226 None] Volume 47767d56-c1e5-4e73-a555-f2ff387981ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47767d56-c1e5-4e73-a555-f2ff387981ff', 'volume_size': 1}
Jul 14 16:32:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-30ac0ae4-be99-48b0-9650-5a098fd8b416 tempest-VolumesDeleteCascade-715576226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:32:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-30ac0ae4-be99-48b0-9650-5a098fd8b416 tempest-VolumesDeleteCascade-715576226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:32:07 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-30ac0ae4-be99-48b0-9650-5a098fd8b416 tempest-VolumesDeleteCascade-715576226 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:32:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1701848627',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47767d56-c1e5-4e73-a555-f2ff387981ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e74c2ad7217481a9f31d066d412ae96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:32:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:32:08Z,use_quota=True,user_id='a72b59e85e1f4f1ea7aedbc379420875',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:32:07 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-30ac0ae4-be99-48b0-9650-5a098fd8b416 tempest-VolumesDeleteCascade-715576226 None] Creating volume 47767d56-c1e5-4e73-a555-f2ff387981ff {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:32:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-30ac0ae4-be99-48b0-9650-5a098fd8b416 tempest-VolumesDeleteCascade-715576226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:32:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-30ac0ae4-be99-48b0-9650-5a098fd8b416 tempest-VolumesDeleteCascade-715576226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:32:07 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-30ac0ae4-be99-48b0-9650-5a098fd8b416 tempest-VolumesDeleteCascade-715576226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:32:07 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-30ac0ae4-be99-48b0-9650-5a098fd8b416 tempest-VolumesDeleteCascade-715576226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:32:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-30ac0ae4-be99-48b0-9650-5a098fd8b416 tempest-VolumesDeleteCascade-715576226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:32:07 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-30ac0ae4-be99-48b0-9650-5a098fd8b416 tempest-VolumesDeleteCascade-715576226 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:32:07 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-30ac0ae4-be99-48b0-9650-5a098fd8b416 tempest-VolumesDeleteCascade-715576226 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:32:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-30ac0ae4-be99-48b0-9650-5a098fd8b416 tempest-VolumesDeleteCascade-715576226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-47767d56-c1e5-4e73-a555-f2ff387981ff 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:07 devstack sudo[97905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-47767d56-c1e5-4e73-a555-f2ff387981ff 1073741824
Jul 14 16:32:07 devstack sudo[97905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:08 devstack sudo[97905]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-30ac0ae4-be99-48b0-9650-5a098fd8b416 tempest-VolumesDeleteCascade-715576226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-47767d56-c1e5-4e73-a555-f2ff387981ff 1073741824" returned: 0 in 0.560s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-30ac0ae4-be99-48b0-9650-5a098fd8b416 tempest-VolumesDeleteCascade-715576226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-47767d56-c1e5-4e73-a555-f2ff387981ff {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:08 devstack sudo[97911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-47767d56-c1e5-4e73-a555-f2ff387981ff
Jul 14 16:32:08 devstack sudo[97911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:08 devstack sudo[97911]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-30ac0ae4-be99-48b0-9650-5a098fd8b416 tempest-VolumesDeleteCascade-715576226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-47767d56-c1e5-4e73-a555-f2ff387981ff" returned: 0 in 0.299s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:08 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-30ac0ae4-be99-48b0-9650-5a098fd8b416 tempest-VolumesDeleteCascade-715576226 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:32:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-30ac0ae4-be99-48b0-9650-5a098fd8b416 tempest-VolumesDeleteCascade-715576226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:32:08 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-30ac0ae4-be99-48b0-9650-5a098fd8b416 tempest-VolumesDeleteCascade-715576226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a73a64db-9c0e-49f6-9df9-a3b0d50913ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47767d56-c1e5-4e73-a555-f2ff387981ff', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:08 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-30ac0ae4-be99-48b0-9650-5a098fd8b416 tempest-VolumesDeleteCascade-715576226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27f61912-cc71-436a-83cb-b36804bbe058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:08 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-30ac0ae4-be99-48b0-9650-5a098fd8b416 tempest-VolumesDeleteCascade-715576226 None] Volume volume-47767d56-c1e5-4e73-a555-f2ff387981ff (47767d56-c1e5-4e73-a555-f2ff387981ff): created successfully
Jul 14 16:32:08 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-30ac0ae4-be99-48b0-9650-5a098fd8b416 tempest-VolumesDeleteCascade-715576226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27f61912-cc71-436a-83cb-b36804bbe058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:08 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-30ac0ae4-be99-48b0-9650-5a098fd8b416 tempest-VolumesDeleteCascade-715576226 None] Flow 'volume_create_manager' (acf04daa-0a08-4018-844c-ca780764abd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:32:08 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-30ac0ae4-be99-48b0-9650-5a098fd8b416 tempest-VolumesDeleteCascade-715576226 None] Created volume successfully.
Jul 14 16:32:09 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e70f206-0a35-4eaf-baac-b3f9509eef8d tempest-VolumesListTestJSON-1424316819 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:32:09 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1e70f206-0a35-4eaf-baac-b3f9509eef8d tempest-VolumesListTestJSON-1424316819 None] Flow 'volume_create_manager' (8ce6ccc5-4c97-447d-865e-8122fa420bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:32:09 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1e70f206-0a35-4eaf-baac-b3f9509eef8d tempest-VolumesListTestJSON-1424316819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f33d4a8a-99cf-440b-8b87-187a7522411b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:09 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1e70f206-0a35-4eaf-baac-b3f9509eef8d tempest-VolumesListTestJSON-1424316819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f33d4a8a-99cf-440b-8b87-187a7522411b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:32:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1846712388',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5910666-7a7e-45f7-85d7-48517e69042a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='32fa7586977a4c45a2ac0cbf4057ba70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:32:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:32:09Z,use_quota=True,user_id='11d9ab1ea14044f49d269507b717a2ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:09 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1e70f206-0a35-4eaf-baac-b3f9509eef8d tempest-VolumesListTestJSON-1424316819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a90d996c-6168-4af5-a5a9-cb0060eab010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:09 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1e70f206-0a35-4eaf-baac-b3f9509eef8d tempest-VolumesListTestJSON-1424316819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a90d996c-6168-4af5-a5a9-cb0060eab010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:09 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1e70f206-0a35-4eaf-baac-b3f9509eef8d tempest-VolumesListTestJSON-1424316819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcba4727-638a-4c3a-88ed-e85ae3a71a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:09 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1e70f206-0a35-4eaf-baac-b3f9509eef8d tempest-VolumesListTestJSON-1424316819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcba4727-638a-4c3a-88ed-e85ae3a71a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5910666-7a7e-45f7-85d7-48517e69042a', 'volume_name': 'volume-f5910666-7a7e-45f7-85d7-48517e69042a', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:09 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1e70f206-0a35-4eaf-baac-b3f9509eef8d tempest-VolumesListTestJSON-1424316819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d4f8d2c-d2f4-4bd1-ba3a-1165cb0efee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:09 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1e70f206-0a35-4eaf-baac-b3f9509eef8d tempest-VolumesListTestJSON-1424316819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d4f8d2c-d2f4-4bd1-ba3a-1165cb0efee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:09 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1e70f206-0a35-4eaf-baac-b3f9509eef8d tempest-VolumesListTestJSON-1424316819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a8627c0-e4f1-4149-b735-3e1950a8e54f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:09 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-1e70f206-0a35-4eaf-baac-b3f9509eef8d tempest-VolumesListTestJSON-1424316819 None] Volume f5910666-7a7e-45f7-85d7-48517e69042a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5910666-7a7e-45f7-85d7-48517e69042a', 'volume_size': 1}
Jul 14 16:32:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1e70f206-0a35-4eaf-baac-b3f9509eef8d tempest-VolumesListTestJSON-1424316819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:32:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1e70f206-0a35-4eaf-baac-b3f9509eef8d tempest-VolumesListTestJSON-1424316819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:32:09 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-1e70f206-0a35-4eaf-baac-b3f9509eef8d tempest-VolumesListTestJSON-1424316819 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:32:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1846712388',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5910666-7a7e-45f7-85d7-48517e69042a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='32fa7586977a4c45a2ac0cbf4057ba70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:32:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:32:09Z,use_quota=True,user_id='11d9ab1ea14044f49d269507b717a2ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:32:09 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-1e70f206-0a35-4eaf-baac-b3f9509eef8d tempest-VolumesListTestJSON-1424316819 None] Creating volume f5910666-7a7e-45f7-85d7-48517e69042a {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:32:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1e70f206-0a35-4eaf-baac-b3f9509eef8d tempest-VolumesListTestJSON-1424316819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:32:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1e70f206-0a35-4eaf-baac-b3f9509eef8d tempest-VolumesListTestJSON-1424316819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:32:09 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-1e70f206-0a35-4eaf-baac-b3f9509eef8d tempest-VolumesListTestJSON-1424316819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:32:09 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-1e70f206-0a35-4eaf-baac-b3f9509eef8d tempest-VolumesListTestJSON-1424316819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:32:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1e70f206-0a35-4eaf-baac-b3f9509eef8d tempest-VolumesListTestJSON-1424316819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:32:09 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-1e70f206-0a35-4eaf-baac-b3f9509eef8d tempest-VolumesListTestJSON-1424316819 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:32:09 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-1e70f206-0a35-4eaf-baac-b3f9509eef8d tempest-VolumesListTestJSON-1424316819 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:32:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1e70f206-0a35-4eaf-baac-b3f9509eef8d tempest-VolumesListTestJSON-1424316819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f5910666-7a7e-45f7-85d7-48517e69042a 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:09 devstack sudo[97915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f5910666-7a7e-45f7-85d7-48517e69042a 1073741824
Jul 14 16:32:09 devstack sudo[97915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:09 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-d361bbc6-e8fe-4406-b8db-e9d8c9984892 tempest-VolumeQuotasAdminTestJSON-106773274 None] Transfer volume completed successfully.
Jul 14 16:32:09 devstack sudo[97915]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1e70f206-0a35-4eaf-baac-b3f9509eef8d tempest-VolumesListTestJSON-1424316819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f5910666-7a7e-45f7-85d7-48517e69042a 1073741824" returned: 0 in 0.525s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1e70f206-0a35-4eaf-baac-b3f9509eef8d tempest-VolumesListTestJSON-1424316819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f5910666-7a7e-45f7-85d7-48517e69042a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:09 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-5d0a22ed-9246-4255-a818-d79be77b826d tempest-VolumeQuotasAdminTestJSON-344878203 None] Acquiring lock "cinder-b0d75fbf-4d59-49da-bcc3-3c6e10b2dd1e-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:32:09 devstack sudo[97921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f5910666-7a7e-45f7-85d7-48517e69042a
Jul 14 16:32:09 devstack sudo[97921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:09 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-5d0a22ed-9246-4255-a818-d79be77b826d tempest-VolumeQuotasAdminTestJSON-344878203 None] Lock "cinder-b0d75fbf-4d59-49da-bcc3-3c6e10b2dd1e-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:32:09 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-5d0a22ed-9246-4255-a818-d79be77b826d tempest-VolumeQuotasAdminTestJSON-344878203 None] Acquiring lock "cinder-quobyte-b0d75fbf-4d59-49da-bcc3-3c6e10b2dd1e" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:32:09 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-5d0a22ed-9246-4255-a818-d79be77b826d tempest-VolumeQuotasAdminTestJSON-344878203 None] Lock "cinder-quobyte-b0d75fbf-4d59-49da-bcc3-3c6e10b2dd1e" acquired by "delete_volume" :: waited 0.029s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:32:09 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a647c25-3a64-44db-b09c-ed48b03659cd]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:32:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5d0a22ed-9246-4255-a818-d79be77b826d tempest-VolumeQuotasAdminTestJSON-344878203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b0d75fbf-4d59-49da-bcc3-3c6e10b2dd1e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0142129e-eb2f-4810-9b76-14efd1322703 tempest-VolumesDeleteCascade-715576226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:32:10 devstack sudo[97921]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1e70f206-0a35-4eaf-baac-b3f9509eef8d tempest-VolumesListTestJSON-1424316819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f5910666-7a7e-45f7-85d7-48517e69042a" returned: 0 in 0.366s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:10 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-1e70f206-0a35-4eaf-baac-b3f9509eef8d tempest-VolumesListTestJSON-1424316819 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:32:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1e70f206-0a35-4eaf-baac-b3f9509eef8d tempest-VolumesListTestJSON-1424316819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:32:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0142129e-eb2f-4810-9b76-14efd1322703 tempest-VolumesDeleteCascade-715576226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.025s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:32:10 devstack sudo[97923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b0d75fbf-4d59-49da-bcc3-3c6e10b2dd1e
Jul 14 16:32:10 devstack sudo[97923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:10 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-0142129e-eb2f-4810-9b76-14efd1322703 tempest-VolumesDeleteCascade-715576226 None] Creating offline snapshot 7dcbfe6e-1644-4c60-a20a-307473bd25e4 of volume 47767d56-c1e5-4e73-a555-f2ff387981ff {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 16:32:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1e70f206-0a35-4eaf-baac-b3f9509eef8d tempest-VolumesListTestJSON-1424316819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a8627c0-e4f1-4149-b735-3e1950a8e54f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5910666-7a7e-45f7-85d7-48517e69042a', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1e70f206-0a35-4eaf-baac-b3f9509eef8d tempest-VolumesListTestJSON-1424316819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6002a991-3485-4f5a-8b14-e3e7304cf30d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:10 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f83617-54d3-4130-b6e2-d26d8b49e7d0]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:32:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0142129e-eb2f-4810-9b76-14efd1322703 tempest-VolumesDeleteCascade-715576226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-47767d56-c1e5-4e73-a555-f2ff387981ff {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:10 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-1e70f206-0a35-4eaf-baac-b3f9509eef8d tempest-VolumesListTestJSON-1424316819 None] Volume volume-f5910666-7a7e-45f7-85d7-48517e69042a (f5910666-7a7e-45f7-85d7-48517e69042a): created successfully
Jul 14 16:32:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1e70f206-0a35-4eaf-baac-b3f9509eef8d tempest-VolumesListTestJSON-1424316819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6002a991-3485-4f5a-8b14-e3e7304cf30d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1e70f206-0a35-4eaf-baac-b3f9509eef8d tempest-VolumesListTestJSON-1424316819 None] Flow 'volume_create_manager' (8ce6ccc5-4c97-447d-865e-8122fa420bc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:32:10 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-1e70f206-0a35-4eaf-baac-b3f9509eef8d tempest-VolumesListTestJSON-1424316819 None] Created volume successfully.
Jul 14 16:32:10 devstack sudo[97926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-47767d56-c1e5-4e73-a555-f2ff387981ff
Jul 14 16:32:10 devstack sudo[97926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:10 devstack sudo[97923]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5d0a22ed-9246-4255-a818-d79be77b826d tempest-VolumeQuotasAdminTestJSON-344878203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b0d75fbf-4d59-49da-bcc3-3c6e10b2dd1e" returned: 0 in 0.395s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5d0a22ed-9246-4255-a818-d79be77b826d tempest-VolumeQuotasAdminTestJSON-344878203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b0d75fbf-4d59-49da-bcc3-3c6e10b2dd1e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:10 devstack sudo[97931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b0d75fbf-4d59-49da-bcc3-3c6e10b2dd1e
Jul 14 16:32:10 devstack sudo[97931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:10 devstack sudo[97926]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0142129e-eb2f-4810-9b76-14efd1322703 tempest-VolumesDeleteCascade-715576226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-47767d56-c1e5-4e73-a555-f2ff387981ff" returned: 0 in 0.376s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0142129e-eb2f-4810-9b76-14efd1322703 tempest-VolumesDeleteCascade-715576226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-47767d56-c1e5-4e73-a555-f2ff387981ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-47767d56-c1e5-4e73-a555-f2ff387981ff.7dcbfe6e-1644-4c60-a20a-307473bd25e4 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:10 devstack sudo[97936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-47767d56-c1e5-4e73-a555-f2ff387981ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-47767d56-c1e5-4e73-a555-f2ff387981ff.7dcbfe6e-1644-4c60-a20a-307473bd25e4 1G
Jul 14 16:32:10 devstack sudo[97936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:10 devstack sudo[97931]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5d0a22ed-9246-4255-a818-d79be77b826d tempest-VolumeQuotasAdminTestJSON-344878203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b0d75fbf-4d59-49da-bcc3-3c6e10b2dd1e" returned: 0 in 0.240s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:10 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-5d0a22ed-9246-4255-a818-d79be77b826d tempest-VolumeQuotasAdminTestJSON-344878203 None] Lock "cinder-quobyte-b0d75fbf-4d59-49da-bcc3-3c6e10b2dd1e" released by "delete_volume" :: held 0.704s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:32:10 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-5d0a22ed-9246-4255-a818-d79be77b826d tempest-VolumeQuotasAdminTestJSON-344878203 None] Created reservations ['66efbe8d-e1f3-4bd9-a1f6-9ec2fd598cca', 'e4781a8e-3e85-4d0f-a2f6-690c3b6bcddf', '268bec75-2024-4aae-9724-2b14ea411e70', '6d1c00a8-80f2-467e-86ea-942e13733651'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:32:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5d0a22ed-9246-4255-a818-d79be77b826d tempest-VolumeQuotasAdminTestJSON-344878203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:32:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5d0a22ed-9246-4255-a818-d79be77b826d tempest-VolumeQuotasAdminTestJSON-344878203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:32:10 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5d0a22ed-9246-4255-a818-d79be77b826d tempest-VolumeQuotasAdminTestJSON-344878203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:32:10 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5d0a22ed-9246-4255-a818-d79be77b826d tempest-VolumeQuotasAdminTestJSON-344878203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:32:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5d0a22ed-9246-4255-a818-d79be77b826d tempest-VolumeQuotasAdminTestJSON-344878203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:32:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5d0a22ed-9246-4255-a818-d79be77b826d tempest-VolumeQuotasAdminTestJSON-344878203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:10 devstack sudo[97942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:32:10 devstack sudo[97942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:10 devstack sudo[97936]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0142129e-eb2f-4810-9b76-14efd1322703 tempest-VolumesDeleteCascade-715576226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-47767d56-c1e5-4e73-a555-f2ff387981ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-47767d56-c1e5-4e73-a555-f2ff387981ff.7dcbfe6e-1644-4c60-a20a-307473bd25e4 1G" returned: 0 in 0.487s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0142129e-eb2f-4810-9b76-14efd1322703 tempest-VolumesDeleteCascade-715576226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47767d56-c1e5-4e73-a555-f2ff387981ff -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-47767d56-c1e5-4e73-a555-f2ff387981ff.7dcbfe6e-1644-4c60-a20a-307473bd25e4 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:11 devstack sudo[97946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47767d56-c1e5-4e73-a555-f2ff387981ff -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-47767d56-c1e5-4e73-a555-f2ff387981ff.7dcbfe6e-1644-4c60-a20a-307473bd25e4
Jul 14 16:32:11 devstack sudo[97946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:11 devstack sudo[97942]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5d0a22ed-9246-4255-a818-d79be77b826d tempest-VolumeQuotasAdminTestJSON-344878203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.302s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:11 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-5d0a22ed-9246-4255-a818-d79be77b826d tempest-VolumeQuotasAdminTestJSON-344878203 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:32:11 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-5d0a22ed-9246-4255-a818-d79be77b826d tempest-VolumeQuotasAdminTestJSON-344878203 None] Deleted volume successfully.
Jul 14 16:32:11 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-5d0a22ed-9246-4255-a818-d79be77b826d tempest-VolumeQuotasAdminTestJSON-344878203 None] Lock "cinder-b0d75fbf-4d59-49da-bcc3-3c6e10b2dd1e-delete_volume" released by "delete_volume" :: held 1.344s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:32:11 devstack sudo[97946]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0142129e-eb2f-4810-9b76-14efd1322703 tempest-VolumesDeleteCascade-715576226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47767d56-c1e5-4e73-a555-f2ff387981ff -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-47767d56-c1e5-4e73-a555-f2ff387981ff.7dcbfe6e-1644-4c60-a20a-307473bd25e4" returned: 0 in 0.422s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:11 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-0142129e-eb2f-4810-9b76-14efd1322703 tempest-VolumesDeleteCascade-715576226 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-47767d56-c1e5-4e73-a555-f2ff387981ff.7dcbfe6e-1644-4c60-a20a-307473bd25e4 is being set with open permissions: ugo+rw
Jul 14 16:32:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0142129e-eb2f-4810-9b76-14efd1322703 tempest-VolumesDeleteCascade-715576226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-47767d56-c1e5-4e73-a555-f2ff387981ff.7dcbfe6e-1644-4c60-a20a-307473bd25e4 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:11 devstack sudo[97960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-47767d56-c1e5-4e73-a555-f2ff387981ff.7dcbfe6e-1644-4c60-a20a-307473bd25e4
Jul 14 16:32:11 devstack sudo[97960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:11 devstack sudo[97960]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0142129e-eb2f-4810-9b76-14efd1322703 tempest-VolumesDeleteCascade-715576226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-47767d56-c1e5-4e73-a555-f2ff387981ff.7dcbfe6e-1644-4c60-a20a-307473bd25e4" returned: 0 in 0.380s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0142129e-eb2f-4810-9b76-14efd1322703 tempest-VolumesDeleteCascade-715576226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-47767d56-c1e5-4e73-a555-f2ff387981ff.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:11 devstack sudo[97963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-47767d56-c1e5-4e73-a555-f2ff387981ff.info
Jul 14 16:32:11 devstack sudo[97963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:11 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-79ab9785-090f-4cdd-a759-b6aeaed2a841 tempest-VolumesListTestJSON-1424316819 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:32:11 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-79ab9785-090f-4cdd-a759-b6aeaed2a841 tempest-VolumesListTestJSON-1424316819 None] Flow 'volume_create_manager' (f5bb0d0c-fb0f-49a2-9cee-91fe89029f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:32:11 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-79ab9785-090f-4cdd-a759-b6aeaed2a841 tempest-VolumesListTestJSON-1424316819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fca542a8-99c6-4d6c-ac8f-e3369bc1e0b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-79ab9785-090f-4cdd-a759-b6aeaed2a841 tempest-VolumesListTestJSON-1424316819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fca542a8-99c6-4d6c-ac8f-e3369bc1e0b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:32:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1967682852',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52a34ac0-10b1-4eb2-b7a6-913d5969fac7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='32fa7586977a4c45a2ac0cbf4057ba70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:32:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:32:12Z,use_quota=True,user_id='11d9ab1ea14044f49d269507b717a2ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-79ab9785-090f-4cdd-a759-b6aeaed2a841 tempest-VolumesListTestJSON-1424316819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e6150e4-f515-4203-9f73-282b1d8ed98d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-79ab9785-090f-4cdd-a759-b6aeaed2a841 tempest-VolumesListTestJSON-1424316819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e6150e4-f515-4203-9f73-282b1d8ed98d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-79ab9785-090f-4cdd-a759-b6aeaed2a841 tempest-VolumesListTestJSON-1424316819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abf68825-3422-48b7-920e-0ddd8a727e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-79ab9785-090f-4cdd-a759-b6aeaed2a841 tempest-VolumesListTestJSON-1424316819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abf68825-3422-48b7-920e-0ddd8a727e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52a34ac0-10b1-4eb2-b7a6-913d5969fac7', 'volume_name': 'volume-52a34ac0-10b1-4eb2-b7a6-913d5969fac7', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-79ab9785-090f-4cdd-a759-b6aeaed2a841 tempest-VolumesListTestJSON-1424316819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7c3ff0a-4260-468d-aa46-9335e6859713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-79ab9785-090f-4cdd-a759-b6aeaed2a841 tempest-VolumesListTestJSON-1424316819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7c3ff0a-4260-468d-aa46-9335e6859713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-79ab9785-090f-4cdd-a759-b6aeaed2a841 tempest-VolumesListTestJSON-1424316819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5704234d-1ae8-4277-8bd5-0fcf0746c6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:12 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-79ab9785-090f-4cdd-a759-b6aeaed2a841 tempest-VolumesListTestJSON-1424316819 None] Volume 52a34ac0-10b1-4eb2-b7a6-913d5969fac7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52a34ac0-10b1-4eb2-b7a6-913d5969fac7', 'volume_size': 1}
Jul 14 16:32:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-79ab9785-090f-4cdd-a759-b6aeaed2a841 tempest-VolumesListTestJSON-1424316819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:32:12 devstack sudo[97963]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0142129e-eb2f-4810-9b76-14efd1322703 tempest-VolumesDeleteCascade-715576226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-47767d56-c1e5-4e73-a555-f2ff387981ff.info" returned: 0 in 0.397s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:12 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-0142129e-eb2f-4810-9b76-14efd1322703 tempest-VolumesDeleteCascade-715576226 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-47767d56-c1e5-4e73-a555-f2ff387981ff.info is being set with open permissions: ugo+rw
Jul 14 16:32:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0142129e-eb2f-4810-9b76-14efd1322703 tempest-VolumesDeleteCascade-715576226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-47767d56-c1e5-4e73-a555-f2ff387981ff.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:12 devstack sudo[97966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-47767d56-c1e5-4e73-a555-f2ff387981ff.info
Jul 14 16:32:12 devstack sudo[97966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:12 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-538cd55e-068c-4313-9d83-995c66d96b07 tempest-TestServerVolumeAttachScenarioOldVersion-977879743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:32:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-538cd55e-068c-4313-9d83-995c66d96b07 tempest-TestServerVolumeAttachScenarioOldVersion-977879743 None] Flow 'volume_create_manager' (797650a1-76d5-423f-8576-ac3a2fbd445d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:32:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-538cd55e-068c-4313-9d83-995c66d96b07 tempest-TestServerVolumeAttachScenarioOldVersion-977879743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c3d9f42-bd56-4b20-86ea-b9a2dee1042f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-538cd55e-068c-4313-9d83-995c66d96b07 tempest-TestServerVolumeAttachScenarioOldVersion-977879743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c3d9f42-bd56-4b20-86ea-b9a2dee1042f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:32:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1846751816',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2302c49a-febd-400c-aebb-418076a199ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d8952c426374f6ea4aa7f19cab48f7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:32:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:32:12Z,use_quota=True,user_id='a7d2939475f94912a69651f827175a0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-538cd55e-068c-4313-9d83-995c66d96b07 tempest-TestServerVolumeAttachScenarioOldVersion-977879743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bed28e20-6c04-4dc5-a1e5-05fa0f3838a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-538cd55e-068c-4313-9d83-995c66d96b07 tempest-TestServerVolumeAttachScenarioOldVersion-977879743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bed28e20-6c04-4dc5-a1e5-05fa0f3838a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-538cd55e-068c-4313-9d83-995c66d96b07 tempest-TestServerVolumeAttachScenarioOldVersion-977879743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97873dde-10e0-4a20-a6b8-70fa284bb46c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-538cd55e-068c-4313-9d83-995c66d96b07 tempest-TestServerVolumeAttachScenarioOldVersion-977879743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97873dde-10e0-4a20-a6b8-70fa284bb46c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2302c49a-febd-400c-aebb-418076a199ad', 'volume_name': 'volume-2302c49a-febd-400c-aebb-418076a199ad', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-538cd55e-068c-4313-9d83-995c66d96b07 tempest-TestServerVolumeAttachScenarioOldVersion-977879743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (010c120b-2e6d-45fb-bf35-17e2b5544929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-538cd55e-068c-4313-9d83-995c66d96b07 tempest-TestServerVolumeAttachScenarioOldVersion-977879743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (010c120b-2e6d-45fb-bf35-17e2b5544929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-538cd55e-068c-4313-9d83-995c66d96b07 tempest-TestServerVolumeAttachScenarioOldVersion-977879743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34b2275b-33fe-4e83-b24b-e1e4380808c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:12 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-538cd55e-068c-4313-9d83-995c66d96b07 tempest-TestServerVolumeAttachScenarioOldVersion-977879743 None] Volume 2302c49a-febd-400c-aebb-418076a199ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2302c49a-febd-400c-aebb-418076a199ad', 'volume_size': 1}
Jul 14 16:32:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-538cd55e-068c-4313-9d83-995c66d96b07 tempest-TestServerVolumeAttachScenarioOldVersion-977879743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:32:12 devstack sudo[97966]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0142129e-eb2f-4810-9b76-14efd1322703 tempest-VolumesDeleteCascade-715576226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-47767d56-c1e5-4e73-a555-f2ff387981ff.info" returned: 0 in 0.307s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0142129e-eb2f-4810-9b76-14efd1322703 tempest-VolumesDeleteCascade-715576226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.474s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:32:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-79ab9785-090f-4cdd-a759-b6aeaed2a841 tempest-VolumesListTestJSON-1424316819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.473s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:32:12 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-79ab9785-090f-4cdd-a759-b6aeaed2a841 tempest-VolumesListTestJSON-1424316819 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:32:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1967682852',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52a34ac0-10b1-4eb2-b7a6-913d5969fac7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='32fa7586977a4c45a2ac0cbf4057ba70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:32:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:32:12Z,use_quota=True,user_id='11d9ab1ea14044f49d269507b717a2ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:32:12 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-79ab9785-090f-4cdd-a759-b6aeaed2a841 tempest-VolumesListTestJSON-1424316819 None] Creating volume 52a34ac0-10b1-4eb2-b7a6-913d5969fac7 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:32:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-79ab9785-090f-4cdd-a759-b6aeaed2a841 tempest-VolumesListTestJSON-1424316819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:32:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-79ab9785-090f-4cdd-a759-b6aeaed2a841 tempest-VolumesListTestJSON-1424316819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:32:12 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-79ab9785-090f-4cdd-a759-b6aeaed2a841 tempest-VolumesListTestJSON-1424316819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:32:12 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-79ab9785-090f-4cdd-a759-b6aeaed2a841 tempest-VolumesListTestJSON-1424316819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:32:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-79ab9785-090f-4cdd-a759-b6aeaed2a841 tempest-VolumesListTestJSON-1424316819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:32:12 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-79ab9785-090f-4cdd-a759-b6aeaed2a841 tempest-VolumesListTestJSON-1424316819 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:32:12 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-79ab9785-090f-4cdd-a759-b6aeaed2a841 tempest-VolumesListTestJSON-1424316819 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:32:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-79ab9785-090f-4cdd-a759-b6aeaed2a841 tempest-VolumesListTestJSON-1424316819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-52a34ac0-10b1-4eb2-b7a6-913d5969fac7 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:12 devstack sudo[97969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-52a34ac0-10b1-4eb2-b7a6-913d5969fac7 1073741824
Jul 14 16:32:12 devstack sudo[97969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:12 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-0142129e-eb2f-4810-9b76-14efd1322703 tempest-VolumesDeleteCascade-715576226 None] Create snapshot completed successfully
Jul 14 16:32:13 devstack sudo[97969]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-79ab9785-090f-4cdd-a759-b6aeaed2a841 tempest-VolumesListTestJSON-1424316819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-52a34ac0-10b1-4eb2-b7a6-913d5969fac7 1073741824" returned: 0 in 0.475s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-79ab9785-090f-4cdd-a759-b6aeaed2a841 tempest-VolumesListTestJSON-1424316819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-52a34ac0-10b1-4eb2-b7a6-913d5969fac7 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:13 devstack sudo[97975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-52a34ac0-10b1-4eb2-b7a6-913d5969fac7
Jul 14 16:32:13 devstack sudo[97975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:13 devstack sudo[97975]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-79ab9785-090f-4cdd-a759-b6aeaed2a841 tempest-VolumesListTestJSON-1424316819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-52a34ac0-10b1-4eb2-b7a6-913d5969fac7" returned: 0 in 0.297s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:13 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-79ab9785-090f-4cdd-a759-b6aeaed2a841 tempest-VolumesListTestJSON-1424316819 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:32:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-79ab9785-090f-4cdd-a759-b6aeaed2a841 tempest-VolumesListTestJSON-1424316819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:32:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-538cd55e-068c-4313-9d83-995c66d96b07 tempest-TestServerVolumeAttachScenarioOldVersion-977879743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.909s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:32:13 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-538cd55e-068c-4313-9d83-995c66d96b07 tempest-TestServerVolumeAttachScenarioOldVersion-977879743 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:32:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1846751816',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2302c49a-febd-400c-aebb-418076a199ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d8952c426374f6ea4aa7f19cab48f7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:32:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:32:12Z,use_quota=True,user_id='a7d2939475f94912a69651f827175a0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:32:13 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-538cd55e-068c-4313-9d83-995c66d96b07 tempest-TestServerVolumeAttachScenarioOldVersion-977879743 None] Creating volume 2302c49a-febd-400c-aebb-418076a199ad {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:32:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-538cd55e-068c-4313-9d83-995c66d96b07 tempest-TestServerVolumeAttachScenarioOldVersion-977879743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:32:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-538cd55e-068c-4313-9d83-995c66d96b07 tempest-TestServerVolumeAttachScenarioOldVersion-977879743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:32:13 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-538cd55e-068c-4313-9d83-995c66d96b07 tempest-TestServerVolumeAttachScenarioOldVersion-977879743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:32:13 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-538cd55e-068c-4313-9d83-995c66d96b07 tempest-TestServerVolumeAttachScenarioOldVersion-977879743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:32:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-538cd55e-068c-4313-9d83-995c66d96b07 tempest-TestServerVolumeAttachScenarioOldVersion-977879743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:32:13 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-538cd55e-068c-4313-9d83-995c66d96b07 tempest-TestServerVolumeAttachScenarioOldVersion-977879743 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:32:13 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-538cd55e-068c-4313-9d83-995c66d96b07 tempest-TestServerVolumeAttachScenarioOldVersion-977879743 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:32:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-538cd55e-068c-4313-9d83-995c66d96b07 tempest-TestServerVolumeAttachScenarioOldVersion-977879743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2302c49a-febd-400c-aebb-418076a199ad 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:13 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-79ab9785-090f-4cdd-a759-b6aeaed2a841 tempest-VolumesListTestJSON-1424316819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5704234d-1ae8-4277-8bd5-0fcf0746c6ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52a34ac0-10b1-4eb2-b7a6-913d5969fac7', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:13 devstack sudo[97978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2302c49a-febd-400c-aebb-418076a199ad 1073741824
Jul 14 16:32:13 devstack sudo[97978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:13 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-79ab9785-090f-4cdd-a759-b6aeaed2a841 tempest-VolumesListTestJSON-1424316819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6038e2f-b5a7-4007-bbc7-59899c64fb18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:13 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-79ab9785-090f-4cdd-a759-b6aeaed2a841 tempest-VolumesListTestJSON-1424316819 None] Volume volume-52a34ac0-10b1-4eb2-b7a6-913d5969fac7 (52a34ac0-10b1-4eb2-b7a6-913d5969fac7): created successfully
Jul 14 16:32:13 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-79ab9785-090f-4cdd-a759-b6aeaed2a841 tempest-VolumesListTestJSON-1424316819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6038e2f-b5a7-4007-bbc7-59899c64fb18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:13 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-79ab9785-090f-4cdd-a759-b6aeaed2a841 tempest-VolumesListTestJSON-1424316819 None] Flow 'volume_create_manager' (f5bb0d0c-fb0f-49a2-9cee-91fe89029f1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:32:13 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-79ab9785-090f-4cdd-a759-b6aeaed2a841 tempest-VolumesListTestJSON-1424316819 None] Created volume successfully.
Jul 14 16:32:13 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-98a2b551-cf81-41ce-bd28-6441b79b49b9 tempest-VolumesDeleteCascade-715576226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:32:13 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-98a2b551-cf81-41ce-bd28-6441b79b49b9 tempest-VolumesDeleteCascade-715576226 None] Flow 'volume_create_manager' (7e9dfe78-4723-4344-83e8-dc60275cf9ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:32:13 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-98a2b551-cf81-41ce-bd28-6441b79b49b9 tempest-VolumesDeleteCascade-715576226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (085e41cf-5531-4145-b837-f3eac1eeeea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:13 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-98a2b551-cf81-41ce-bd28-6441b79b49b9 tempest-VolumesDeleteCascade-715576226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (085e41cf-5531-4145-b837-f3eac1eeeea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:32:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1136781678',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68f3e076-14fd-496a-90f8-da67ec6db8ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e74c2ad7217481a9f31d066d412ae96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:32:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7dcbfe6e-1644-4c60-a20a-307473bd25e4,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:32:14Z,use_quota=True,user_id='a72b59e85e1f4f1ea7aedbc379420875',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:13 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-98a2b551-cf81-41ce-bd28-6441b79b49b9 tempest-VolumesDeleteCascade-715576226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e820929e-73ca-45e7-94fe-e28663577f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:13 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-98a2b551-cf81-41ce-bd28-6441b79b49b9 tempest-VolumesDeleteCascade-715576226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e820929e-73ca-45e7-94fe-e28663577f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:13 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-98a2b551-cf81-41ce-bd28-6441b79b49b9 tempest-VolumesDeleteCascade-715576226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0cb825d-ca66-4948-89e1-533649d9e2d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:13 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-98a2b551-cf81-41ce-bd28-6441b79b49b9 tempest-VolumesDeleteCascade-715576226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0cb825d-ca66-4948-89e1-533649d9e2d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '68f3e076-14fd-496a-90f8-da67ec6db8ed', 'volume_name': 'volume-68f3e076-14fd-496a-90f8-da67ec6db8ed', 'volume_size': 1, 'snapshot_id': '7dcbfe6e-1644-4c60-a20a-307473bd25e4'}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:13 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-98a2b551-cf81-41ce-bd28-6441b79b49b9 tempest-VolumesDeleteCascade-715576226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22ec6d47-815b-4860-b9d7-ddc44d7f365d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:13 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-98a2b551-cf81-41ce-bd28-6441b79b49b9 tempest-VolumesDeleteCascade-715576226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22ec6d47-815b-4860-b9d7-ddc44d7f365d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:13 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-98a2b551-cf81-41ce-bd28-6441b79b49b9 tempest-VolumesDeleteCascade-715576226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb854ddd-7c0f-45de-85f0-8243a59c295d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:13 devstack sudo[97978]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:13 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-98a2b551-cf81-41ce-bd28-6441b79b49b9 tempest-VolumesDeleteCascade-715576226 None] Volume 68f3e076-14fd-496a-90f8-da67ec6db8ed: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-68f3e076-14fd-496a-90f8-da67ec6db8ed', 'volume_size': 1, 'snapshot_id': '7dcbfe6e-1644-4c60-a20a-307473bd25e4'}
Jul 14 16:32:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-538cd55e-068c-4313-9d83-995c66d96b07 tempest-TestServerVolumeAttachScenarioOldVersion-977879743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2302c49a-febd-400c-aebb-418076a199ad 1073741824" returned: 0 in 0.583s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-98a2b551-cf81-41ce-bd28-6441b79b49b9 tempest-VolumesDeleteCascade-715576226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:32:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-538cd55e-068c-4313-9d83-995c66d96b07 tempest-TestServerVolumeAttachScenarioOldVersion-977879743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2302c49a-febd-400c-aebb-418076a199ad {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:14 devstack sudo[97984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2302c49a-febd-400c-aebb-418076a199ad
Jul 14 16:32:14 devstack sudo[97984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:14 devstack sudo[97984]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-538cd55e-068c-4313-9d83-995c66d96b07 tempest-TestServerVolumeAttachScenarioOldVersion-977879743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2302c49a-febd-400c-aebb-418076a199ad" returned: 0 in 0.310s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:14 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-538cd55e-068c-4313-9d83-995c66d96b07 tempest-TestServerVolumeAttachScenarioOldVersion-977879743 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:32:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-538cd55e-068c-4313-9d83-995c66d96b07 tempest-TestServerVolumeAttachScenarioOldVersion-977879743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:32:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-98a2b551-cf81-41ce-bd28-6441b79b49b9 tempest-VolumesDeleteCascade-715576226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.345s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:32:14 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-98a2b551-cf81-41ce-bd28-6441b79b49b9 tempest-VolumesDeleteCascade-715576226 None] Acquiring lock "cinder-quobyte-7dcbfe6e-1644-4c60-a20a-307473bd25e4-68f3e076-14fd-496a-90f8-da67ec6db8ed" by "_create_volume_from_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:32:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-538cd55e-068c-4313-9d83-995c66d96b07 tempest-TestServerVolumeAttachScenarioOldVersion-977879743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34b2275b-33fe-4e83-b24b-e1e4380808c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2302c49a-febd-400c-aebb-418076a199ad', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-538cd55e-068c-4313-9d83-995c66d96b07 tempest-TestServerVolumeAttachScenarioOldVersion-977879743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (129b5d7a-ab71-4693-b7b0-ecbf962f6ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:14 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-98a2b551-cf81-41ce-bd28-6441b79b49b9 tempest-VolumesDeleteCascade-715576226 None] Lock "cinder-quobyte-7dcbfe6e-1644-4c60-a20a-307473bd25e4-68f3e076-14fd-496a-90f8-da67ec6db8ed" acquired by "_create_volume_from_snapshot" :: waited 0.037s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:32:14 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-98a2b551-cf81-41ce-bd28-6441b79b49b9 tempest-VolumesDeleteCascade-715576226 None] Creating volume 68f3e076-14fd-496a-90f8-da67ec6db8ed from snapshot 7dcbfe6e-1644-4c60-a20a-307473bd25e4 {{(pid=87166) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 14 16:32:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-98a2b551-cf81-41ce-bd28-6441b79b49b9 tempest-VolumesDeleteCascade-715576226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:32:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-98a2b551-cf81-41ce-bd28-6441b79b49b9 tempest-VolumesDeleteCascade-715576226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:32:14 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-98a2b551-cf81-41ce-bd28-6441b79b49b9 tempest-VolumesDeleteCascade-715576226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:32:14 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-98a2b551-cf81-41ce-bd28-6441b79b49b9 tempest-VolumesDeleteCascade-715576226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:32:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-98a2b551-cf81-41ce-bd28-6441b79b49b9 tempest-VolumesDeleteCascade-715576226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:32:14 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-98a2b551-cf81-41ce-bd28-6441b79b49b9 tempest-VolumesDeleteCascade-715576226 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:32:14 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-98a2b551-cf81-41ce-bd28-6441b79b49b9 tempest-VolumesDeleteCascade-715576226 None] Acquiring lock "cinder-quobyte-68f3e076-14fd-496a-90f8-da67ec6db8ed" by "_copy_volume_from_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:32:14 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-538cd55e-068c-4313-9d83-995c66d96b07 tempest-TestServerVolumeAttachScenarioOldVersion-977879743 None] Volume volume-2302c49a-febd-400c-aebb-418076a199ad (2302c49a-febd-400c-aebb-418076a199ad): created successfully
Jul 14 16:32:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-538cd55e-068c-4313-9d83-995c66d96b07 tempest-TestServerVolumeAttachScenarioOldVersion-977879743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (129b5d7a-ab71-4693-b7b0-ecbf962f6ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-538cd55e-068c-4313-9d83-995c66d96b07 tempest-TestServerVolumeAttachScenarioOldVersion-977879743 None] Flow 'volume_create_manager' (797650a1-76d5-423f-8576-ac3a2fbd445d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:32:14 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-98a2b551-cf81-41ce-bd28-6441b79b49b9 tempest-VolumesDeleteCascade-715576226 None] Lock "cinder-quobyte-68f3e076-14fd-496a-90f8-da67ec6db8ed" acquired by "_copy_volume_from_snapshot" :: waited 0.040s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:32:14 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-98a2b551-cf81-41ce-bd28-6441b79b49b9 tempest-VolumesDeleteCascade-715576226 None] snapshot: 7dcbfe6e-1644-4c60-a20a-307473bd25e4, volume: 68f3e076-14fd-496a-90f8-da67ec6db8ed,  {{(pid=87166) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 14 16:32:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-98a2b551-cf81-41ce-bd28-6441b79b49b9 tempest-VolumesDeleteCascade-715576226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:32:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-98a2b551-cf81-41ce-bd28-6441b79b49b9 tempest-VolumesDeleteCascade-715576226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:32:14 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-98a2b551-cf81-41ce-bd28-6441b79b49b9 tempest-VolumesDeleteCascade-715576226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:32:14 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-98a2b551-cf81-41ce-bd28-6441b79b49b9 tempest-VolumesDeleteCascade-715576226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:32:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-98a2b551-cf81-41ce-bd28-6441b79b49b9 tempest-VolumesDeleteCascade-715576226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:32:14 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-538cd55e-068c-4313-9d83-995c66d96b07 tempest-TestServerVolumeAttachScenarioOldVersion-977879743 None] Created volume successfully.
Jul 14 16:32:14 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f487951-85ad-400b-a646-a5440feba2cd]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:32:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-98a2b551-cf81-41ce-bd28-6441b79b49b9 tempest-VolumesDeleteCascade-715576226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-47767d56-c1e5-4e73-a555-f2ff387981ff.7dcbfe6e-1644-4c60-a20a-307473bd25e4 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:14 devstack sudo[97987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-47767d56-c1e5-4e73-a555-f2ff387981ff.7dcbfe6e-1644-4c60-a20a-307473bd25e4
Jul 14 16:32:14 devstack sudo[97987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:14 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d9df89f-d57f-4487-893f-41cd4de5a3bc tempest-VolumesListTestJSON-1424316819 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:32:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5d9df89f-d57f-4487-893f-41cd4de5a3bc tempest-VolumesListTestJSON-1424316819 None] Flow 'volume_create_manager' (0b0e1e30-8845-4d1b-981a-118ebcb7b0e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:32:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5d9df89f-d57f-4487-893f-41cd4de5a3bc tempest-VolumesListTestJSON-1424316819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcaadf6a-e0a2-468c-9609-ec8c031c88eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5d9df89f-d57f-4487-893f-41cd4de5a3bc tempest-VolumesListTestJSON-1424316819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcaadf6a-e0a2-468c-9609-ec8c031c88eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:32:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1911754711',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cea3ec1f-9042-40db-ac50-9b81d912dfed,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='32fa7586977a4c45a2ac0cbf4057ba70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:32:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:32:15Z,use_quota=True,user_id='11d9ab1ea14044f49d269507b717a2ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5d9df89f-d57f-4487-893f-41cd4de5a3bc tempest-VolumesListTestJSON-1424316819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d35e115-e515-4168-95fc-58d948d3e2af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5d9df89f-d57f-4487-893f-41cd4de5a3bc tempest-VolumesListTestJSON-1424316819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d35e115-e515-4168-95fc-58d948d3e2af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5d9df89f-d57f-4487-893f-41cd4de5a3bc tempest-VolumesListTestJSON-1424316819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54be4883-46cf-4a91-81df-71ee4032dc83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5d9df89f-d57f-4487-893f-41cd4de5a3bc tempest-VolumesListTestJSON-1424316819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54be4883-46cf-4a91-81df-71ee4032dc83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cea3ec1f-9042-40db-ac50-9b81d912dfed', 'volume_name': 'volume-cea3ec1f-9042-40db-ac50-9b81d912dfed', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5d9df89f-d57f-4487-893f-41cd4de5a3bc tempest-VolumesListTestJSON-1424316819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c0190da-21a5-4cb2-aea9-ccd757b28a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5d9df89f-d57f-4487-893f-41cd4de5a3bc tempest-VolumesListTestJSON-1424316819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c0190da-21a5-4cb2-aea9-ccd757b28a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5d9df89f-d57f-4487-893f-41cd4de5a3bc tempest-VolumesListTestJSON-1424316819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (390ae880-533a-4b62-b8b0-af4d8e840011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:14 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-5d9df89f-d57f-4487-893f-41cd4de5a3bc tempest-VolumesListTestJSON-1424316819 None] Volume cea3ec1f-9042-40db-ac50-9b81d912dfed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cea3ec1f-9042-40db-ac50-9b81d912dfed', 'volume_size': 1}
Jul 14 16:32:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5d9df89f-d57f-4487-893f-41cd4de5a3bc tempest-VolumesListTestJSON-1424316819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:32:14 devstack sudo[97987]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-98a2b551-cf81-41ce-bd28-6441b79b49b9 tempest-VolumesDeleteCascade-715576226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-47767d56-c1e5-4e73-a555-f2ff387981ff.7dcbfe6e-1644-4c60-a20a-307473bd25e4" returned: 0 in 0.513s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:14 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-98a2b551-cf81-41ce-bd28-6441b79b49b9 tempest-VolumesDeleteCascade-715576226 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47767d56-c1e5-4e73-a555-f2ff387981ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 16:32:14 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-98a2b551-cf81-41ce-bd28-6441b79b49b9 tempest-VolumesDeleteCascade-715576226 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-47767d56-c1e5-4e73-a555-f2ff387981ff {{(pid=87166) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 14 16:32:14 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-98a2b551-cf81-41ce-bd28-6441b79b49b9 tempest-VolumesDeleteCascade-715576226 None] Creating direct copy from snapshot {{(pid=87166) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 14 16:32:15 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb4b549b-d5f5-47aa-b37c-142efa12cd15]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:32:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-98a2b551-cf81-41ce-bd28-6441b79b49b9 tempest-VolumesDeleteCascade-715576226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-47767d56-c1e5-4e73-a555-f2ff387981ff {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:15 devstack sudo[97992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-47767d56-c1e5-4e73-a555-f2ff387981ff
Jul 14 16:32:15 devstack sudo[97992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:15 devstack sudo[97992]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-98a2b551-cf81-41ce-bd28-6441b79b49b9 tempest-VolumesDeleteCascade-715576226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-47767d56-c1e5-4e73-a555-f2ff387981ff" returned: 0 in 0.384s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:15 devstack cinder-volume[87166]: DEBUG cinder.utils [None req-98a2b551-cf81-41ce-bd28-6441b79b49b9 tempest-VolumesDeleteCascade-715576226 None] Path /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-68f3e076-14fd-496a-90f8-da67ec6db8ed not found in is_blk_device check {{(pid=87166) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 14 16:32:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-98a2b551-cf81-41ce-bd28-6441b79b49b9 tempest-VolumesDeleteCascade-715576226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-47767d56-c1e5-4e73-a555-f2ff387981ff /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-68f3e076-14fd-496a-90f8-da67ec6db8ed {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:15 devstack sudo[97997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-47767d56-c1e5-4e73-a555-f2ff387981ff /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-68f3e076-14fd-496a-90f8-da67ec6db8ed
Jul 14 16:32:15 devstack sudo[97997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-c9ee6819-c14d-4835-ae5b-b09d9a0634a7 req-88264823-73b3-4b43-8064-2b3eeb92a7f5 tempest-TestServerVolumeAttachScenarioOldVersion-977879743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:32:20 devstack sudo[97997]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-98a2b551-cf81-41ce-bd28-6441b79b49b9 tempest-VolumesDeleteCascade-715576226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-47767d56-c1e5-4e73-a555-f2ff387981ff /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-68f3e076-14fd-496a-90f8-da67ec6db8ed" returned: 0 in 5.175s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:20 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ff4ccd-23ad-4238-9841-248d97e4e451]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:32:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-98a2b551-cf81-41ce-bd28-6441b79b49b9 tempest-VolumesDeleteCascade-715576226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-47767d56-c1e5-4e73-a555-f2ff387981ff {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:20 devstack sudo[98022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-47767d56-c1e5-4e73-a555-f2ff387981ff
Jul 14 16:32:20 devstack sudo[98022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:21 devstack sudo[98022]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-98a2b551-cf81-41ce-bd28-6441b79b49b9 tempest-VolumesDeleteCascade-715576226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-47767d56-c1e5-4e73-a555-f2ff387981ff" returned: 0 in 0.521s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:21 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-98a2b551-cf81-41ce-bd28-6441b79b49b9 tempest-VolumesDeleteCascade-715576226 None] Image conversion details: src /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-47767d56-c1e5-4e73-a555-f2ff387981ff, size 1024.00 MB, duration 5.18 sec, destination /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-68f3e076-14fd-496a-90f8-da67ec6db8ed {{(pid=87166) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 14 16:32:21 devstack cinder-volume[87166]: INFO cinder.image.image_utils [None req-98a2b551-cf81-41ce-bd28-6441b79b49b9 tempest-VolumesDeleteCascade-715576226 None] Converted 1024.00 MB image at 197.82 MB/s
Jul 14 16:32:21 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-98a2b551-cf81-41ce-bd28-6441b79b49b9 tempest-VolumesDeleteCascade-715576226 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-68f3e076-14fd-496a-90f8-da67ec6db8ed is being set with open permissions: ugo+rw
Jul 14 16:32:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-98a2b551-cf81-41ce-bd28-6441b79b49b9 tempest-VolumesDeleteCascade-715576226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-68f3e076-14fd-496a-90f8-da67ec6db8ed {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:21 devstack sudo[98027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-68f3e076-14fd-496a-90f8-da67ec6db8ed
Jul 14 16:32:21 devstack sudo[98027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:21 devstack sudo[98027]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-98a2b551-cf81-41ce-bd28-6441b79b49b9 tempest-VolumesDeleteCascade-715576226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-68f3e076-14fd-496a-90f8-da67ec6db8ed" returned: 0 in 0.240s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:21 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-98a2b551-cf81-41ce-bd28-6441b79b49b9 tempest-VolumesDeleteCascade-715576226 None] Lock "cinder-quobyte-68f3e076-14fd-496a-90f8-da67ec6db8ed" released by "_copy_volume_from_snapshot" :: held 6.951s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:32:21 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-98a2b551-cf81-41ce-bd28-6441b79b49b9 tempest-VolumesDeleteCascade-715576226 None] Lock "cinder-quobyte-7dcbfe6e-1644-4c60-a20a-307473bd25e4-68f3e076-14fd-496a-90f8-da67ec6db8ed" released by "_create_volume_from_snapshot" :: held 7.009s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:32:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-98a2b551-cf81-41ce-bd28-6441b79b49b9 tempest-VolumesDeleteCascade-715576226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.047s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:32:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5d9df89f-d57f-4487-893f-41cd4de5a3bc tempest-VolumesListTestJSON-1424316819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.423s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:32:21 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5d9df89f-d57f-4487-893f-41cd4de5a3bc tempest-VolumesListTestJSON-1424316819 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:32:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1911754711',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cea3ec1f-9042-40db-ac50-9b81d912dfed,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='32fa7586977a4c45a2ac0cbf4057ba70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:32:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:32:15Z,use_quota=True,user_id='11d9ab1ea14044f49d269507b717a2ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:32:21 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-5d9df89f-d57f-4487-893f-41cd4de5a3bc tempest-VolumesListTestJSON-1424316819 None] Creating volume cea3ec1f-9042-40db-ac50-9b81d912dfed {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:32:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5d9df89f-d57f-4487-893f-41cd4de5a3bc tempest-VolumesListTestJSON-1424316819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:32:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5d9df89f-d57f-4487-893f-41cd4de5a3bc tempest-VolumesListTestJSON-1424316819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:32:21 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5d9df89f-d57f-4487-893f-41cd4de5a3bc tempest-VolumesListTestJSON-1424316819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:32:21 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5d9df89f-d57f-4487-893f-41cd4de5a3bc tempest-VolumesListTestJSON-1424316819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:32:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5d9df89f-d57f-4487-893f-41cd4de5a3bc tempest-VolumesListTestJSON-1424316819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:32:21 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5d9df89f-d57f-4487-893f-41cd4de5a3bc tempest-VolumesListTestJSON-1424316819 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:32:21 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-5d9df89f-d57f-4487-893f-41cd4de5a3bc tempest-VolumesListTestJSON-1424316819 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:32:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5d9df89f-d57f-4487-893f-41cd4de5a3bc tempest-VolumesListTestJSON-1424316819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cea3ec1f-9042-40db-ac50-9b81d912dfed 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:21 devstack sudo[98030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cea3ec1f-9042-40db-ac50-9b81d912dfed 1073741824
Jul 14 16:32:21 devstack sudo[98030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:21 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-98a2b551-cf81-41ce-bd28-6441b79b49b9 tempest-VolumesDeleteCascade-715576226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb854ddd-7c0f-45de-85f0-8243a59c295d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68f3e076-14fd-496a-90f8-da67ec6db8ed', 'volume_size': 1, 'snapshot_id': '7dcbfe6e-1644-4c60-a20a-307473bd25e4'}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:21 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-98a2b551-cf81-41ce-bd28-6441b79b49b9 tempest-VolumesDeleteCascade-715576226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e451d0da-0f67-4fc8-b297-c518dbf36dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:21 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-98a2b551-cf81-41ce-bd28-6441b79b49b9 tempest-VolumesDeleteCascade-715576226 None] Volume volume-68f3e076-14fd-496a-90f8-da67ec6db8ed (68f3e076-14fd-496a-90f8-da67ec6db8ed): created successfully
Jul 14 16:32:21 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-98a2b551-cf81-41ce-bd28-6441b79b49b9 tempest-VolumesDeleteCascade-715576226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e451d0da-0f67-4fc8-b297-c518dbf36dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:21 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-98a2b551-cf81-41ce-bd28-6441b79b49b9 tempest-VolumesDeleteCascade-715576226 None] Flow 'volume_create_manager' (7e9dfe78-4723-4344-83e8-dc60275cf9ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:32:21 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-98a2b551-cf81-41ce-bd28-6441b79b49b9 tempest-VolumesDeleteCascade-715576226 None] Created volume successfully.
Jul 14 16:32:21 devstack sudo[98030]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5d9df89f-d57f-4487-893f-41cd4de5a3bc tempest-VolumesListTestJSON-1424316819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cea3ec1f-9042-40db-ac50-9b81d912dfed 1073741824" returned: 0 in 0.464s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5d9df89f-d57f-4487-893f-41cd4de5a3bc tempest-VolumesListTestJSON-1424316819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cea3ec1f-9042-40db-ac50-9b81d912dfed {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:21 devstack sudo[98036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cea3ec1f-9042-40db-ac50-9b81d912dfed
Jul 14 16:32:21 devstack sudo[98036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:22 devstack sudo[98036]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5d9df89f-d57f-4487-893f-41cd4de5a3bc tempest-VolumesListTestJSON-1424316819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cea3ec1f-9042-40db-ac50-9b81d912dfed" returned: 0 in 0.276s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:22 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5d9df89f-d57f-4487-893f-41cd4de5a3bc tempest-VolumesListTestJSON-1424316819 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:32:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5d9df89f-d57f-4487-893f-41cd4de5a3bc tempest-VolumesListTestJSON-1424316819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:32:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-c9ee6819-c14d-4835-ae5b-b09d9a0634a7 req-88264823-73b3-4b43-8064-2b3eeb92a7f5 tempest-TestServerVolumeAttachScenarioOldVersion-977879743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.495s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:32:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5d9df89f-d57f-4487-893f-41cd4de5a3bc tempest-VolumesListTestJSON-1424316819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (390ae880-533a-4b62-b8b0-af4d8e840011) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cea3ec1f-9042-40db-ac50-9b81d912dfed', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5d9df89f-d57f-4487-893f-41cd4de5a3bc tempest-VolumesListTestJSON-1424316819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10b9ee75-05aa-4de9-a994-2bac38b9a9ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:22 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[72591958-d8f1-405f-bedd-1590adb948cd]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:32:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-c9ee6819-c14d-4835-ae5b-b09d9a0634a7 req-88264823-73b3-4b43-8064-2b3eeb92a7f5 tempest-TestServerVolumeAttachScenarioOldVersion-977879743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2302c49a-febd-400c-aebb-418076a199ad {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:22 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-5d9df89f-d57f-4487-893f-41cd4de5a3bc tempest-VolumesListTestJSON-1424316819 None] Volume volume-cea3ec1f-9042-40db-ac50-9b81d912dfed (cea3ec1f-9042-40db-ac50-9b81d912dfed): created successfully
Jul 14 16:32:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5d9df89f-d57f-4487-893f-41cd4de5a3bc tempest-VolumesListTestJSON-1424316819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10b9ee75-05aa-4de9-a994-2bac38b9a9ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5d9df89f-d57f-4487-893f-41cd4de5a3bc tempest-VolumesListTestJSON-1424316819 None] Flow 'volume_create_manager' (0b0e1e30-8845-4d1b-981a-118ebcb7b0e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:32:22 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-5d9df89f-d57f-4487-893f-41cd4de5a3bc tempest-VolumesListTestJSON-1424316819 None] Created volume successfully.
Jul 14 16:32:22 devstack sudo[98039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2302c49a-febd-400c-aebb-418076a199ad
Jul 14 16:32:22 devstack sudo[98039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6b313c72-67cb-4370-9319-09cc0e6e6d6e tempest-VolumesDeleteCascade-715576226 None] Acquiring lock "cinder-47767d56-c1e5-4e73-a555-f2ff387981ff-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:32:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6b313c72-67cb-4370-9319-09cc0e6e6d6e tempest-VolumesDeleteCascade-715576226 None] Lock "cinder-47767d56-c1e5-4e73-a555-f2ff387981ff-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:32:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6b313c72-67cb-4370-9319-09cc0e6e6d6e tempest-VolumesDeleteCascade-715576226 None] Performing cascade delete. {{(pid=87166) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Jul 14 16:32:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6b313c72-67cb-4370-9319-09cc0e6e6d6e tempest-VolumesDeleteCascade-715576226 None] Acquiring lock "cinder-7dcbfe6e-1644-4c60-a20a-307473bd25e4-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:32:22 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-4446f9eb-1390-43f6-91b8-95099845c935 tempest-VolumeTypesAccessTest-1203422451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:32:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4446f9eb-1390-43f6-91b8-95099845c935 tempest-VolumeTypesAccessTest-1203422451 None] Flow 'volume_create_manager' (7387ef51-40df-4861-8056-2197e83b4df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:32:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4446f9eb-1390-43f6-91b8-95099845c935 tempest-VolumeTypesAccessTest-1203422451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c678e80-5de7-4415-af8e-7dc9a6177e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6b313c72-67cb-4370-9319-09cc0e6e6d6e tempest-VolumesDeleteCascade-715576226 None] Lock "cinder-7dcbfe6e-1644-4c60-a20a-307473bd25e4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:32:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6b313c72-67cb-4370-9319-09cc0e6e6d6e tempest-VolumesDeleteCascade-715576226 None] Acquiring lock "cinder-quobyte-47767d56-c1e5-4e73-a555-f2ff387981ff" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:32:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4446f9eb-1390-43f6-91b8-95099845c935 tempest-VolumeTypesAccessTest-1203422451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c678e80-5de7-4415-af8e-7dc9a6177e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:32:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-905384019',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e84dfb6-9787-4f36-abdd-c869dc1bfafc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='382354192c2c4a10b7503c4bdf6bd83c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:32:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:32:22Z,use_quota=True,user_id='27698fb0be2344a5a30fe30feeac1dd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ddcbd37-5beb-4f10-9a4b-41a5aa00ec97),volume_type_id=1ddcbd37-5beb-4f10-9a4b-41a5aa00ec97)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4446f9eb-1390-43f6-91b8-95099845c935 tempest-VolumeTypesAccessTest-1203422451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fdf82ab-edff-4637-a137-6bc800b376f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4446f9eb-1390-43f6-91b8-95099845c935 tempest-VolumeTypesAccessTest-1203422451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fdf82ab-edff-4637-a137-6bc800b376f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4446f9eb-1390-43f6-91b8-95099845c935 tempest-VolumeTypesAccessTest-1203422451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4f613eb-ea39-4f16-b55c-c5ef4a4d8979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4446f9eb-1390-43f6-91b8-95099845c935 tempest-VolumeTypesAccessTest-1203422451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4f613eb-ea39-4f16-b55c-c5ef4a4d8979) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e84dfb6-9787-4f36-abdd-c869dc1bfafc', 'volume_name': 'volume-7e84dfb6-9787-4f36-abdd-c869dc1bfafc', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4446f9eb-1390-43f6-91b8-95099845c935 tempest-VolumeTypesAccessTest-1203422451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56d06bdc-c535-4879-833f-dadf3b4b687a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4446f9eb-1390-43f6-91b8-95099845c935 tempest-VolumeTypesAccessTest-1203422451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56d06bdc-c535-4879-833f-dadf3b4b687a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4446f9eb-1390-43f6-91b8-95099845c935 tempest-VolumeTypesAccessTest-1203422451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f36cd14c-8169-48c7-acb4-6787c628562c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:22 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-4446f9eb-1390-43f6-91b8-95099845c935 tempest-VolumeTypesAccessTest-1203422451 None] Volume 7e84dfb6-9787-4f36-abdd-c869dc1bfafc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e84dfb6-9787-4f36-abdd-c869dc1bfafc', 'volume_size': 1}
Jul 14 16:32:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-4446f9eb-1390-43f6-91b8-95099845c935 tempest-VolumeTypesAccessTest-1203422451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:32:22 devstack sudo[98039]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-c9ee6819-c14d-4835-ae5b-b09d9a0634a7 req-88264823-73b3-4b43-8064-2b3eeb92a7f5 tempest-TestServerVolumeAttachScenarioOldVersion-977879743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2302c49a-febd-400c-aebb-418076a199ad" returned: 0 in 0.381s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-c9ee6819-c14d-4835-ae5b-b09d9a0634a7 req-88264823-73b3-4b43-8064-2b3eeb92a7f5 tempest-TestServerVolumeAttachScenarioOldVersion-977879743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.408s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:32:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-4446f9eb-1390-43f6-91b8-95099845c935 tempest-VolumeTypesAccessTest-1203422451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:32:22 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-4446f9eb-1390-43f6-91b8-95099845c935 tempest-VolumeTypesAccessTest-1203422451 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:32:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-905384019',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e84dfb6-9787-4f36-abdd-c869dc1bfafc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='382354192c2c4a10b7503c4bdf6bd83c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:32:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:32:22Z,use_quota=True,user_id='27698fb0be2344a5a30fe30feeac1dd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ddcbd37-5beb-4f10-9a4b-41a5aa00ec97),volume_type_id=1ddcbd37-5beb-4f10-9a4b-41a5aa00ec97)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:32:22 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-4446f9eb-1390-43f6-91b8-95099845c935 tempest-VolumeTypesAccessTest-1203422451 None] Creating volume 7e84dfb6-9787-4f36-abdd-c869dc1bfafc {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:32:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-4446f9eb-1390-43f6-91b8-95099845c935 tempest-VolumeTypesAccessTest-1203422451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:32:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-4446f9eb-1390-43f6-91b8-95099845c935 tempest-VolumeTypesAccessTest-1203422451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:32:22 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-4446f9eb-1390-43f6-91b8-95099845c935 tempest-VolumeTypesAccessTest-1203422451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:32:22 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-4446f9eb-1390-43f6-91b8-95099845c935 tempest-VolumeTypesAccessTest-1203422451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:32:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-4446f9eb-1390-43f6-91b8-95099845c935 tempest-VolumeTypesAccessTest-1203422451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:32:22 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-4446f9eb-1390-43f6-91b8-95099845c935 tempest-VolumeTypesAccessTest-1203422451 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:32:22 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-4446f9eb-1390-43f6-91b8-95099845c935 tempest-VolumeTypesAccessTest-1203422451 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:32:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4446f9eb-1390-43f6-91b8-95099845c935 tempest-VolumeTypesAccessTest-1203422451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-7e84dfb6-9787-4f36-abdd-c869dc1bfafc 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6b313c72-67cb-4370-9319-09cc0e6e6d6e tempest-VolumesDeleteCascade-715576226 None] Lock "cinder-quobyte-47767d56-c1e5-4e73-a555-f2ff387981ff" acquired by "delete_snapshot" :: waited 0.093s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:32:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6b313c72-67cb-4370-9319-09cc0e6e6d6e tempest-VolumesDeleteCascade-715576226 None] Acquiring lock "cinder-quobyte-7dcbfe6e-1644-4c60-a20a-307473bd25e4" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:32:22 devstack sudo[98044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-7e84dfb6-9787-4f36-abdd-c869dc1bfafc 1073741824
Jul 14 16:32:22 devstack sudo[98044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6b313c72-67cb-4370-9319-09cc0e6e6d6e tempest-VolumesDeleteCascade-715576226 None] Lock "cinder-quobyte-7dcbfe6e-1644-4c60-a20a-307473bd25e4" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:32:22 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-6b313c72-67cb-4370-9319-09cc0e6e6d6e tempest-VolumesDeleteCascade-715576226 None] Deleting offline snapshot 7dcbfe6e-1644-4c60-a20a-307473bd25e4 of volume 47767d56-c1e5-4e73-a555-f2ff387981ff {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 16:32:22 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-6b313c72-67cb-4370-9319-09cc0e6e6d6e tempest-VolumesDeleteCascade-715576226 None] snapshot_file for this snap is: volume-47767d56-c1e5-4e73-a555-f2ff387981ff.7dcbfe6e-1644-4c60-a20a-307473bd25e4 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 16:32:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-c9ee6819-c14d-4835-ae5b-b09d9a0634a7 req-88264823-73b3-4b43-8064-2b3eeb92a7f5 tempest-TestServerVolumeAttachScenarioOldVersion-977879743 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052', 'name': 'volume-2302c49a-febd-400c-aebb-418076a199ad', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '30fee04a-e601-4757-8769-7bb0e38833d3', 'enforce_multipath': True} {{(pid=87166) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 14 16:32:22 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e136c13-e742-4a4c-8994-9806c9fa87b1]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:32:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6b313c72-67cb-4370-9319-09cc0e6e6d6e tempest-VolumesDeleteCascade-715576226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-47767d56-c1e5-4e73-a555-f2ff387981ff.7dcbfe6e-1644-4c60-a20a-307473bd25e4 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:22 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-c9ee6819-c14d-4835-ae5b-b09d9a0634a7 req-88264823-73b3-4b43-8064-2b3eeb92a7f5 tempest-TestServerVolumeAttachScenarioOldVersion-977879743 None] attachment_update completed successfully.
Jul 14 16:32:22 devstack sudo[98046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-47767d56-c1e5-4e73-a555-f2ff387981ff.7dcbfe6e-1644-4c60-a20a-307473bd25e4
Jul 14 16:32:22 devstack sudo[98046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:23 devstack sudo[98046]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6b313c72-67cb-4370-9319-09cc0e6e6d6e tempest-VolumesDeleteCascade-715576226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-47767d56-c1e5-4e73-a555-f2ff387981ff.7dcbfe6e-1644-4c60-a20a-307473bd25e4" returned: 0 in 0.482s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:23 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-6b313c72-67cb-4370-9319-09cc0e6e6d6e tempest-VolumesDeleteCascade-715576226 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47767d56-c1e5-4e73-a555-f2ff387981ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 16:32:23 devstack sudo[98044]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4446f9eb-1390-43f6-91b8-95099845c935 tempest-VolumeTypesAccessTest-1203422451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-7e84dfb6-9787-4f36-abdd-c869dc1bfafc 1073741824" returned: 0 in 0.602s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:23 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e7d3c36-cd6d-4509-9acc-ac7ac327a6f6]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:32:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6b313c72-67cb-4370-9319-09cc0e6e6d6e tempest-VolumesDeleteCascade-715576226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-47767d56-c1e5-4e73-a555-f2ff387981ff {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4446f9eb-1390-43f6-91b8-95099845c935 tempest-VolumeTypesAccessTest-1203422451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-7e84dfb6-9787-4f36-abdd-c869dc1bfafc {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:23 devstack sudo[98438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-7e84dfb6-9787-4f36-abdd-c869dc1bfafc
Jul 14 16:32:23 devstack sudo[98438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:23 devstack sudo[98436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-47767d56-c1e5-4e73-a555-f2ff387981ff
Jul 14 16:32:23 devstack sudo[98436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:23 devstack sudo[98438]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4446f9eb-1390-43f6-91b8-95099845c935 tempest-VolumeTypesAccessTest-1203422451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-7e84dfb6-9787-4f36-abdd-c869dc1bfafc" returned: 0 in 0.380s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:23 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-4446f9eb-1390-43f6-91b8-95099845c935 tempest-VolumeTypesAccessTest-1203422451 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:32:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-4446f9eb-1390-43f6-91b8-95099845c935 tempest-VolumeTypesAccessTest-1203422451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:32:23 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4446f9eb-1390-43f6-91b8-95099845c935 tempest-VolumeTypesAccessTest-1203422451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f36cd14c-8169-48c7-acb4-6787c628562c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e84dfb6-9787-4f36-abdd-c869dc1bfafc', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:23 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4446f9eb-1390-43f6-91b8-95099845c935 tempest-VolumeTypesAccessTest-1203422451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b26ebdc-946d-454f-b720-146854e83e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:23 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-4446f9eb-1390-43f6-91b8-95099845c935 tempest-VolumeTypesAccessTest-1203422451 None] Volume volume-7e84dfb6-9787-4f36-abdd-c869dc1bfafc (7e84dfb6-9787-4f36-abdd-c869dc1bfafc): created successfully
Jul 14 16:32:23 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4446f9eb-1390-43f6-91b8-95099845c935 tempest-VolumeTypesAccessTest-1203422451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b26ebdc-946d-454f-b720-146854e83e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:23 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4446f9eb-1390-43f6-91b8-95099845c935 tempest-VolumeTypesAccessTest-1203422451 None] Flow 'volume_create_manager' (7387ef51-40df-4861-8056-2197e83b4df8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:32:23 devstack sudo[98436]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:23 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-4446f9eb-1390-43f6-91b8-95099845c935 tempest-VolumeTypesAccessTest-1203422451 None] Created volume successfully.
Jul 14 16:32:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6b313c72-67cb-4370-9319-09cc0e6e6d6e tempest-VolumesDeleteCascade-715576226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-47767d56-c1e5-4e73-a555-f2ff387981ff" returned: 0 in 0.531s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6b313c72-67cb-4370-9319-09cc0e6e6d6e tempest-VolumesDeleteCascade-715576226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-47767d56-c1e5-4e73-a555-f2ff387981ff.7dcbfe6e-1644-4c60-a20a-307473bd25e4 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:23 devstack sudo[98445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-47767d56-c1e5-4e73-a555-f2ff387981ff.7dcbfe6e-1644-4c60-a20a-307473bd25e4
Jul 14 16:32:23 devstack sudo[98445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:24 devstack sudo[98445]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6b313c72-67cb-4370-9319-09cc0e6e6d6e tempest-VolumesDeleteCascade-715576226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-47767d56-c1e5-4e73-a555-f2ff387981ff.7dcbfe6e-1644-4c60-a20a-307473bd25e4" returned: 0 in 0.405s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6b313c72-67cb-4370-9319-09cc0e6e6d6e tempest-VolumesDeleteCascade-715576226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-47767d56-c1e5-4e73-a555-f2ff387981ff.7dcbfe6e-1644-4c60-a20a-307473bd25e4 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:24 devstack sudo[98450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-47767d56-c1e5-4e73-a555-f2ff387981ff.7dcbfe6e-1644-4c60-a20a-307473bd25e4
Jul 14 16:32:24 devstack sudo[98450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:24 devstack sudo[98450]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6b313c72-67cb-4370-9319-09cc0e6e6d6e tempest-VolumesDeleteCascade-715576226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-47767d56-c1e5-4e73-a555-f2ff387981ff.7dcbfe6e-1644-4c60-a20a-307473bd25e4" returned: 0 in 0.276s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:24 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6b313c72-67cb-4370-9319-09cc0e6e6d6e tempest-VolumesDeleteCascade-715576226 None] Lock "cinder-quobyte-7dcbfe6e-1644-4c60-a20a-307473bd25e4" released by "_delete_snapshot" :: held 1.814s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:32:24 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6b313c72-67cb-4370-9319-09cc0e6e6d6e tempest-VolumesDeleteCascade-715576226 None] Lock "cinder-quobyte-47767d56-c1e5-4e73-a555-f2ff387981ff" released by "delete_snapshot" :: held 1.851s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:32:24 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-6b313c72-67cb-4370-9319-09cc0e6e6d6e tempest-VolumesDeleteCascade-715576226 None] Created reservations ['da757caf-3999-4c1a-b8b6-018c664cda61', '078507d3-9f05-456f-9878-bdf6704b63a6', '5c532770-1325-4e08-88c3-331cadae78b0', '0d6c4e36-5a26-4752-99d8-99b11fd4dd96'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:32:24 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-6b313c72-67cb-4370-9319-09cc0e6e6d6e tempest-VolumesDeleteCascade-715576226 None] Delete snapshot completed successfully.
Jul 14 16:32:24 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6b313c72-67cb-4370-9319-09cc0e6e6d6e tempest-VolumesDeleteCascade-715576226 None] Lock "cinder-7dcbfe6e-1644-4c60-a20a-307473bd25e4-delete_snapshot" released by "delete_snapshot" :: held 2.134s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:32:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6b313c72-67cb-4370-9319-09cc0e6e6d6e tempest-VolumesDeleteCascade-715576226 None] Snapshots deleted, issuing volume delete {{(pid=87166) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Jul 14 16:32:24 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6b313c72-67cb-4370-9319-09cc0e6e6d6e tempest-VolumesDeleteCascade-715576226 None] Acquiring lock "cinder-quobyte-47767d56-c1e5-4e73-a555-f2ff387981ff" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:32:24 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6b313c72-67cb-4370-9319-09cc0e6e6d6e tempest-VolumesDeleteCascade-715576226 None] Lock "cinder-quobyte-47767d56-c1e5-4e73-a555-f2ff387981ff" acquired by "delete_volume" :: waited 0.016s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:32:24 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba5bf52-4e89-4ff5-93ff-5c942fe9126a]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:32:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6b313c72-67cb-4370-9319-09cc0e6e6d6e tempest-VolumesDeleteCascade-715576226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-47767d56-c1e5-4e73-a555-f2ff387981ff {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:24 devstack sudo[98453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-47767d56-c1e5-4e73-a555-f2ff387981ff
Jul 14 16:32:24 devstack sudo[98453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:24 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-fd4f9265-e7be-4430-bf40-ba632a985c60 tempest-VolumeTypesAccessTest-1203422451 None] Acquiring lock "cinder-7e84dfb6-9787-4f36-abdd-c869dc1bfafc-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:32:24 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-fd4f9265-e7be-4430-bf40-ba632a985c60 tempest-VolumeTypesAccessTest-1203422451 None] Lock "cinder-7e84dfb6-9787-4f36-abdd-c869dc1bfafc-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:32:24 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-fd4f9265-e7be-4430-bf40-ba632a985c60 tempest-VolumeTypesAccessTest-1203422451 None] Acquiring lock "cinder-quobyte-7e84dfb6-9787-4f36-abdd-c869dc1bfafc" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:32:24 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-fd4f9265-e7be-4430-bf40-ba632a985c60 tempest-VolumeTypesAccessTest-1203422451 None] Lock "cinder-quobyte-7e84dfb6-9787-4f36-abdd-c869dc1bfafc" acquired by "delete_volume" :: waited 0.027s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:32:25 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a1ef8d-3258-402e-b140-e1550de3db3b]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:32:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fd4f9265-e7be-4430-bf40-ba632a985c60 tempest-VolumeTypesAccessTest-1203422451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-7e84dfb6-9787-4f36-abdd-c869dc1bfafc {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:25 devstack sudo[98455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-7e84dfb6-9787-4f36-abdd-c869dc1bfafc
Jul 14 16:32:25 devstack sudo[98455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:25 devstack sudo[98453]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6b313c72-67cb-4370-9319-09cc0e6e6d6e tempest-VolumesDeleteCascade-715576226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-47767d56-c1e5-4e73-a555-f2ff387981ff" returned: 0 in 0.505s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6b313c72-67cb-4370-9319-09cc0e6e6d6e tempest-VolumesDeleteCascade-715576226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-47767d56-c1e5-4e73-a555-f2ff387981ff {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:25 devstack sudo[98460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-47767d56-c1e5-4e73-a555-f2ff387981ff
Jul 14 16:32:25 devstack sudo[98460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:25 devstack sudo[98455]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fd4f9265-e7be-4430-bf40-ba632a985c60 tempest-VolumeTypesAccessTest-1203422451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-7e84dfb6-9787-4f36-abdd-c869dc1bfafc" returned: 0 in 0.468s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fd4f9265-e7be-4430-bf40-ba632a985c60 tempest-VolumeTypesAccessTest-1203422451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-7e84dfb6-9787-4f36-abdd-c869dc1bfafc {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:25 devstack sudo[98468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-7e84dfb6-9787-4f36-abdd-c869dc1bfafc
Jul 14 16:32:25 devstack sudo[98468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:25 devstack sudo[98460]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6b313c72-67cb-4370-9319-09cc0e6e6d6e tempest-VolumesDeleteCascade-715576226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-47767d56-c1e5-4e73-a555-f2ff387981ff" returned: 0 in 0.348s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:25 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6b313c72-67cb-4370-9319-09cc0e6e6d6e tempest-VolumesDeleteCascade-715576226 None] Lock "cinder-quobyte-47767d56-c1e5-4e73-a555-f2ff387981ff" released by "delete_volume" :: held 0.950s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:32:25 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-6bcdc01a-96e5-4b40-a413-2751f073728d req-5c1a8091-ad6e-4e87-96cd-5bda81ea49b7 tempest-TestServerVolumeAttachScenarioOldVersion-977879743 None] Terminate volume connection completed successfully.
Jul 14 16:32:25 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-6bcdc01a-96e5-4b40-a413-2751f073728d req-5c1a8091-ad6e-4e87-96cd-5bda81ea49b7 tempest-TestServerVolumeAttachScenarioOldVersion-977879743 None] Deleting attachment 30fee04a-e601-4757-8769-7bb0e38833d3. {{(pid=87166) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 14 16:32:25 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-6b313c72-67cb-4370-9319-09cc0e6e6d6e tempest-VolumesDeleteCascade-715576226 None] Created reservations ['bf85b1f2-7345-477f-b0fb-cbd8edbf1407', '5731217d-c8da-49de-ab01-9939546d5723', 'de4f10b4-76f7-4999-b249-e04d1d061c41', 'd4234785-69e3-405f-bf80-556b9863d222'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:32:25 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-55170d13-f1a1-445a-b8b7-1555a425b119 tempest-VolumesListTestJSON-1424316819 None] Acquiring lock "cinder-cea3ec1f-9042-40db-ac50-9b81d912dfed-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:32:25 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-55170d13-f1a1-445a-b8b7-1555a425b119 tempest-VolumesListTestJSON-1424316819 None] Lock "cinder-cea3ec1f-9042-40db-ac50-9b81d912dfed-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:32:25 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-55170d13-f1a1-445a-b8b7-1555a425b119 tempest-VolumesListTestJSON-1424316819 None] Acquiring lock "cinder-quobyte-cea3ec1f-9042-40db-ac50-9b81d912dfed" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:32:25 devstack sudo[98468]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fd4f9265-e7be-4430-bf40-ba632a985c60 tempest-VolumeTypesAccessTest-1203422451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-7e84dfb6-9787-4f36-abdd-c869dc1bfafc" returned: 0 in 0.333s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:25 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-55170d13-f1a1-445a-b8b7-1555a425b119 tempest-VolumesListTestJSON-1424316819 None] Lock "cinder-quobyte-cea3ec1f-9042-40db-ac50-9b81d912dfed" acquired by "delete_volume" :: waited 0.044s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:32:25 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-fd4f9265-e7be-4430-bf40-ba632a985c60 tempest-VolumeTypesAccessTest-1203422451 None] Lock "cinder-quobyte-7e84dfb6-9787-4f36-abdd-c869dc1bfafc" released by "delete_volume" :: held 0.893s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:32:25 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b99e36f-48b1-4ebe-a958-f6b9e086915e]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:32:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-55170d13-f1a1-445a-b8b7-1555a425b119 tempest-VolumesListTestJSON-1424316819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cea3ec1f-9042-40db-ac50-9b81d912dfed {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6b313c72-67cb-4370-9319-09cc0e6e6d6e tempest-VolumesDeleteCascade-715576226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:32:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6b313c72-67cb-4370-9319-09cc0e6e6d6e tempest-VolumesDeleteCascade-715576226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:32:25 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6b313c72-67cb-4370-9319-09cc0e6e6d6e tempest-VolumesDeleteCascade-715576226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:32:25 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6b313c72-67cb-4370-9319-09cc0e6e6d6e tempest-VolumesDeleteCascade-715576226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:32:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6b313c72-67cb-4370-9319-09cc0e6e6d6e tempest-VolumesDeleteCascade-715576226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:32:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6b313c72-67cb-4370-9319-09cc0e6e6d6e tempest-VolumesDeleteCascade-715576226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:25 devstack cinder-volume[87166]: WARNING cinder.quota [None req-fd4f9265-e7be-4430-bf40-ba632a985c60 tempest-VolumeTypesAccessTest-1203422451 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-643770282 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-643770282, it is now deprecated. Please use the default quota class for default quota.
Jul 14 16:32:25 devstack cinder-volume[87166]: WARNING cinder.quota [None req-fd4f9265-e7be-4430-bf40-ba632a985c60 tempest-VolumeTypesAccessTest-1203422451 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-643770282 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-643770282, it is now deprecated. Please use the default quota class for default quota.
Jul 14 16:32:25 devstack sudo[98499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:32:25 devstack sudo[98499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:26 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-fd4f9265-e7be-4430-bf40-ba632a985c60 tempest-VolumeTypesAccessTest-1203422451 None] Created reservations ['08695f6e-22ac-47bb-90e3-0715dfe35192', '177d3139-211d-4141-8bf5-6e893314cc27', 'c2ab23ca-4539-4750-a649-a2af3ddb7ec1', '8cb606ac-dc47-4e4a-b6ed-70a602b2edd2'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:32:26 devstack sudo[98498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cea3ec1f-9042-40db-ac50-9b81d912dfed
Jul 14 16:32:26 devstack sudo[98498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-fd4f9265-e7be-4430-bf40-ba632a985c60 tempest-VolumeTypesAccessTest-1203422451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:32:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-fd4f9265-e7be-4430-bf40-ba632a985c60 tempest-VolumeTypesAccessTest-1203422451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:32:26 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-fd4f9265-e7be-4430-bf40-ba632a985c60 tempest-VolumeTypesAccessTest-1203422451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:32:26 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-fd4f9265-e7be-4430-bf40-ba632a985c60 tempest-VolumeTypesAccessTest-1203422451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:32:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-fd4f9265-e7be-4430-bf40-ba632a985c60 tempest-VolumeTypesAccessTest-1203422451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:32:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fd4f9265-e7be-4430-bf40-ba632a985c60 tempest-VolumeTypesAccessTest-1203422451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:26 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-46a3b661-1aad-4072-b99b-7b7b18b4ce1b tempest-VolumesDeleteCascade-715576226 None] Acquiring lock "cinder-68f3e076-14fd-496a-90f8-da67ec6db8ed-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:32:26 devstack sudo[98502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:32:26 devstack sudo[98502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:26 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-46a3b661-1aad-4072-b99b-7b7b18b4ce1b tempest-VolumesDeleteCascade-715576226 None] Lock "cinder-68f3e076-14fd-496a-90f8-da67ec6db8ed-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:32:26 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-46a3b661-1aad-4072-b99b-7b7b18b4ce1b tempest-VolumesDeleteCascade-715576226 None] Acquiring lock "cinder-quobyte-68f3e076-14fd-496a-90f8-da67ec6db8ed" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:32:26 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-46a3b661-1aad-4072-b99b-7b7b18b4ce1b tempest-VolumesDeleteCascade-715576226 None] Lock "cinder-quobyte-68f3e076-14fd-496a-90f8-da67ec6db8ed" acquired by "delete_volume" :: waited 0.015s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:32:26 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b11c6b-90c7-4a69-be2b-a1f0b82836aa]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:32:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-46a3b661-1aad-4072-b99b-7b7b18b4ce1b tempest-VolumesDeleteCascade-715576226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-68f3e076-14fd-496a-90f8-da67ec6db8ed {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:26 devstack sudo[98499]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6b313c72-67cb-4370-9319-09cc0e6e6d6e tempest-VolumesDeleteCascade-715576226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.413s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:26 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-6b313c72-67cb-4370-9319-09cc0e6e6d6e tempest-VolumesDeleteCascade-715576226 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:32:26 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-6b313c72-67cb-4370-9319-09cc0e6e6d6e tempest-VolumesDeleteCascade-715576226 None] Deleted volume successfully.
Jul 14 16:32:26 devstack sudo[98498]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:26 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6b313c72-67cb-4370-9319-09cc0e6e6d6e tempest-VolumesDeleteCascade-715576226 None] Lock "cinder-47767d56-c1e5-4e73-a555-f2ff387981ff-delete_volume" released by "delete_volume" :: held 4.042s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:32:26 devstack sudo[98504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-68f3e076-14fd-496a-90f8-da67ec6db8ed
Jul 14 16:32:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-55170d13-f1a1-445a-b8b7-1555a425b119 tempest-VolumesListTestJSON-1424316819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cea3ec1f-9042-40db-ac50-9b81d912dfed" returned: 0 in 0.527s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-55170d13-f1a1-445a-b8b7-1555a425b119 tempest-VolumesListTestJSON-1424316819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cea3ec1f-9042-40db-ac50-9b81d912dfed {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:26 devstack sudo[98504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:26 devstack sudo[98511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cea3ec1f-9042-40db-ac50-9b81d912dfed
Jul 14 16:32:26 devstack sudo[98511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:26 devstack sudo[98502]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fd4f9265-e7be-4430-bf40-ba632a985c60 tempest-VolumeTypesAccessTest-1203422451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.374s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:26 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-fd4f9265-e7be-4430-bf40-ba632a985c60 tempest-VolumeTypesAccessTest-1203422451 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:32:26 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-fd4f9265-e7be-4430-bf40-ba632a985c60 tempest-VolumeTypesAccessTest-1203422451 None] Deleted volume successfully.
Jul 14 16:32:26 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-fd4f9265-e7be-4430-bf40-ba632a985c60 tempest-VolumeTypesAccessTest-1203422451 None] Lock "cinder-7e84dfb6-9787-4f36-abdd-c869dc1bfafc-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:32:26 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a3414f95-c051-4e27-9447-9a5b85dabc66 tempest-TestServerVolumeAttachScenarioOldVersion-977879743 None] Acquiring lock "cinder-2302c49a-febd-400c-aebb-418076a199ad-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:32:26 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a3414f95-c051-4e27-9447-9a5b85dabc66 tempest-TestServerVolumeAttachScenarioOldVersion-977879743 None] Lock "cinder-2302c49a-febd-400c-aebb-418076a199ad-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:32:26 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a3414f95-c051-4e27-9447-9a5b85dabc66 tempest-TestServerVolumeAttachScenarioOldVersion-977879743 None] Acquiring lock "cinder-quobyte-2302c49a-febd-400c-aebb-418076a199ad" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:32:26 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a3414f95-c051-4e27-9447-9a5b85dabc66 tempest-TestServerVolumeAttachScenarioOldVersion-977879743 None] Lock "cinder-quobyte-2302c49a-febd-400c-aebb-418076a199ad" acquired by "delete_volume" :: waited 0.020s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:32:26 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b474c6-efcb-479e-b6c3-fe54b22511e3]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:32:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a3414f95-c051-4e27-9447-9a5b85dabc66 tempest-TestServerVolumeAttachScenarioOldVersion-977879743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2302c49a-febd-400c-aebb-418076a199ad {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:26 devstack sudo[98511]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-55170d13-f1a1-445a-b8b7-1555a425b119 tempest-VolumesListTestJSON-1424316819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cea3ec1f-9042-40db-ac50-9b81d912dfed" returned: 0 in 0.308s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:26 devstack sudo[98504]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-46a3b661-1aad-4072-b99b-7b7b18b4ce1b tempest-VolumesDeleteCascade-715576226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-68f3e076-14fd-496a-90f8-da67ec6db8ed" returned: 0 in 0.483s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-46a3b661-1aad-4072-b99b-7b7b18b4ce1b tempest-VolumesDeleteCascade-715576226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-68f3e076-14fd-496a-90f8-da67ec6db8ed {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:26 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-55170d13-f1a1-445a-b8b7-1555a425b119 tempest-VolumesListTestJSON-1424316819 None] Lock "cinder-quobyte-cea3ec1f-9042-40db-ac50-9b81d912dfed" released by "delete_volume" :: held 0.902s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:32:26 devstack sudo[98519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-68f3e076-14fd-496a-90f8-da67ec6db8ed
Jul 14 16:32:26 devstack sudo[98519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:26 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-55170d13-f1a1-445a-b8b7-1555a425b119 tempest-VolumesListTestJSON-1424316819 None] Created reservations ['b4ee4200-61c5-4faa-99b2-e76768413e97', '9af04e71-f072-49dc-872e-d4de0cefd1c9', 'e155ffa4-b8ad-49bb-b89d-b64f707e1135', 'd7189d98-52be-4dd8-b154-ba252b54dfc0'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:32:26 devstack sudo[98518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2302c49a-febd-400c-aebb-418076a199ad
Jul 14 16:32:26 devstack sudo[98518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-55170d13-f1a1-445a-b8b7-1555a425b119 tempest-VolumesListTestJSON-1424316819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:32:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-55170d13-f1a1-445a-b8b7-1555a425b119 tempest-VolumesListTestJSON-1424316819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:32:26 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-55170d13-f1a1-445a-b8b7-1555a425b119 tempest-VolumesListTestJSON-1424316819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:32:26 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-55170d13-f1a1-445a-b8b7-1555a425b119 tempest-VolumesListTestJSON-1424316819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:32:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-55170d13-f1a1-445a-b8b7-1555a425b119 tempest-VolumesListTestJSON-1424316819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:32:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-55170d13-f1a1-445a-b8b7-1555a425b119 tempest-VolumesListTestJSON-1424316819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:26 devstack sudo[98522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:32:26 devstack sudo[98522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:27 devstack sudo[98519]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-46a3b661-1aad-4072-b99b-7b7b18b4ce1b tempest-VolumesDeleteCascade-715576226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-68f3e076-14fd-496a-90f8-da67ec6db8ed" returned: 0 in 0.305s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:27 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-46a3b661-1aad-4072-b99b-7b7b18b4ce1b tempest-VolumesDeleteCascade-715576226 None] Lock "cinder-quobyte-68f3e076-14fd-496a-90f8-da67ec6db8ed" released by "delete_volume" :: held 0.840s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:32:27 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6d0bb8fc-8161-4141-91b7-e18fce1f3f7b tempest-VolumesListTestJSON-1424316819 None] Acquiring lock "cinder-52a34ac0-10b1-4eb2-b7a6-913d5969fac7-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:32:27 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6d0bb8fc-8161-4141-91b7-e18fce1f3f7b tempest-VolumesListTestJSON-1424316819 None] Lock "cinder-52a34ac0-10b1-4eb2-b7a6-913d5969fac7-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:32:27 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-46a3b661-1aad-4072-b99b-7b7b18b4ce1b tempest-VolumesDeleteCascade-715576226 None] Created reservations ['9560ec21-45fd-49a1-b79b-5ae491ba41b2', 'b8256f69-ddf1-47e5-8a65-04a8260972b5', 'f59342e3-bcc3-4b94-bfc5-76a7649c59a0', '06f03768-1b8a-4ae6-b370-a0764233ec42'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:32:27 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6d0bb8fc-8161-4141-91b7-e18fce1f3f7b tempest-VolumesListTestJSON-1424316819 None] Acquiring lock "cinder-quobyte-52a34ac0-10b1-4eb2-b7a6-913d5969fac7" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:32:27 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6d0bb8fc-8161-4141-91b7-e18fce1f3f7b tempest-VolumesListTestJSON-1424316819 None] Lock "cinder-quobyte-52a34ac0-10b1-4eb2-b7a6-913d5969fac7" acquired by "delete_volume" :: waited 0.029s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:32:27 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[4128b02b-4a92-4bd8-9e08-1de8516c4e80]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:32:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6d0bb8fc-8161-4141-91b7-e18fce1f3f7b tempest-VolumesListTestJSON-1424316819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-52a34ac0-10b1-4eb2-b7a6-913d5969fac7 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:27 devstack sudo[98522]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-55170d13-f1a1-445a-b8b7-1555a425b119 tempest-VolumesListTestJSON-1424316819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.342s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:27 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-55170d13-f1a1-445a-b8b7-1555a425b119 tempest-VolumesListTestJSON-1424316819 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:32:27 devstack sudo[98518]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:27 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-55170d13-f1a1-445a-b8b7-1555a425b119 tempest-VolumesListTestJSON-1424316819 None] Deleted volume successfully.
Jul 14 16:32:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a3414f95-c051-4e27-9447-9a5b85dabc66 tempest-TestServerVolumeAttachScenarioOldVersion-977879743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2302c49a-febd-400c-aebb-418076a199ad" returned: 0 in 0.572s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a3414f95-c051-4e27-9447-9a5b85dabc66 tempest-TestServerVolumeAttachScenarioOldVersion-977879743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2302c49a-febd-400c-aebb-418076a199ad {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:27 devstack sudo[98530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2302c49a-febd-400c-aebb-418076a199ad
Jul 14 16:32:27 devstack sudo[98530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:27 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-55170d13-f1a1-445a-b8b7-1555a425b119 tempest-VolumesListTestJSON-1424316819 None] Lock "cinder-cea3ec1f-9042-40db-ac50-9b81d912dfed-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:32:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-46a3b661-1aad-4072-b99b-7b7b18b4ce1b tempest-VolumesDeleteCascade-715576226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:32:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-46a3b661-1aad-4072-b99b-7b7b18b4ce1b tempest-VolumesDeleteCascade-715576226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:32:27 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-46a3b661-1aad-4072-b99b-7b7b18b4ce1b tempest-VolumesDeleteCascade-715576226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:32:27 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-46a3b661-1aad-4072-b99b-7b7b18b4ce1b tempest-VolumesDeleteCascade-715576226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:32:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-46a3b661-1aad-4072-b99b-7b7b18b4ce1b tempest-VolumesDeleteCascade-715576226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:32:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-46a3b661-1aad-4072-b99b-7b7b18b4ce1b tempest-VolumesDeleteCascade-715576226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:27 devstack sudo[98529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-52a34ac0-10b1-4eb2-b7a6-913d5969fac7
Jul 14 16:32:27 devstack sudo[98529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:27 devstack sudo[98532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:32:27 devstack sudo[98532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:27 devstack sudo[98530]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a3414f95-c051-4e27-9447-9a5b85dabc66 tempest-TestServerVolumeAttachScenarioOldVersion-977879743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2302c49a-febd-400c-aebb-418076a199ad" returned: 0 in 0.383s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:27 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a3414f95-c051-4e27-9447-9a5b85dabc66 tempest-TestServerVolumeAttachScenarioOldVersion-977879743 None] Lock "cinder-quobyte-2302c49a-febd-400c-aebb-418076a199ad" released by "delete_volume" :: held 1.013s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:32:27 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-a3414f95-c051-4e27-9447-9a5b85dabc66 tempest-TestServerVolumeAttachScenarioOldVersion-977879743 None] Created reservations ['9c11b571-fdfa-4a00-a299-0fba69e9d742', 'e76f6608-8265-4032-acae-09f735e201a5', '630a093c-5c4a-4ba4-a7a5-e6cace1fc078', 'd7b53df7-9cbd-4f3a-a44c-bb4231b5c1d1'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:32:27 devstack sudo[98529]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6d0bb8fc-8161-4141-91b7-e18fce1f3f7b tempest-VolumesListTestJSON-1424316819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-52a34ac0-10b1-4eb2-b7a6-913d5969fac7" returned: 0 in 0.587s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6d0bb8fc-8161-4141-91b7-e18fce1f3f7b tempest-VolumesListTestJSON-1424316819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-52a34ac0-10b1-4eb2-b7a6-913d5969fac7 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a3414f95-c051-4e27-9447-9a5b85dabc66 tempest-TestServerVolumeAttachScenarioOldVersion-977879743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:32:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a3414f95-c051-4e27-9447-9a5b85dabc66 tempest-TestServerVolumeAttachScenarioOldVersion-977879743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:32:27 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a3414f95-c051-4e27-9447-9a5b85dabc66 tempest-TestServerVolumeAttachScenarioOldVersion-977879743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:32:27 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a3414f95-c051-4e27-9447-9a5b85dabc66 tempest-TestServerVolumeAttachScenarioOldVersion-977879743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:32:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a3414f95-c051-4e27-9447-9a5b85dabc66 tempest-TestServerVolumeAttachScenarioOldVersion-977879743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:32:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a3414f95-c051-4e27-9447-9a5b85dabc66 tempest-TestServerVolumeAttachScenarioOldVersion-977879743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:27 devstack sudo[98532]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:27 devstack sudo[98541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-52a34ac0-10b1-4eb2-b7a6-913d5969fac7
Jul 14 16:32:27 devstack sudo[98541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-46a3b661-1aad-4072-b99b-7b7b18b4ce1b tempest-VolumesDeleteCascade-715576226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.491s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:27 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-46a3b661-1aad-4072-b99b-7b7b18b4ce1b tempest-VolumesDeleteCascade-715576226 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:32:27 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-46a3b661-1aad-4072-b99b-7b7b18b4ce1b tempest-VolumesDeleteCascade-715576226 None] Deleted volume successfully.
Jul 14 16:32:27 devstack sudo[98542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:32:27 devstack sudo[98542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:27 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-46a3b661-1aad-4072-b99b-7b7b18b4ce1b tempest-VolumesDeleteCascade-715576226 None] Lock "cinder-68f3e076-14fd-496a-90f8-da67ec6db8ed-delete_volume" released by "delete_volume" :: held 1.771s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:32:28 devstack sudo[98542]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a3414f95-c051-4e27-9447-9a5b85dabc66 tempest-TestServerVolumeAttachScenarioOldVersion-977879743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.305s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:28 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-a3414f95-c051-4e27-9447-9a5b85dabc66 tempest-TestServerVolumeAttachScenarioOldVersion-977879743 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:32:28 devstack sudo[98541]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:28 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-a3414f95-c051-4e27-9447-9a5b85dabc66 tempest-TestServerVolumeAttachScenarioOldVersion-977879743 None] Deleted volume successfully.
Jul 14 16:32:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6d0bb8fc-8161-4141-91b7-e18fce1f3f7b tempest-VolumesListTestJSON-1424316819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-52a34ac0-10b1-4eb2-b7a6-913d5969fac7" returned: 0 in 0.354s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:28 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6d0bb8fc-8161-4141-91b7-e18fce1f3f7b tempest-VolumesListTestJSON-1424316819 None] Lock "cinder-quobyte-52a34ac0-10b1-4eb2-b7a6-913d5969fac7" released by "delete_volume" :: held 1.013s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:32:28 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a3414f95-c051-4e27-9447-9a5b85dabc66 tempest-TestServerVolumeAttachScenarioOldVersion-977879743 None] Lock "cinder-2302c49a-febd-400c-aebb-418076a199ad-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:32:28 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-6d0bb8fc-8161-4141-91b7-e18fce1f3f7b tempest-VolumesListTestJSON-1424316819 None] Created reservations ['c1d86c4a-36ae-4b8a-8c08-bdb8cfaae198', 'eccfeddc-4c79-40f7-9df4-3e9e440f2f2e', '037e5d8c-0993-41d0-b6fa-ba41e3e3c18b', '21898b8e-e1b0-4756-a093-82e48b4a3e78'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:32:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6d0bb8fc-8161-4141-91b7-e18fce1f3f7b tempest-VolumesListTestJSON-1424316819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:32:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6d0bb8fc-8161-4141-91b7-e18fce1f3f7b tempest-VolumesListTestJSON-1424316819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:32:28 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6d0bb8fc-8161-4141-91b7-e18fce1f3f7b tempest-VolumesListTestJSON-1424316819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:32:28 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6d0bb8fc-8161-4141-91b7-e18fce1f3f7b tempest-VolumesListTestJSON-1424316819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:32:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6d0bb8fc-8161-4141-91b7-e18fce1f3f7b tempest-VolumesListTestJSON-1424316819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:32:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6d0bb8fc-8161-4141-91b7-e18fce1f3f7b tempest-VolumesListTestJSON-1424316819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:28 devstack sudo[98547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:32:28 devstack sudo[98547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:28 devstack sudo[98547]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6d0bb8fc-8161-4141-91b7-e18fce1f3f7b tempest-VolumesListTestJSON-1424316819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.270s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:28 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-6d0bb8fc-8161-4141-91b7-e18fce1f3f7b tempest-VolumesListTestJSON-1424316819 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:32:28 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-6d0bb8fc-8161-4141-91b7-e18fce1f3f7b tempest-VolumesListTestJSON-1424316819 None] Deleted volume successfully.
Jul 14 16:32:28 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6d0bb8fc-8161-4141-91b7-e18fce1f3f7b tempest-VolumesListTestJSON-1424316819 None] Lock "cinder-52a34ac0-10b1-4eb2-b7a6-913d5969fac7-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:32:29 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d5349a0b-9ceb-475a-8cea-f5ec5f0aa8f9 tempest-VolumesListTestJSON-1424316819 None] Acquiring lock "cinder-f5910666-7a7e-45f7-85d7-48517e69042a-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:32:29 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d5349a0b-9ceb-475a-8cea-f5ec5f0aa8f9 tempest-VolumesListTestJSON-1424316819 None] Lock "cinder-f5910666-7a7e-45f7-85d7-48517e69042a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:32:29 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d5349a0b-9ceb-475a-8cea-f5ec5f0aa8f9 tempest-VolumesListTestJSON-1424316819 None] Acquiring lock "cinder-quobyte-f5910666-7a7e-45f7-85d7-48517e69042a" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:32:29 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d5349a0b-9ceb-475a-8cea-f5ec5f0aa8f9 tempest-VolumesListTestJSON-1424316819 None] Lock "cinder-quobyte-f5910666-7a7e-45f7-85d7-48517e69042a" acquired by "delete_volume" :: waited 0.028s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:32:29 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5adec9-df70-47bf-a469-173d14f3cd14]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:32:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d5349a0b-9ceb-475a-8cea-f5ec5f0aa8f9 tempest-VolumesListTestJSON-1424316819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f5910666-7a7e-45f7-85d7-48517e69042a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:29 devstack sudo[98569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f5910666-7a7e-45f7-85d7-48517e69042a
Jul 14 16:32:29 devstack sudo[98569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:30 devstack sudo[98569]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d5349a0b-9ceb-475a-8cea-f5ec5f0aa8f9 tempest-VolumesListTestJSON-1424316819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f5910666-7a7e-45f7-85d7-48517e69042a" returned: 0 in 0.460s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d5349a0b-9ceb-475a-8cea-f5ec5f0aa8f9 tempest-VolumesListTestJSON-1424316819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f5910666-7a7e-45f7-85d7-48517e69042a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:30 devstack sudo[98579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f5910666-7a7e-45f7-85d7-48517e69042a
Jul 14 16:32:30 devstack sudo[98579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:30 devstack sudo[98579]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d5349a0b-9ceb-475a-8cea-f5ec5f0aa8f9 tempest-VolumesListTestJSON-1424316819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f5910666-7a7e-45f7-85d7-48517e69042a" returned: 0 in 0.387s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:30 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d5349a0b-9ceb-475a-8cea-f5ec5f0aa8f9 tempest-VolumesListTestJSON-1424316819 None] Lock "cinder-quobyte-f5910666-7a7e-45f7-85d7-48517e69042a" released by "delete_volume" :: held 0.933s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:32:30 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-d5349a0b-9ceb-475a-8cea-f5ec5f0aa8f9 tempest-VolumesListTestJSON-1424316819 None] Created reservations ['4f826271-6610-48c4-a736-08c4ab94deec', 'bcab9138-775a-42a3-a86b-f37608575714', 'e19d8463-ae0e-4bfb-bd22-53e57cf8c330', 'a8f3a030-e4ed-45b3-a624-eb1df5620397'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:32:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d5349a0b-9ceb-475a-8cea-f5ec5f0aa8f9 tempest-VolumesListTestJSON-1424316819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:32:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d5349a0b-9ceb-475a-8cea-f5ec5f0aa8f9 tempest-VolumesListTestJSON-1424316819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:32:30 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d5349a0b-9ceb-475a-8cea-f5ec5f0aa8f9 tempest-VolumesListTestJSON-1424316819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:32:30 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d5349a0b-9ceb-475a-8cea-f5ec5f0aa8f9 tempest-VolumesListTestJSON-1424316819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:32:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d5349a0b-9ceb-475a-8cea-f5ec5f0aa8f9 tempest-VolumesListTestJSON-1424316819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:32:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d5349a0b-9ceb-475a-8cea-f5ec5f0aa8f9 tempest-VolumesListTestJSON-1424316819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:30 devstack sudo[98584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:32:30 devstack sudo[98584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:31 devstack sudo[98584]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d5349a0b-9ceb-475a-8cea-f5ec5f0aa8f9 tempest-VolumesListTestJSON-1424316819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.372s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:31 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-d5349a0b-9ceb-475a-8cea-f5ec5f0aa8f9 tempest-VolumesListTestJSON-1424316819 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:32:31 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-d5349a0b-9ceb-475a-8cea-f5ec5f0aa8f9 tempest-VolumesListTestJSON-1424316819 None] Deleted volume successfully.
Jul 14 16:32:31 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d5349a0b-9ceb-475a-8cea-f5ec5f0aa8f9 tempest-VolumesListTestJSON-1424316819 None] Lock "cinder-f5910666-7a7e-45f7-85d7-48517e69042a-delete_volume" released by "delete_volume" :: held 1.711s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:32:34 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f4c9cf4-f4ac-42a9-91b2-966229993864 tempest-VolumesTransfersTest-1473749471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:32:34 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2f4c9cf4-f4ac-42a9-91b2-966229993864 tempest-VolumesTransfersTest-1473749471 None] Flow 'volume_create_manager' (90309675-a34f-4239-8ebc-e1e0b4ac3906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:32:34 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2f4c9cf4-f4ac-42a9-91b2-966229993864 tempest-VolumesTransfersTest-1473749471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d12ee2a9-f175-4e27-8f19-bc6bf8e142ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:34 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2f4c9cf4-f4ac-42a9-91b2-966229993864 tempest-VolumesTransfersTest-1473749471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d12ee2a9-f175-4e27-8f19-bc6bf8e142ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:32:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1739531335',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=112ce53f-a96a-4027-b773-bb56bbd65900,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fa475560ec44d2aabaaffb0e1c3158f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:32:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:32:34Z,use_quota=True,user_id='79109bbbd18a4bc580e716f8bb817f88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:34 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2f4c9cf4-f4ac-42a9-91b2-966229993864 tempest-VolumesTransfersTest-1473749471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd2cc6bd-717d-47c7-9ac6-c5223000ce28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:34 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2f4c9cf4-f4ac-42a9-91b2-966229993864 tempest-VolumesTransfersTest-1473749471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd2cc6bd-717d-47c7-9ac6-c5223000ce28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:34 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2f4c9cf4-f4ac-42a9-91b2-966229993864 tempest-VolumesTransfersTest-1473749471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e77243b4-b246-4563-b92b-116783468055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:34 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2f4c9cf4-f4ac-42a9-91b2-966229993864 tempest-VolumesTransfersTest-1473749471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e77243b4-b246-4563-b92b-116783468055) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '112ce53f-a96a-4027-b773-bb56bbd65900', 'volume_name': 'volume-112ce53f-a96a-4027-b773-bb56bbd65900', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:34 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2f4c9cf4-f4ac-42a9-91b2-966229993864 tempest-VolumesTransfersTest-1473749471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (231a9ff1-0f56-479b-86e5-84cf3095e8ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:34 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2f4c9cf4-f4ac-42a9-91b2-966229993864 tempest-VolumesTransfersTest-1473749471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (231a9ff1-0f56-479b-86e5-84cf3095e8ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:34 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2f4c9cf4-f4ac-42a9-91b2-966229993864 tempest-VolumesTransfersTest-1473749471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06fe492f-7f53-49cf-af3a-98d67e2e03bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:34 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-2f4c9cf4-f4ac-42a9-91b2-966229993864 tempest-VolumesTransfersTest-1473749471 None] Volume 112ce53f-a96a-4027-b773-bb56bbd65900: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-112ce53f-a96a-4027-b773-bb56bbd65900', 'volume_size': 1}
Jul 14 16:32:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2f4c9cf4-f4ac-42a9-91b2-966229993864 tempest-VolumesTransfersTest-1473749471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:32:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2f4c9cf4-f4ac-42a9-91b2-966229993864 tempest-VolumesTransfersTest-1473749471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:32:34 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2f4c9cf4-f4ac-42a9-91b2-966229993864 tempest-VolumesTransfersTest-1473749471 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:32:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1739531335',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=112ce53f-a96a-4027-b773-bb56bbd65900,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fa475560ec44d2aabaaffb0e1c3158f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:32:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:32:34Z,use_quota=True,user_id='79109bbbd18a4bc580e716f8bb817f88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:32:34 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-2f4c9cf4-f4ac-42a9-91b2-966229993864 tempest-VolumesTransfersTest-1473749471 None] Creating volume 112ce53f-a96a-4027-b773-bb56bbd65900 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:32:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2f4c9cf4-f4ac-42a9-91b2-966229993864 tempest-VolumesTransfersTest-1473749471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:32:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2f4c9cf4-f4ac-42a9-91b2-966229993864 tempest-VolumesTransfersTest-1473749471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:32:34 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2f4c9cf4-f4ac-42a9-91b2-966229993864 tempest-VolumesTransfersTest-1473749471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:32:34 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2f4c9cf4-f4ac-42a9-91b2-966229993864 tempest-VolumesTransfersTest-1473749471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:32:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2f4c9cf4-f4ac-42a9-91b2-966229993864 tempest-VolumesTransfersTest-1473749471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:32:34 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2f4c9cf4-f4ac-42a9-91b2-966229993864 tempest-VolumesTransfersTest-1473749471 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:32:34 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-2f4c9cf4-f4ac-42a9-91b2-966229993864 tempest-VolumesTransfersTest-1473749471 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:32:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2f4c9cf4-f4ac-42a9-91b2-966229993864 tempest-VolumesTransfersTest-1473749471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-112ce53f-a96a-4027-b773-bb56bbd65900 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:34 devstack sudo[98591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-112ce53f-a96a-4027-b773-bb56bbd65900 1073741824
Jul 14 16:32:34 devstack sudo[98591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:35 devstack sudo[98591]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2f4c9cf4-f4ac-42a9-91b2-966229993864 tempest-VolumesTransfersTest-1473749471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-112ce53f-a96a-4027-b773-bb56bbd65900 1073741824" returned: 0 in 0.607s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2f4c9cf4-f4ac-42a9-91b2-966229993864 tempest-VolumesTransfersTest-1473749471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-112ce53f-a96a-4027-b773-bb56bbd65900 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:35 devstack sudo[98597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-112ce53f-a96a-4027-b773-bb56bbd65900
Jul 14 16:32:35 devstack sudo[98597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:35 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 16:32:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:32:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:32:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:32:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:32:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:32:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:35 devstack sudo[98599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:32:35 devstack sudo[98599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:35 devstack sudo[98597]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2f4c9cf4-f4ac-42a9-91b2-966229993864 tempest-VolumesTransfersTest-1473749471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-112ce53f-a96a-4027-b773-bb56bbd65900" returned: 0 in 0.379s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2f4c9cf4-f4ac-42a9-91b2-966229993864 tempest-VolumesTransfersTest-1473749471 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:32:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2f4c9cf4-f4ac-42a9-91b2-966229993864 tempest-VolumesTransfersTest-1473749471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:32:35 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2f4c9cf4-f4ac-42a9-91b2-966229993864 tempest-VolumesTransfersTest-1473749471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06fe492f-7f53-49cf-af3a-98d67e2e03bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-112ce53f-a96a-4027-b773-bb56bbd65900', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:35 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2f4c9cf4-f4ac-42a9-91b2-966229993864 tempest-VolumesTransfersTest-1473749471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cfdb158-ca64-42b5-89e4-e8303b7ad87d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:35 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-2f4c9cf4-f4ac-42a9-91b2-966229993864 tempest-VolumesTransfersTest-1473749471 None] Volume volume-112ce53f-a96a-4027-b773-bb56bbd65900 (112ce53f-a96a-4027-b773-bb56bbd65900): created successfully
Jul 14 16:32:35 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2f4c9cf4-f4ac-42a9-91b2-966229993864 tempest-VolumesTransfersTest-1473749471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cfdb158-ca64-42b5-89e4-e8303b7ad87d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:35 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2f4c9cf4-f4ac-42a9-91b2-966229993864 tempest-VolumesTransfersTest-1473749471 None] Flow 'volume_create_manager' (90309675-a34f-4239-8ebc-e1e0b4ac3906) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:32:35 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-2f4c9cf4-f4ac-42a9-91b2-966229993864 tempest-VolumesTransfersTest-1473749471 None] Created volume successfully.
Jul 14 16:32:35 devstack sudo[98599]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.404s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:35 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:32:35 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Running periodic task VolumeManager._thread_info {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 16:32:35 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] thread count: 28 {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 14 16:32:35 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] thread info: [<_MainThread(MainThread, started 128606490927232)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128606415432960)>, <Thread(Thread-3 (stat_writer), started daemon 128606378859328)>, <Thread(Rabbit-heartbeat, started daemon 128606379646144)>, <Thread(Thread-5 (_runner), started daemon 128606377685824)>, <Thread(Thread-7 (_runner), started daemon 128606377701888)>, <Thread(fd_logger, started daemon 128606377091392)>, <Thread(privsep_reader, started daemon 128606375782080)>, <Thread(tpool_thread_0, started daemon 128606365607616)>, <Thread(tpool_thread_1, started daemon 128606357214912)>, <Thread(tpool_thread_2, started daemon 128606348822208)>, <Thread(tpool_thread_3, started daemon 128606340413120)>, <Thread(tpool_thread_4, started daemon 128606332004032)>, <Thread(tpool_thread_5, started daemon 128606323594944)>, <Thread(tpool_thread_6, started daemon 128606315185856)>, <Thread(tpool_thread_7, started daemon 128606306776768)>, <Thread(tpool_thread_8, started daemon 128606298367680)>, <Thread(tpool_thread_9, started daemon 128606289958592)>, <Thread(tpool_thread_10, started daemon 128606281549504)>, <Thread(tpool_thread_11, started daemon 128606273140416)>, <Thread(tpool_thread_12, started daemon 128606264731328)>, <Thread(tpool_thread_13, started daemon 128606256322240)>, <Thread(tpool_thread_14, started daemon 128606247913152)>, <Thread(tpool_thread_15, started daemon 128606239504064)>, <Thread(tpool_thread_16, started daemon 128606231094976)>, <Thread(tpool_thread_17, started daemon 128606222685888)>, <Thread(tpool_thread_18, started daemon 128606214276800)>, <Thread(tpool_thread_19, started daemon 128606205867712)>] {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 14 16:32:37 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-c38fab1d-09ea-4a12-913b-b14626161d12 tempest-VolumesTransfersTest-948764227 None] Transfer volume completed successfully.
Jul 14 16:32:38 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f24386aa-2432-45e9-ae04-f14492196e42 tempest-VolumesTransfersTest-1840514357 None] Acquiring lock "cinder-112ce53f-a96a-4027-b773-bb56bbd65900-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:32:38 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f24386aa-2432-45e9-ae04-f14492196e42 tempest-VolumesTransfersTest-1840514357 None] Lock "cinder-112ce53f-a96a-4027-b773-bb56bbd65900-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:32:38 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:SELECT=135,cinder:UPDATE=194,cinder:INSERT=45,cinder:DELETE=16 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 16:32:38 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:SELECT=158,cinder:UPDATE=187,cinder:INSERT=57,cinder:DELETE=17 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 16:32:38 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f24386aa-2432-45e9-ae04-f14492196e42 tempest-VolumesTransfersTest-1840514357 None] Acquiring lock "cinder-quobyte-112ce53f-a96a-4027-b773-bb56bbd65900" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:32:38 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f24386aa-2432-45e9-ae04-f14492196e42 tempest-VolumesTransfersTest-1840514357 None] Lock "cinder-quobyte-112ce53f-a96a-4027-b773-bb56bbd65900" acquired by "delete_volume" :: waited 0.032s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:32:38 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ff2e5b-014d-4fca-ba60-82fc057d84fc]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:32:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f24386aa-2432-45e9-ae04-f14492196e42 tempest-VolumesTransfersTest-1840514357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-112ce53f-a96a-4027-b773-bb56bbd65900 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:38 devstack sudo[98606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-112ce53f-a96a-4027-b773-bb56bbd65900
Jul 14 16:32:38 devstack sudo[98606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:39 devstack sudo[98606]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f24386aa-2432-45e9-ae04-f14492196e42 tempest-VolumesTransfersTest-1840514357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-112ce53f-a96a-4027-b773-bb56bbd65900" returned: 0 in 0.457s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f24386aa-2432-45e9-ae04-f14492196e42 tempest-VolumesTransfersTest-1840514357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-112ce53f-a96a-4027-b773-bb56bbd65900 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:39 devstack sudo[98613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-112ce53f-a96a-4027-b773-bb56bbd65900
Jul 14 16:32:39 devstack sudo[98613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:39 devstack sudo[98613]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f24386aa-2432-45e9-ae04-f14492196e42 tempest-VolumesTransfersTest-1840514357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-112ce53f-a96a-4027-b773-bb56bbd65900" returned: 0 in 0.296s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:39 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f24386aa-2432-45e9-ae04-f14492196e42 tempest-VolumesTransfersTest-1840514357 None] Lock "cinder-quobyte-112ce53f-a96a-4027-b773-bb56bbd65900" released by "delete_volume" :: held 0.827s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:32:39 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-f24386aa-2432-45e9-ae04-f14492196e42 tempest-VolumesTransfersTest-1840514357 None] Created reservations ['cc098e7c-ea66-469e-a6b6-2fff0fee8727', '3dc3abc9-a278-4ace-ac6a-cf23c7505807', 'bf3663a4-18f9-4f06-8541-21ea7e4054ae', '8091ae01-77c2-46bf-9d16-ab1537371048'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:32:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f24386aa-2432-45e9-ae04-f14492196e42 tempest-VolumesTransfersTest-1840514357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:32:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f24386aa-2432-45e9-ae04-f14492196e42 tempest-VolumesTransfersTest-1840514357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:32:39 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f24386aa-2432-45e9-ae04-f14492196e42 tempest-VolumesTransfersTest-1840514357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:32:39 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f24386aa-2432-45e9-ae04-f14492196e42 tempest-VolumesTransfersTest-1840514357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:32:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f24386aa-2432-45e9-ae04-f14492196e42 tempest-VolumesTransfersTest-1840514357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:32:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f24386aa-2432-45e9-ae04-f14492196e42 tempest-VolumesTransfersTest-1840514357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:39 devstack sudo[98616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:32:39 devstack sudo[98616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:40 devstack sudo[98616]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f24386aa-2432-45e9-ae04-f14492196e42 tempest-VolumesTransfersTest-1840514357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.431s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:40 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-f24386aa-2432-45e9-ae04-f14492196e42 tempest-VolumesTransfersTest-1840514357 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:32:40 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-f24386aa-2432-45e9-ae04-f14492196e42 tempest-VolumesTransfersTest-1840514357 None] Deleted volume successfully.
Jul 14 16:32:40 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f24386aa-2432-45e9-ae04-f14492196e42 tempest-VolumesTransfersTest-1840514357 None] Lock "cinder-112ce53f-a96a-4027-b773-bb56bbd65900-delete_volume" released by "delete_volume" :: held 1.756s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:32:40 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6f8cf84-a884-4bf1-baa8-cee3d282dae0 tempest-VolumesTransfersTest-1473749471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:32:40 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c6f8cf84-a884-4bf1-baa8-cee3d282dae0 tempest-VolumesTransfersTest-1473749471 None] Flow 'volume_create_manager' (286e20b9-72ef-4e9a-af5d-709f452d234b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:32:40 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c6f8cf84-a884-4bf1-baa8-cee3d282dae0 tempest-VolumesTransfersTest-1473749471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a34c5c4-89e8-4f2a-bafd-f71dcb09c301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:40 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c6f8cf84-a884-4bf1-baa8-cee3d282dae0 tempest-VolumesTransfersTest-1473749471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a34c5c4-89e8-4f2a-bafd-f71dcb09c301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:32:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-130178940',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=649ff27d-7509-4667-91bd-0a493d59ca2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fa475560ec44d2aabaaffb0e1c3158f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:32:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:32:41Z,use_quota=True,user_id='79109bbbd18a4bc580e716f8bb817f88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:40 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c6f8cf84-a884-4bf1-baa8-cee3d282dae0 tempest-VolumesTransfersTest-1473749471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dee6e60c-0e21-4b81-8f31-50ffd083dde7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:40 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c6f8cf84-a884-4bf1-baa8-cee3d282dae0 tempest-VolumesTransfersTest-1473749471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dee6e60c-0e21-4b81-8f31-50ffd083dde7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:40 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c6f8cf84-a884-4bf1-baa8-cee3d282dae0 tempest-VolumesTransfersTest-1473749471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccd8bb3c-d46a-46f3-8f29-fc6750691694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:40 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c6f8cf84-a884-4bf1-baa8-cee3d282dae0 tempest-VolumesTransfersTest-1473749471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccd8bb3c-d46a-46f3-8f29-fc6750691694) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '649ff27d-7509-4667-91bd-0a493d59ca2f', 'volume_name': 'volume-649ff27d-7509-4667-91bd-0a493d59ca2f', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:40 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c6f8cf84-a884-4bf1-baa8-cee3d282dae0 tempest-VolumesTransfersTest-1473749471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c338a19-ddc9-44ef-bb2e-e51a330bd1ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:40 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c6f8cf84-a884-4bf1-baa8-cee3d282dae0 tempest-VolumesTransfersTest-1473749471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c338a19-ddc9-44ef-bb2e-e51a330bd1ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:40 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c6f8cf84-a884-4bf1-baa8-cee3d282dae0 tempest-VolumesTransfersTest-1473749471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1701750-c51a-4248-b806-6860426a05c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:40 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-c6f8cf84-a884-4bf1-baa8-cee3d282dae0 tempest-VolumesTransfersTest-1473749471 None] Volume 649ff27d-7509-4667-91bd-0a493d59ca2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-649ff27d-7509-4667-91bd-0a493d59ca2f', 'volume_size': 1}
Jul 14 16:32:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c6f8cf84-a884-4bf1-baa8-cee3d282dae0 tempest-VolumesTransfersTest-1473749471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:32:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c6f8cf84-a884-4bf1-baa8-cee3d282dae0 tempest-VolumesTransfersTest-1473749471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:32:40 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-c6f8cf84-a884-4bf1-baa8-cee3d282dae0 tempest-VolumesTransfersTest-1473749471 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:32:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-130178940',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=649ff27d-7509-4667-91bd-0a493d59ca2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fa475560ec44d2aabaaffb0e1c3158f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:32:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:32:41Z,use_quota=True,user_id='79109bbbd18a4bc580e716f8bb817f88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:32:40 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-c6f8cf84-a884-4bf1-baa8-cee3d282dae0 tempest-VolumesTransfersTest-1473749471 None] Creating volume 649ff27d-7509-4667-91bd-0a493d59ca2f {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:32:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c6f8cf84-a884-4bf1-baa8-cee3d282dae0 tempest-VolumesTransfersTest-1473749471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:32:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c6f8cf84-a884-4bf1-baa8-cee3d282dae0 tempest-VolumesTransfersTest-1473749471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:32:40 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-c6f8cf84-a884-4bf1-baa8-cee3d282dae0 tempest-VolumesTransfersTest-1473749471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:32:40 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-c6f8cf84-a884-4bf1-baa8-cee3d282dae0 tempest-VolumesTransfersTest-1473749471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:32:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c6f8cf84-a884-4bf1-baa8-cee3d282dae0 tempest-VolumesTransfersTest-1473749471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:32:40 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-c6f8cf84-a884-4bf1-baa8-cee3d282dae0 tempest-VolumesTransfersTest-1473749471 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:32:40 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-c6f8cf84-a884-4bf1-baa8-cee3d282dae0 tempest-VolumesTransfersTest-1473749471 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:32:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c6f8cf84-a884-4bf1-baa8-cee3d282dae0 tempest-VolumesTransfersTest-1473749471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-649ff27d-7509-4667-91bd-0a493d59ca2f 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:40 devstack sudo[98620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-649ff27d-7509-4667-91bd-0a493d59ca2f 1073741824
Jul 14 16:32:40 devstack sudo[98620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:40 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-453af322-a7a9-462e-83aa-9de4f4f72814 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:32:40 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-453af322-a7a9-462e-83aa-9de4f4f72814 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] Flow 'volume_create_manager' (d77947e0-b6d8-45c9-b035-b43f8837ffa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:32:40 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-453af322-a7a9-462e-83aa-9de4f4f72814 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c1fb58e-665b-4189-aedd-00c2e91506e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:40 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-453af322-a7a9-462e-83aa-9de4f4f72814 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c1fb58e-665b-4189-aedd-00c2e91506e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:32:40Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=530a1353-19d0-4416-9da9-f5d11165ba30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6150cc266690448fb00aece80506cd85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:32:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:32:41Z,use_quota=True,user_id='e54392e0baa5440d9d044ed478da6ddd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f12f656a-ff86-4980-96b9-1bf2163223d2),volume_type_id=f12f656a-ff86-4980-96b9-1bf2163223d2)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:40 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-453af322-a7a9-462e-83aa-9de4f4f72814 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (009452b4-005d-40e0-9a6c-2b157b9dc59e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:40 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-453af322-a7a9-462e-83aa-9de4f4f72814 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (009452b4-005d-40e0-9a6c-2b157b9dc59e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:40 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-453af322-a7a9-462e-83aa-9de4f4f72814 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8d20e74-752b-44f0-81a6-67f7768acbc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:40 devstack cinder-volume[87166]: DEBUG cinder.image.glance [None req-453af322-a7a9-462e-83aa-9de4f4f72814 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] Creating Keystone auth plugin from conf {{(pid=87166) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 14 16:32:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-453af322-a7a9-462e-83aa-9de4f4f72814 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8d20e74-752b-44f0-81a6-67f7768acbc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '530a1353-19d0-4416-9da9-f5d11165ba30', 'volume_name': 'volume-530a1353-19d0-4416-9da9-f5d11165ba30', 'volume_size': 1, 'image_id': '67ef9254-9cf1-42ec-9270-ba8ac52d3246', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/67ef9254-9cf1-42ec-9270-ba8ac52d3246', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '485db7504a42e2b13f3cfc2bc323b168', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6150cc266690448fb00aece80506cd85', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5033178ab5973bec32539c2b14917c26d98415de6b8efbc8bc6aa11282ae101cdd9a76ea5349839c24fb35b98e7db14a78aa2aed2e6b762ddccfb66cd45bfa12', 'id': '67ef9254-9cf1-42ec-9270-ba8ac52d3246', 'created_at': datetime.datetime(2026, 7, 14, 14, 32, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 14, 32, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/67ef9254-9cf1-42ec-9270-ba8ac52d3246/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74f780ef88c0>}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-453af322-a7a9-462e-83aa-9de4f4f72814 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c021a7cf-49ee-4cbd-8c9a-b2bd5c2ec2f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-453af322-a7a9-462e-83aa-9de4f4f72814 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c021a7cf-49ee-4cbd-8c9a-b2bd5c2ec2f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-453af322-a7a9-462e-83aa-9de4f4f72814 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eef2966f-ce62-4cd9-a2ff-446bbe2e4b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:41 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-453af322-a7a9-462e-83aa-9de4f4f72814 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] Volume 530a1353-19d0-4416-9da9-f5d11165ba30: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-530a1353-19d0-4416-9da9-f5d11165ba30', 'volume_size': 1, 'image_id': '67ef9254-9cf1-42ec-9270-ba8ac52d3246', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/67ef9254-9cf1-42ec-9270-ba8ac52d3246', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '485db7504a42e2b13f3cfc2bc323b168', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6150cc266690448fb00aece80506cd85', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5033178ab5973bec32539c2b14917c26d98415de6b8efbc8bc6aa11282ae101cdd9a76ea5349839c24fb35b98e7db14a78aa2aed2e6b762ddccfb66cd45bfa12', 'id': '67ef9254-9cf1-42ec-9270-ba8ac52d3246', 'created_at': datetime.datetime(2026, 7, 14, 14, 32, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 14, 32, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/67ef9254-9cf1-42ec-9270-ba8ac52d3246/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74f780ef88c0>}
Jul 14 16:32:41 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-453af322-a7a9-462e-83aa-9de4f4f72814 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] Trying to clone 530a1353-19d0-4416-9da9-f5d11165ba30 from image 67ef9254-9cf1-42ec-9270-ba8ac52d3246 at location (None, [{'url': 'file:///opt/stack/data/glance/images/67ef9254-9cf1-42ec-9270-ba8ac52d3246', 'metadata': {}}]). {{(pid=87166) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 14 16:32:41 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-453af322-a7a9-462e-83aa-9de4f4f72814 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_67ef9254-9cf1-42ec-9270-ba8ac52d3246_7mulnsmadevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87166) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 14 16:32:41 devstack cinder-volume[87166]: INFO cinder.image.image_utils [None req-453af322-a7a9-462e-83aa-9de4f4f72814 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] Image download 0.00 MB at 0.00 MB/s
Jul 14 16:32:41 devstack sudo[98620]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c6f8cf84-a884-4bf1-baa8-cee3d282dae0 tempest-VolumesTransfersTest-1473749471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-649ff27d-7509-4667-91bd-0a493d59ca2f 1073741824" returned: 0 in 0.649s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c6f8cf84-a884-4bf1-baa8-cee3d282dae0 tempest-VolumesTransfersTest-1473749471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-649ff27d-7509-4667-91bd-0a493d59ca2f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:41 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50ff6df-b8d9-485f-a404-0b0db94d0dbd]: (4, 'raw') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:32:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-453af322-a7a9-462e-83aa-9de4f4f72814 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_67ef9254-9cf1-42ec-9270-ba8ac52d3246_7mulnsmadevstack@QuobyteHD {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:41 devstack sudo[98626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-649ff27d-7509-4667-91bd-0a493d59ca2f
Jul 14 16:32:41 devstack sudo[98626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:41 devstack sudo[98627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_67ef9254-9cf1-42ec-9270-ba8ac52d3246_7mulnsmadevstack@QuobyteHD
Jul 14 16:32:41 devstack sudo[98627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:41 devstack sudo[98626]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c6f8cf84-a884-4bf1-baa8-cee3d282dae0 tempest-VolumesTransfersTest-1473749471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-649ff27d-7509-4667-91bd-0a493d59ca2f" returned: 0 in 0.349s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:41 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-c6f8cf84-a884-4bf1-baa8-cee3d282dae0 tempest-VolumesTransfersTest-1473749471 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:32:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c6f8cf84-a884-4bf1-baa8-cee3d282dae0 tempest-VolumesTransfersTest-1473749471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:32:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c6f8cf84-a884-4bf1-baa8-cee3d282dae0 tempest-VolumesTransfersTest-1473749471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1701750-c51a-4248-b806-6860426a05c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-649ff27d-7509-4667-91bd-0a493d59ca2f', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c6f8cf84-a884-4bf1-baa8-cee3d282dae0 tempest-VolumesTransfersTest-1473749471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (599d7b58-8e28-4281-9d7b-5962d9344237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:41 devstack sudo[98627]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-453af322-a7a9-462e-83aa-9de4f4f72814 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_67ef9254-9cf1-42ec-9270-ba8ac52d3246_7mulnsmadevstack@QuobyteHD" returned: 0 in 0.374s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-453af322-a7a9-462e-83aa-9de4f4f72814 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_67ef9254-9cf1-42ec-9270-ba8ac52d3246_7mulnsmadevstack@QuobyteHD {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:41 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-c6f8cf84-a884-4bf1-baa8-cee3d282dae0 tempest-VolumesTransfersTest-1473749471 None] Volume volume-649ff27d-7509-4667-91bd-0a493d59ca2f (649ff27d-7509-4667-91bd-0a493d59ca2f): created successfully
Jul 14 16:32:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c6f8cf84-a884-4bf1-baa8-cee3d282dae0 tempest-VolumesTransfersTest-1473749471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (599d7b58-8e28-4281-9d7b-5962d9344237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c6f8cf84-a884-4bf1-baa8-cee3d282dae0 tempest-VolumesTransfersTest-1473749471 None] Flow 'volume_create_manager' (286e20b9-72ef-4e9a-af5d-709f452d234b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:32:41 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-c6f8cf84-a884-4bf1-baa8-cee3d282dae0 tempest-VolumesTransfersTest-1473749471 None] Created volume successfully.
Jul 14 16:32:42 devstack sudo[98633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_67ef9254-9cf1-42ec-9270-ba8ac52d3246_7mulnsmadevstack@QuobyteHD
Jul 14 16:32:42 devstack sudo[98633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:42 devstack sudo[98633]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-453af322-a7a9-462e-83aa-9de4f4f72814 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_67ef9254-9cf1-42ec-9270-ba8ac52d3246_7mulnsmadevstack@QuobyteHD" returned: 1 in 0.448s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-453af322-a7a9-462e-83aa-9de4f4f72814 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_67ef9254-9cf1-42ec-9270-ba8ac52d3246_7mulnsmadevstack@QuobyteHD' failed. Not Retrying. {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 16:32:42 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-453af322-a7a9-462e-83aa-9de4f4f72814 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] Temporary image 67ef9254-9cf1-42ec-9270-ba8ac52d3246 is fetched for user e54392e0baa5440d9d044ed478da6ddd. {{(pid=87166) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 14 16:32:42 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe36e266-6f7e-4b9a-9584-d7debd4618ea]: (4, 'raw') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:32:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-453af322-a7a9-462e-83aa-9de4f4f72814 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_67ef9254-9cf1-42ec-9270-ba8ac52d3246_7mulnsmadevstack@QuobyteHD {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:42 devstack sudo[98639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_67ef9254-9cf1-42ec-9270-ba8ac52d3246_7mulnsmadevstack@QuobyteHD
Jul 14 16:32:42 devstack sudo[98639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:42 devstack sudo[98639]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-453af322-a7a9-462e-83aa-9de4f4f72814 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_67ef9254-9cf1-42ec-9270-ba8ac52d3246_7mulnsmadevstack@QuobyteHD" returned: 0 in 0.482s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-453af322-a7a9-462e-83aa-9de4f4f72814 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_67ef9254-9cf1-42ec-9270-ba8ac52d3246_7mulnsmadevstack@QuobyteHD {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:43 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e2dc0254-90a4-42fd-b16f-e91f9c652041 tempest-VolumesTransfersTest-1840514357 None] Acquiring lock "cinder-649ff27d-7509-4667-91bd-0a493d59ca2f-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:32:43 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e2dc0254-90a4-42fd-b16f-e91f9c652041 tempest-VolumesTransfersTest-1840514357 None] Lock "cinder-649ff27d-7509-4667-91bd-0a493d59ca2f-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:32:43 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e2dc0254-90a4-42fd-b16f-e91f9c652041 tempest-VolumesTransfersTest-1840514357 None] Acquiring lock "cinder-quobyte-649ff27d-7509-4667-91bd-0a493d59ca2f" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:32:43 devstack sudo[98643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_67ef9254-9cf1-42ec-9270-ba8ac52d3246_7mulnsmadevstack@QuobyteHD
Jul 14 16:32:43 devstack sudo[98643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:43 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e2dc0254-90a4-42fd-b16f-e91f9c652041 tempest-VolumesTransfersTest-1840514357 None] Lock "cinder-quobyte-649ff27d-7509-4667-91bd-0a493d59ca2f" acquired by "delete_volume" :: waited 0.028s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:32:43 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[711b8975-ce2c-4673-b198-c810d0f9062b]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:32:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e2dc0254-90a4-42fd-b16f-e91f9c652041 tempest-VolumesTransfersTest-1840514357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-649ff27d-7509-4667-91bd-0a493d59ca2f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:43 devstack sudo[98645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-649ff27d-7509-4667-91bd-0a493d59ca2f
Jul 14 16:32:43 devstack sudo[98645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:43 devstack sudo[98643]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-453af322-a7a9-462e-83aa-9de4f4f72814 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_67ef9254-9cf1-42ec-9270-ba8ac52d3246_7mulnsmadevstack@QuobyteHD" returned: 1 in 0.461s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-453af322-a7a9-462e-83aa-9de4f4f72814 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_67ef9254-9cf1-42ec-9270-ba8ac52d3246_7mulnsmadevstack@QuobyteHD' failed. Not Retrying. {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 16:32:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-453af322-a7a9-462e-83aa-9de4f4f72814 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:32:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-453af322-a7a9-462e-83aa-9de4f4f72814 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:32:43 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-453af322-a7a9-462e-83aa-9de4f4f72814 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:32:40Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=530a1353-19d0-4416-9da9-f5d11165ba30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6150cc266690448fb00aece80506cd85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:32:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:32:41Z,use_quota=True,user_id='e54392e0baa5440d9d044ed478da6ddd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f12f656a-ff86-4980-96b9-1bf2163223d2),volume_type_id=f12f656a-ff86-4980-96b9-1bf2163223d2)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:32:43 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-453af322-a7a9-462e-83aa-9de4f4f72814 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] Creating volume 530a1353-19d0-4416-9da9-f5d11165ba30 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:32:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-453af322-a7a9-462e-83aa-9de4f4f72814 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:32:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-453af322-a7a9-462e-83aa-9de4f4f72814 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:32:43 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-453af322-a7a9-462e-83aa-9de4f4f72814 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:32:43 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-453af322-a7a9-462e-83aa-9de4f4f72814 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:32:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-453af322-a7a9-462e-83aa-9de4f4f72814 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:32:43 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-453af322-a7a9-462e-83aa-9de4f4f72814 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:32:43 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-453af322-a7a9-462e-83aa-9de4f4f72814 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:32:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-453af322-a7a9-462e-83aa-9de4f4f72814 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-530a1353-19d0-4416-9da9-f5d11165ba30 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:43 devstack sudo[98650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-530a1353-19d0-4416-9da9-f5d11165ba30 1073741824
Jul 14 16:32:43 devstack sudo[98650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:43 devstack sudo[98645]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e2dc0254-90a4-42fd-b16f-e91f9c652041 tempest-VolumesTransfersTest-1840514357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-649ff27d-7509-4667-91bd-0a493d59ca2f" returned: 0 in 0.498s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e2dc0254-90a4-42fd-b16f-e91f9c652041 tempest-VolumesTransfersTest-1840514357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-649ff27d-7509-4667-91bd-0a493d59ca2f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:43 devstack sudo[98655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-649ff27d-7509-4667-91bd-0a493d59ca2f
Jul 14 16:32:43 devstack sudo[98655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:43 devstack sudo[98655]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e2dc0254-90a4-42fd-b16f-e91f9c652041 tempest-VolumesTransfersTest-1840514357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-649ff27d-7509-4667-91bd-0a493d59ca2f" returned: 0 in 0.259s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:43 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e2dc0254-90a4-42fd-b16f-e91f9c652041 tempest-VolumesTransfersTest-1840514357 None] Lock "cinder-quobyte-649ff27d-7509-4667-91bd-0a493d59ca2f" released by "delete_volume" :: held 0.821s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:32:44 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-e2dc0254-90a4-42fd-b16f-e91f9c652041 tempest-VolumesTransfersTest-1840514357 None] Created reservations ['ddf883aa-5a12-4a3c-a325-7ceae75fdfbe', '9ef35740-9204-480f-bda2-0ab6102c9e96', 'c9e01891-757f-49d2-9ad2-93dbd22fdec4', '8a49c615-69a7-43a9-b7e8-1e3fae4210a4'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:32:44 devstack sudo[98650]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-453af322-a7a9-462e-83aa-9de4f4f72814 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-530a1353-19d0-4416-9da9-f5d11165ba30 1073741824" returned: 0 in 0.811s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e2dc0254-90a4-42fd-b16f-e91f9c652041 tempest-VolumesTransfersTest-1840514357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:32:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e2dc0254-90a4-42fd-b16f-e91f9c652041 tempest-VolumesTransfersTest-1840514357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:32:44 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-e2dc0254-90a4-42fd-b16f-e91f9c652041 tempest-VolumesTransfersTest-1840514357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:32:44 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-e2dc0254-90a4-42fd-b16f-e91f9c652041 tempest-VolumesTransfersTest-1840514357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:32:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e2dc0254-90a4-42fd-b16f-e91f9c652041 tempest-VolumesTransfersTest-1840514357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:32:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e2dc0254-90a4-42fd-b16f-e91f9c652041 tempest-VolumesTransfersTest-1840514357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-453af322-a7a9-462e-83aa-9de4f4f72814 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-530a1353-19d0-4416-9da9-f5d11165ba30 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:44 devstack sudo[98661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:32:44 devstack sudo[98661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:44 devstack sudo[98662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-530a1353-19d0-4416-9da9-f5d11165ba30
Jul 14 16:32:44 devstack sudo[98662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:44 devstack sudo[98661]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e2dc0254-90a4-42fd-b16f-e91f9c652041 tempest-VolumesTransfersTest-1840514357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.358s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:44 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-e2dc0254-90a4-42fd-b16f-e91f9c652041 tempest-VolumesTransfersTest-1840514357 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:32:44 devstack sudo[98662]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-453af322-a7a9-462e-83aa-9de4f4f72814 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-530a1353-19d0-4416-9da9-f5d11165ba30" returned: 0 in 0.333s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:44 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-453af322-a7a9-462e-83aa-9de4f4f72814 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] <== create_volume: return (1224ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:32:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-453af322-a7a9-462e-83aa-9de4f4f72814 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.228s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:32:44 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-e2dc0254-90a4-42fd-b16f-e91f9c652041 tempest-VolumesTransfersTest-1840514357 None] Deleted volume successfully.
Jul 14 16:32:44 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e2dc0254-90a4-42fd-b16f-e91f9c652041 tempest-VolumesTransfersTest-1840514357 None] Lock "cinder-649ff27d-7509-4667-91bd-0a493d59ca2f-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:32:44 devstack cinder-volume[87166]: DEBUG cinder.volume.volume_utils [None req-453af322-a7a9-462e-83aa-9de4f4f72814 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] Attempting download of 67ef9254-9cf1-42ec-9270-ba8ac52d3246 ((None, [{'url': 'file:///opt/stack/data/glance/images/67ef9254-9cf1-42ec-9270-ba8ac52d3246', 'metadata': {}}])) to volume 530a1353-19d0-4416-9da9-f5d11165ba30. {{(pid=87166) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 14 16:32:44 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5a8f82-bb51-4f21-97bc-8668d3a05163]: (4, 'raw') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:32:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-453af322-a7a9-462e-83aa-9de4f4f72814 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_67ef9254-9cf1-42ec-9270-ba8ac52d3246_ma3idhf9 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:44 devstack sudo[98667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_67ef9254-9cf1-42ec-9270-ba8ac52d3246_ma3idhf9
Jul 14 16:32:44 devstack sudo[98667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:45 devstack sudo[98667]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-453af322-a7a9-462e-83aa-9de4f4f72814 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_67ef9254-9cf1-42ec-9270-ba8ac52d3246_ma3idhf9" returned: 0 in 0.436s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-453af322-a7a9-462e-83aa-9de4f4f72814 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_67ef9254-9cf1-42ec-9270-ba8ac52d3246_ma3idhf9 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:45 devstack sudo[98671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_67ef9254-9cf1-42ec-9270-ba8ac52d3246_ma3idhf9
Jul 14 16:32:45 devstack sudo[98671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:45 devstack sudo[98671]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-453af322-a7a9-462e-83aa-9de4f4f72814 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_67ef9254-9cf1-42ec-9270-ba8ac52d3246_ma3idhf9" returned: 1 in 0.592s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-453af322-a7a9-462e-83aa-9de4f4f72814 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_67ef9254-9cf1-42ec-9270-ba8ac52d3246_ma3idhf9' failed. Not Retrying. {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 16:32:45 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c8b72a-5b3d-41f2-8adc-97fe7ea1085a]: (4, 'raw') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:32:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-453af322-a7a9-462e-83aa-9de4f4f72814 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_67ef9254-9cf1-42ec-9270-ba8ac52d3246_7mulnsmadevstack@QuobyteHD {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:45 devstack sudo[98676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_67ef9254-9cf1-42ec-9270-ba8ac52d3246_7mulnsmadevstack@QuobyteHD
Jul 14 16:32:45 devstack sudo[98676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:46 devstack sudo[98676]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-453af322-a7a9-462e-83aa-9de4f4f72814 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_67ef9254-9cf1-42ec-9270-ba8ac52d3246_7mulnsmadevstack@QuobyteHD" returned: 0 in 0.444s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-453af322-a7a9-462e-83aa-9de4f4f72814 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_67ef9254-9cf1-42ec-9270-ba8ac52d3246_7mulnsmadevstack@QuobyteHD {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:46 devstack sudo[98680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_67ef9254-9cf1-42ec-9270-ba8ac52d3246_7mulnsmadevstack@QuobyteHD
Jul 14 16:32:46 devstack sudo[98680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:46 devstack sudo[98680]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-453af322-a7a9-462e-83aa-9de4f4f72814 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_67ef9254-9cf1-42ec-9270-ba8ac52d3246_7mulnsmadevstack@QuobyteHD" returned: 1 in 0.347s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-453af322-a7a9-462e-83aa-9de4f4f72814 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_67ef9254-9cf1-42ec-9270-ba8ac52d3246_7mulnsmadevstack@QuobyteHD' failed. Not Retrying. {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 16:32:46 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-453af322-a7a9-462e-83aa-9de4f4f72814 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] 67ef9254-9cf1-42ec-9270-ba8ac52d3246 was raw, converting to raw {{(pid=87166) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 14 16:32:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-453af322-a7a9-462e-83aa-9de4f4f72814 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_67ef9254-9cf1-42ec-9270-ba8ac52d3246_7mulnsmadevstack@QuobyteHD /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-530a1353-19d0-4416-9da9-f5d11165ba30 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:46 devstack sudo[98685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_67ef9254-9cf1-42ec-9270-ba8ac52d3246_7mulnsmadevstack@QuobyteHD /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-530a1353-19d0-4416-9da9-f5d11165ba30
Jul 14 16:32:46 devstack sudo[98685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:47 devstack sudo[98685]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-453af322-a7a9-462e-83aa-9de4f4f72814 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_67ef9254-9cf1-42ec-9270-ba8ac52d3246_7mulnsmadevstack@QuobyteHD /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-530a1353-19d0-4416-9da9-f5d11165ba30" returned: 0 in 0.437s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:47 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-453af322-a7a9-462e-83aa-9de4f4f72814 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_67ef9254-9cf1-42ec-9270-ba8ac52d3246_7mulnsmadevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-530a1353-19d0-4416-9da9-f5d11165ba30 {{(pid=87166) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 14 16:32:47 devstack cinder-volume[87166]: INFO cinder.image.image_utils [None req-453af322-a7a9-462e-83aa-9de4f4f72814 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] Converted 0.00 MB image at 0.00 MB/s
Jul 14 16:32:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-453af322-a7a9-462e-83aa-9de4f4f72814 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-530a1353-19d0-4416-9da9-f5d11165ba30 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:47 devstack sudo[98690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-530a1353-19d0-4416-9da9-f5d11165ba30 1G
Jul 14 16:32:47 devstack sudo[98690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:47 devstack sudo[98690]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-453af322-a7a9-462e-83aa-9de4f4f72814 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-530a1353-19d0-4416-9da9-f5d11165ba30 1G" returned: 0 in 0.428s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:47 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca74999d-9bbd-42e5-a837-a9ad047bc1ba]: (4, 'raw') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:32:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-453af322-a7a9-462e-83aa-9de4f4f72814 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-530a1353-19d0-4416-9da9-f5d11165ba30 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:47 devstack sudo[98695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-530a1353-19d0-4416-9da9-f5d11165ba30
Jul 14 16:32:47 devstack sudo[98695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:48 devstack sudo[98695]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-453af322-a7a9-462e-83aa-9de4f4f72814 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-530a1353-19d0-4416-9da9-f5d11165ba30" returned: 0 in 0.443s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-453af322-a7a9-462e-83aa-9de4f4f72814 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-530a1353-19d0-4416-9da9-f5d11165ba30 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:48 devstack sudo[98699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-530a1353-19d0-4416-9da9-f5d11165ba30
Jul 14 16:32:48 devstack sudo[98699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:48 devstack sudo[98699]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-453af322-a7a9-462e-83aa-9de4f4f72814 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-530a1353-19d0-4416-9da9-f5d11165ba30" returned: 1 in 0.430s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-453af322-a7a9-462e-83aa-9de4f4f72814 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-530a1353-19d0-4416-9da9-f5d11165ba30' failed. Not Retrying. {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 16:32:48 devstack cinder-volume[87166]: DEBUG cinder.volume.volume_utils [None req-453af322-a7a9-462e-83aa-9de4f4f72814 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] Downloaded image 67ef9254-9cf1-42ec-9270-ba8ac52d3246 ((None, [{'url': 'file:///opt/stack/data/glance/images/67ef9254-9cf1-42ec-9270-ba8ac52d3246', 'metadata': {}}])) to volume 530a1353-19d0-4416-9da9-f5d11165ba30 successfully. {{(pid=87166) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 14 16:32:48 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-453af322-a7a9-462e-83aa-9de4f4f72814 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] Temporary image 67ef9254-9cf1-42ec-9270-ba8ac52d3246 for user e54392e0baa5440d9d044ed478da6ddd is deleted. {{(pid=87166) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 14 16:32:48 devstack cinder-volume[87166]: DEBUG cinder.volume.volume_utils [None req-453af322-a7a9-462e-83aa-9de4f4f72814 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] Marking volume 530a1353-19d0-4416-9da9-f5d11165ba30 as bootable. {{(pid=87166) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 14 16:32:48 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-453af322-a7a9-462e-83aa-9de4f4f72814 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] Copying metadata from image 67ef9254-9cf1-42ec-9270-ba8ac52d3246 to 530a1353-19d0-4416-9da9-f5d11165ba30. {{(pid=87166) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 14 16:32:48 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-453af322-a7a9-462e-83aa-9de4f4f72814 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] Creating volume glance metadata for volume 530a1353-19d0-4416-9da9-f5d11165ba30 backed by image 67ef9254-9cf1-42ec-9270-ba8ac52d3246 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '67ef9254-9cf1-42ec-9270-ba8ac52d3246', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '485db7504a42e2b13f3cfc2bc323b168', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87166) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 14 16:32:48 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-453af322-a7a9-462e-83aa-9de4f4f72814 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eef2966f-ce62-4cd9-a2ff-446bbe2e4b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-530a1353-19d0-4416-9da9-f5d11165ba30', 'volume_size': 1, 'image_id': '67ef9254-9cf1-42ec-9270-ba8ac52d3246', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/67ef9254-9cf1-42ec-9270-ba8ac52d3246', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '485db7504a42e2b13f3cfc2bc323b168', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6150cc266690448fb00aece80506cd85', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5033178ab5973bec32539c2b14917c26d98415de6b8efbc8bc6aa11282ae101cdd9a76ea5349839c24fb35b98e7db14a78aa2aed2e6b762ddccfb66cd45bfa12', 'id': '67ef9254-9cf1-42ec-9270-ba8ac52d3246', 'created_at': datetime.datetime(2026, 7, 14, 14, 32, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 14, 32, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/67ef9254-9cf1-42ec-9270-ba8ac52d3246/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74f780ef88c0>}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:48 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-453af322-a7a9-462e-83aa-9de4f4f72814 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58cc1072-788c-4876-ba92-d99ea381207d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:48 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-453af322-a7a9-462e-83aa-9de4f4f72814 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] Volume volume-530a1353-19d0-4416-9da9-f5d11165ba30 (530a1353-19d0-4416-9da9-f5d11165ba30): created successfully
Jul 14 16:32:48 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-453af322-a7a9-462e-83aa-9de4f4f72814 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58cc1072-788c-4876-ba92-d99ea381207d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:48 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-453af322-a7a9-462e-83aa-9de4f4f72814 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] Flow 'volume_create_manager' (d77947e0-b6d8-45c9-b035-b43f8837ffa5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:32:48 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-453af322-a7a9-462e-83aa-9de4f4f72814 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] Created volume successfully.
Jul 14 16:32:49 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f4e84d83-ed1e-403e-88b5-3e7cc4a2e843 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] Acquiring lock "cinder-530a1353-19d0-4416-9da9-f5d11165ba30-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:32:49 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f4e84d83-ed1e-403e-88b5-3e7cc4a2e843 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] Lock "cinder-530a1353-19d0-4416-9da9-f5d11165ba30-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:32:49 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f4e84d83-ed1e-403e-88b5-3e7cc4a2e843 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] Acquiring lock "cinder-quobyte-530a1353-19d0-4416-9da9-f5d11165ba30" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:32:49 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f4e84d83-ed1e-403e-88b5-3e7cc4a2e843 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] Lock "cinder-quobyte-530a1353-19d0-4416-9da9-f5d11165ba30" acquired by "delete_volume" :: waited 0.024s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:32:49 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[5721795c-69f8-4a3f-8735-28f2fcf58cf8]: (4, 'raw') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:32:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f4e84d83-ed1e-403e-88b5-3e7cc4a2e843 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-530a1353-19d0-4416-9da9-f5d11165ba30 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:50 devstack sudo[98705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-530a1353-19d0-4416-9da9-f5d11165ba30
Jul 14 16:32:50 devstack sudo[98705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:50 devstack sudo[98705]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f4e84d83-ed1e-403e-88b5-3e7cc4a2e843 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-530a1353-19d0-4416-9da9-f5d11165ba30" returned: 0 in 0.522s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f4e84d83-ed1e-403e-88b5-3e7cc4a2e843 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-530a1353-19d0-4416-9da9-f5d11165ba30 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:50 devstack sudo[98709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-530a1353-19d0-4416-9da9-f5d11165ba30
Jul 14 16:32:50 devstack sudo[98709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:50 devstack sudo[98709]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f4e84d83-ed1e-403e-88b5-3e7cc4a2e843 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-530a1353-19d0-4416-9da9-f5d11165ba30" returned: 1 in 0.496s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f4e84d83-ed1e-403e-88b5-3e7cc4a2e843 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-530a1353-19d0-4416-9da9-f5d11165ba30' failed. Not Retrying. {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 16:32:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f4e84d83-ed1e-403e-88b5-3e7cc4a2e843 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-530a1353-19d0-4416-9da9-f5d11165ba30 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:50 devstack sudo[98714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-530a1353-19d0-4416-9da9-f5d11165ba30
Jul 14 16:32:50 devstack sudo[98714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:51 devstack sudo[98714]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f4e84d83-ed1e-403e-88b5-3e7cc4a2e843 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-530a1353-19d0-4416-9da9-f5d11165ba30" returned: 0 in 0.336s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:51 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f4e84d83-ed1e-403e-88b5-3e7cc4a2e843 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] Lock "cinder-quobyte-530a1353-19d0-4416-9da9-f5d11165ba30" released by "delete_volume" :: held 1.478s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:32:51 devstack cinder-volume[87166]: WARNING cinder.quota [None req-f4e84d83-ed1e-403e-88b5-3e7cc4a2e843 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Jul 14 16:32:51 devstack cinder-volume[87166]: WARNING cinder.quota [None req-f4e84d83-ed1e-403e-88b5-3e7cc4a2e843 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Jul 14 16:32:51 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-f4e84d83-ed1e-403e-88b5-3e7cc4a2e843 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] Created reservations ['bf693914-046c-4132-8f9a-5bfd1d48d376', '87f424e0-c1b5-45b1-bcef-9144ef65d7af', '9d41acb1-1639-4027-998c-99c48acc0d00', '56714d26-ea17-4d47-8403-b880d8592b73'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:32:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f4e84d83-ed1e-403e-88b5-3e7cc4a2e843 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:32:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f4e84d83-ed1e-403e-88b5-3e7cc4a2e843 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:32:51 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f4e84d83-ed1e-403e-88b5-3e7cc4a2e843 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:32:51 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f4e84d83-ed1e-403e-88b5-3e7cc4a2e843 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:32:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f4e84d83-ed1e-403e-88b5-3e7cc4a2e843 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:32:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f4e84d83-ed1e-403e-88b5-3e7cc4a2e843 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:51 devstack sudo[98717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:32:51 devstack sudo[98717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:51 devstack sudo[98717]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f4e84d83-ed1e-403e-88b5-3e7cc4a2e843 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.398s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:51 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-f4e84d83-ed1e-403e-88b5-3e7cc4a2e843 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:32:51 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-f4e84d83-ed1e-403e-88b5-3e7cc4a2e843 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] Deleted volume successfully.
Jul 14 16:32:51 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f4e84d83-ed1e-403e-88b5-3e7cc4a2e843 tempest-VolumeAndVolumeTypeFromImageTest-1610413765 None] Lock "cinder-530a1353-19d0-4416-9da9-f5d11165ba30-delete_volume" released by "delete_volume" :: held 2.176s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:32:51 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-33ca728a-1d43-4be9-802c-9e73c50e2a16 tempest-VolumesActionsTest-1397689694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:32:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-33ca728a-1d43-4be9-802c-9e73c50e2a16 tempest-VolumesActionsTest-1397689694 None] Flow 'volume_create_manager' (f2bd9cdc-8e3a-4384-8751-06344eebf4c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:32:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-33ca728a-1d43-4be9-802c-9e73c50e2a16 tempest-VolumesActionsTest-1397689694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9aa010e4-974c-4355-bd2c-18adb53d9eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-33ca728a-1d43-4be9-802c-9e73c50e2a16 tempest-VolumesActionsTest-1397689694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9aa010e4-974c-4355-bd2c-18adb53d9eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:32:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1715416421',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c1af111-f7de-48b5-bb7e-f8e09a5ce399,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f71e9f18c97a4299b23f9bb919e994bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:32:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:32:52Z,use_quota=True,user_id='778edba42f0c44dfab1d1064f861db59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-33ca728a-1d43-4be9-802c-9e73c50e2a16 tempest-VolumesActionsTest-1397689694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (156aa6f9-929a-46d5-a372-ca3689e47c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-33ca728a-1d43-4be9-802c-9e73c50e2a16 tempest-VolumesActionsTest-1397689694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (156aa6f9-929a-46d5-a372-ca3689e47c96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-33ca728a-1d43-4be9-802c-9e73c50e2a16 tempest-VolumesActionsTest-1397689694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3105217e-46a7-4276-abf0-f2edd6842283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-33ca728a-1d43-4be9-802c-9e73c50e2a16 tempest-VolumesActionsTest-1397689694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3105217e-46a7-4276-abf0-f2edd6842283) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c1af111-f7de-48b5-bb7e-f8e09a5ce399', 'volume_name': 'volume-3c1af111-f7de-48b5-bb7e-f8e09a5ce399', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-33ca728a-1d43-4be9-802c-9e73c50e2a16 tempest-VolumesActionsTest-1397689694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7958342e-8a03-49c8-a027-ede1f6e925ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-33ca728a-1d43-4be9-802c-9e73c50e2a16 tempest-VolumesActionsTest-1397689694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7958342e-8a03-49c8-a027-ede1f6e925ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-33ca728a-1d43-4be9-802c-9e73c50e2a16 tempest-VolumesActionsTest-1397689694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd478ad8-f1eb-485b-9a01-f6d31ff46fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:51 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-33ca728a-1d43-4be9-802c-9e73c50e2a16 tempest-VolumesActionsTest-1397689694 None] Volume 3c1af111-f7de-48b5-bb7e-f8e09a5ce399: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c1af111-f7de-48b5-bb7e-f8e09a5ce399', 'volume_size': 1}
Jul 14 16:32:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-33ca728a-1d43-4be9-802c-9e73c50e2a16 tempest-VolumesActionsTest-1397689694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:32:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-33ca728a-1d43-4be9-802c-9e73c50e2a16 tempest-VolumesActionsTest-1397689694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:32:51 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-33ca728a-1d43-4be9-802c-9e73c50e2a16 tempest-VolumesActionsTest-1397689694 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:32:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1715416421',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c1af111-f7de-48b5-bb7e-f8e09a5ce399,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f71e9f18c97a4299b23f9bb919e994bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:32:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:32:52Z,use_quota=True,user_id='778edba42f0c44dfab1d1064f861db59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:32:51 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-33ca728a-1d43-4be9-802c-9e73c50e2a16 tempest-VolumesActionsTest-1397689694 None] Creating volume 3c1af111-f7de-48b5-bb7e-f8e09a5ce399 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:32:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-33ca728a-1d43-4be9-802c-9e73c50e2a16 tempest-VolumesActionsTest-1397689694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:32:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-33ca728a-1d43-4be9-802c-9e73c50e2a16 tempest-VolumesActionsTest-1397689694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:32:51 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-33ca728a-1d43-4be9-802c-9e73c50e2a16 tempest-VolumesActionsTest-1397689694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:32:51 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-33ca728a-1d43-4be9-802c-9e73c50e2a16 tempest-VolumesActionsTest-1397689694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:32:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-33ca728a-1d43-4be9-802c-9e73c50e2a16 tempest-VolumesActionsTest-1397689694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:32:51 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-33ca728a-1d43-4be9-802c-9e73c50e2a16 tempest-VolumesActionsTest-1397689694 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:32:51 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-33ca728a-1d43-4be9-802c-9e73c50e2a16 tempest-VolumesActionsTest-1397689694 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:32:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-33ca728a-1d43-4be9-802c-9e73c50e2a16 tempest-VolumesActionsTest-1397689694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-3c1af111-f7de-48b5-bb7e-f8e09a5ce399 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:52 devstack sudo[98720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-3c1af111-f7de-48b5-bb7e-f8e09a5ce399 1073741824
Jul 14 16:32:52 devstack sudo[98720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:52 devstack sudo[98720]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-33ca728a-1d43-4be9-802c-9e73c50e2a16 tempest-VolumesActionsTest-1397689694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-3c1af111-f7de-48b5-bb7e-f8e09a5ce399 1073741824" returned: 0 in 0.710s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-33ca728a-1d43-4be9-802c-9e73c50e2a16 tempest-VolumesActionsTest-1397689694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-3c1af111-f7de-48b5-bb7e-f8e09a5ce399 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:52 devstack sudo[98726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-3c1af111-f7de-48b5-bb7e-f8e09a5ce399
Jul 14 16:32:52 devstack sudo[98726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:53 devstack sudo[98726]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-33ca728a-1d43-4be9-802c-9e73c50e2a16 tempest-VolumesActionsTest-1397689694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-3c1af111-f7de-48b5-bb7e-f8e09a5ce399" returned: 0 in 0.381s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:53 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-33ca728a-1d43-4be9-802c-9e73c50e2a16 tempest-VolumesActionsTest-1397689694 None] <== create_volume: return (1194ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:32:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-33ca728a-1d43-4be9-802c-9e73c50e2a16 tempest-VolumesActionsTest-1397689694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.198s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:32:53 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-33ca728a-1d43-4be9-802c-9e73c50e2a16 tempest-VolumesActionsTest-1397689694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd478ad8-f1eb-485b-9a01-f6d31ff46fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c1af111-f7de-48b5-bb7e-f8e09a5ce399', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:53 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-33ca728a-1d43-4be9-802c-9e73c50e2a16 tempest-VolumesActionsTest-1397689694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (402cca17-8eec-458b-bd8f-184818b41f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:53 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-33ca728a-1d43-4be9-802c-9e73c50e2a16 tempest-VolumesActionsTest-1397689694 None] Volume volume-3c1af111-f7de-48b5-bb7e-f8e09a5ce399 (3c1af111-f7de-48b5-bb7e-f8e09a5ce399): created successfully
Jul 14 16:32:53 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-33ca728a-1d43-4be9-802c-9e73c50e2a16 tempest-VolumesActionsTest-1397689694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (402cca17-8eec-458b-bd8f-184818b41f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:53 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-33ca728a-1d43-4be9-802c-9e73c50e2a16 tempest-VolumesActionsTest-1397689694 None] Flow 'volume_create_manager' (f2bd9cdc-8e3a-4384-8751-06344eebf4c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:32:53 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-33ca728a-1d43-4be9-802c-9e73c50e2a16 tempest-VolumesActionsTest-1397689694 None] Created volume successfully.
Jul 14 16:32:54 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-a82409ac-06b7-4a67-8f88-44ac07d50ad1 tempest-VolumesTransfersV355Test-1727580817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:32:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a82409ac-06b7-4a67-8f88-44ac07d50ad1 tempest-VolumesTransfersV355Test-1727580817 None] Flow 'volume_create_manager' (39d07fca-f44e-4e3c-99a7-649c5656c5c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:32:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a82409ac-06b7-4a67-8f88-44ac07d50ad1 tempest-VolumesTransfersV355Test-1727580817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88db7420-dfa7-40f3-8d9b-9191835533d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a82409ac-06b7-4a67-8f88-44ac07d50ad1 tempest-VolumesTransfersV355Test-1727580817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88db7420-dfa7-40f3-8d9b-9191835533d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:32:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-991349628',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47ff2af3-e98a-47c6-8c8a-878063c96024,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a6ef327a05a4c9b90d357606aafd6d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:32:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:32:54Z,use_quota=True,user_id='024dcf927f9b42a28a8b356b56b94f3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a82409ac-06b7-4a67-8f88-44ac07d50ad1 tempest-VolumesTransfersV355Test-1727580817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9e64e69-b89d-43b1-a9d4-dff6b2fa2e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a82409ac-06b7-4a67-8f88-44ac07d50ad1 tempest-VolumesTransfersV355Test-1727580817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9e64e69-b89d-43b1-a9d4-dff6b2fa2e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a82409ac-06b7-4a67-8f88-44ac07d50ad1 tempest-VolumesTransfersV355Test-1727580817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d5ef032-1655-425e-97dd-ce44fa1295ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a82409ac-06b7-4a67-8f88-44ac07d50ad1 tempest-VolumesTransfersV355Test-1727580817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d5ef032-1655-425e-97dd-ce44fa1295ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47ff2af3-e98a-47c6-8c8a-878063c96024', 'volume_name': 'volume-47ff2af3-e98a-47c6-8c8a-878063c96024', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a82409ac-06b7-4a67-8f88-44ac07d50ad1 tempest-VolumesTransfersV355Test-1727580817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52fdaf5a-2588-4114-9b9a-8471bb83f68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a82409ac-06b7-4a67-8f88-44ac07d50ad1 tempest-VolumesTransfersV355Test-1727580817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52fdaf5a-2588-4114-9b9a-8471bb83f68b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a82409ac-06b7-4a67-8f88-44ac07d50ad1 tempest-VolumesTransfersV355Test-1727580817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85065a7a-2983-42d1-a39c-b8d66bcc9489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:54 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-a82409ac-06b7-4a67-8f88-44ac07d50ad1 tempest-VolumesTransfersV355Test-1727580817 None] Volume 47ff2af3-e98a-47c6-8c8a-878063c96024: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47ff2af3-e98a-47c6-8c8a-878063c96024', 'volume_size': 1}
Jul 14 16:32:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a82409ac-06b7-4a67-8f88-44ac07d50ad1 tempest-VolumesTransfersV355Test-1727580817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:32:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a82409ac-06b7-4a67-8f88-44ac07d50ad1 tempest-VolumesTransfersV355Test-1727580817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:32:54 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a82409ac-06b7-4a67-8f88-44ac07d50ad1 tempest-VolumesTransfersV355Test-1727580817 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:32:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-991349628',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47ff2af3-e98a-47c6-8c8a-878063c96024,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a6ef327a05a4c9b90d357606aafd6d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:32:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:32:54Z,use_quota=True,user_id='024dcf927f9b42a28a8b356b56b94f3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:32:54 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-a82409ac-06b7-4a67-8f88-44ac07d50ad1 tempest-VolumesTransfersV355Test-1727580817 None] Creating volume 47ff2af3-e98a-47c6-8c8a-878063c96024 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:32:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a82409ac-06b7-4a67-8f88-44ac07d50ad1 tempest-VolumesTransfersV355Test-1727580817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:32:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a82409ac-06b7-4a67-8f88-44ac07d50ad1 tempest-VolumesTransfersV355Test-1727580817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:32:54 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a82409ac-06b7-4a67-8f88-44ac07d50ad1 tempest-VolumesTransfersV355Test-1727580817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:32:54 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a82409ac-06b7-4a67-8f88-44ac07d50ad1 tempest-VolumesTransfersV355Test-1727580817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:32:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a82409ac-06b7-4a67-8f88-44ac07d50ad1 tempest-VolumesTransfersV355Test-1727580817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:32:54 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a82409ac-06b7-4a67-8f88-44ac07d50ad1 tempest-VolumesTransfersV355Test-1727580817 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:32:54 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-a82409ac-06b7-4a67-8f88-44ac07d50ad1 tempest-VolumesTransfersV355Test-1727580817 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:32:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a82409ac-06b7-4a67-8f88-44ac07d50ad1 tempest-VolumesTransfersV355Test-1727580817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-47ff2af3-e98a-47c6-8c8a-878063c96024 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:54 devstack sudo[98729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-47ff2af3-e98a-47c6-8c8a-878063c96024 1073741824
Jul 14 16:32:54 devstack sudo[98729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:55 devstack sudo[98729]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a82409ac-06b7-4a67-8f88-44ac07d50ad1 tempest-VolumesTransfersV355Test-1727580817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-47ff2af3-e98a-47c6-8c8a-878063c96024 1073741824" returned: 0 in 0.562s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a82409ac-06b7-4a67-8f88-44ac07d50ad1 tempest-VolumesTransfersV355Test-1727580817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-47ff2af3-e98a-47c6-8c8a-878063c96024 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:55 devstack sudo[98735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-47ff2af3-e98a-47c6-8c8a-878063c96024
Jul 14 16:32:55 devstack sudo[98735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:55 devstack sudo[98735]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a82409ac-06b7-4a67-8f88-44ac07d50ad1 tempest-VolumesTransfersV355Test-1727580817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-47ff2af3-e98a-47c6-8c8a-878063c96024" returned: 0 in 0.265s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:55 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a82409ac-06b7-4a67-8f88-44ac07d50ad1 tempest-VolumesTransfersV355Test-1727580817 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:32:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a82409ac-06b7-4a67-8f88-44ac07d50ad1 tempest-VolumesTransfersV355Test-1727580817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:32:55 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a82409ac-06b7-4a67-8f88-44ac07d50ad1 tempest-VolumesTransfersV355Test-1727580817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85065a7a-2983-42d1-a39c-b8d66bcc9489) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47ff2af3-e98a-47c6-8c8a-878063c96024', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:55 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a82409ac-06b7-4a67-8f88-44ac07d50ad1 tempest-VolumesTransfersV355Test-1727580817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f63818b8-bac9-4a8d-8669-51de2557dd2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:55 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-a82409ac-06b7-4a67-8f88-44ac07d50ad1 tempest-VolumesTransfersV355Test-1727580817 None] Volume volume-47ff2af3-e98a-47c6-8c8a-878063c96024 (47ff2af3-e98a-47c6-8c8a-878063c96024): created successfully
Jul 14 16:32:55 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a82409ac-06b7-4a67-8f88-44ac07d50ad1 tempest-VolumesTransfersV355Test-1727580817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f63818b8-bac9-4a8d-8669-51de2557dd2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:55 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a82409ac-06b7-4a67-8f88-44ac07d50ad1 tempest-VolumesTransfersV355Test-1727580817 None] Flow 'volume_create_manager' (39d07fca-f44e-4e3c-99a7-649c5656c5c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:32:55 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-a82409ac-06b7-4a67-8f88-44ac07d50ad1 tempest-VolumesTransfersV355Test-1727580817 None] Created volume successfully.
Jul 14 16:32:57 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-b4d0766c-3cc4-42c2-94a4-d80db18cb27d tempest-VolumesTransfersV355Test-153248407 None] Transfer volume completed successfully.
Jul 14 16:32:58 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4d5210d-9d91-4c24-a1f3-931126202c0f tempest-CreateVolumesFromImageTest-1083614734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:32:58 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f4d5210d-9d91-4c24-a1f3-931126202c0f tempest-CreateVolumesFromImageTest-1083614734 None] Flow 'volume_create_manager' (8deaceb8-eb9b-4976-8301-f198c88fc2da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:32:58 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f4d5210d-9d91-4c24-a1f3-931126202c0f tempest-CreateVolumesFromImageTest-1083614734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52b453d3-59d3-47e7-aa3d-12e845e5102b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:58 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f4d5210d-9d91-4c24-a1f3-931126202c0f tempest-CreateVolumesFromImageTest-1083614734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52b453d3-59d3-47e7-aa3d-12e845e5102b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:32:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-138854286',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9815071-e48a-4b15-b48b-8d5bda59dea9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff932e4c5e334586a4e350025f9a4355',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:32:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:32:58Z,use_quota=True,user_id='624e59eaea3b42f29a5e12444710f045',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:58 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f4d5210d-9d91-4c24-a1f3-931126202c0f tempest-CreateVolumesFromImageTest-1083614734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b88ce60-2676-4694-99a3-9af4359550da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:58 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f4d5210d-9d91-4c24-a1f3-931126202c0f tempest-CreateVolumesFromImageTest-1083614734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b88ce60-2676-4694-99a3-9af4359550da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:58 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f4d5210d-9d91-4c24-a1f3-931126202c0f tempest-CreateVolumesFromImageTest-1083614734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f11789d1-e90d-4c1b-8b4c-c513792a8c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:58 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f4d5210d-9d91-4c24-a1f3-931126202c0f tempest-CreateVolumesFromImageTest-1083614734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f11789d1-e90d-4c1b-8b4c-c513792a8c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9815071-e48a-4b15-b48b-8d5bda59dea9', 'volume_name': 'volume-f9815071-e48a-4b15-b48b-8d5bda59dea9', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:58 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f4d5210d-9d91-4c24-a1f3-931126202c0f tempest-CreateVolumesFromImageTest-1083614734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (690fc3d7-4b96-43ff-83ee-31064bbb8550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:58 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f4d5210d-9d91-4c24-a1f3-931126202c0f tempest-CreateVolumesFromImageTest-1083614734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (690fc3d7-4b96-43ff-83ee-31064bbb8550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:58 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f4d5210d-9d91-4c24-a1f3-931126202c0f tempest-CreateVolumesFromImageTest-1083614734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43bc51f1-dce3-42ab-9169-0ac431abd1c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:58 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-f4d5210d-9d91-4c24-a1f3-931126202c0f tempest-CreateVolumesFromImageTest-1083614734 None] Volume f9815071-e48a-4b15-b48b-8d5bda59dea9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9815071-e48a-4b15-b48b-8d5bda59dea9', 'volume_size': 1}
Jul 14 16:32:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f4d5210d-9d91-4c24-a1f3-931126202c0f tempest-CreateVolumesFromImageTest-1083614734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:32:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f4d5210d-9d91-4c24-a1f3-931126202c0f tempest-CreateVolumesFromImageTest-1083614734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:32:58 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f4d5210d-9d91-4c24-a1f3-931126202c0f tempest-CreateVolumesFromImageTest-1083614734 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:32:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-138854286',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9815071-e48a-4b15-b48b-8d5bda59dea9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff932e4c5e334586a4e350025f9a4355',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:32:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:32:58Z,use_quota=True,user_id='624e59eaea3b42f29a5e12444710f045',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:32:58 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-f4d5210d-9d91-4c24-a1f3-931126202c0f tempest-CreateVolumesFromImageTest-1083614734 None] Creating volume f9815071-e48a-4b15-b48b-8d5bda59dea9 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:32:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f4d5210d-9d91-4c24-a1f3-931126202c0f tempest-CreateVolumesFromImageTest-1083614734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:32:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f4d5210d-9d91-4c24-a1f3-931126202c0f tempest-CreateVolumesFromImageTest-1083614734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:32:58 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f4d5210d-9d91-4c24-a1f3-931126202c0f tempest-CreateVolumesFromImageTest-1083614734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:32:58 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f4d5210d-9d91-4c24-a1f3-931126202c0f tempest-CreateVolumesFromImageTest-1083614734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:32:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f4d5210d-9d91-4c24-a1f3-931126202c0f tempest-CreateVolumesFromImageTest-1083614734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:32:58 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f4d5210d-9d91-4c24-a1f3-931126202c0f tempest-CreateVolumesFromImageTest-1083614734 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:32:58 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-f4d5210d-9d91-4c24-a1f3-931126202c0f tempest-CreateVolumesFromImageTest-1083614734 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:32:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f4d5210d-9d91-4c24-a1f3-931126202c0f tempest-CreateVolumesFromImageTest-1083614734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f9815071-e48a-4b15-b48b-8d5bda59dea9 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:58 devstack sudo[98752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f9815071-e48a-4b15-b48b-8d5bda59dea9 1073741824
Jul 14 16:32:58 devstack sudo[98752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:32:59 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f83dd18c-6c58-4d55-9aa6-8e356e39ab90 tempest-VolumesTransfersV355Test-887425671 None] Acquiring lock "cinder-47ff2af3-e98a-47c6-8c8a-878063c96024-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:32:59 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f83dd18c-6c58-4d55-9aa6-8e356e39ab90 tempest-VolumesTransfersV355Test-887425671 None] Lock "cinder-47ff2af3-e98a-47c6-8c8a-878063c96024-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:32:59 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-af4a4800-dc87-4b14-b6f7-91d8b5d253d2 tempest-CreateVolumesFromImageTest-1083614734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:32:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-af4a4800-dc87-4b14-b6f7-91d8b5d253d2 tempest-CreateVolumesFromImageTest-1083614734 None] Flow 'volume_create_manager' (ca887ac7-61b1-43f6-aba8-84b90457ea20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:32:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-af4a4800-dc87-4b14-b6f7-91d8b5d253d2 tempest-CreateVolumesFromImageTest-1083614734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (680f9aea-8fbd-4bb1-a9e0-068dbdf34cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:59 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f83dd18c-6c58-4d55-9aa6-8e356e39ab90 tempest-VolumesTransfersV355Test-887425671 None] Acquiring lock "cinder-quobyte-47ff2af3-e98a-47c6-8c8a-878063c96024" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:32:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-af4a4800-dc87-4b14-b6f7-91d8b5d253d2 tempest-CreateVolumesFromImageTest-1083614734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (680f9aea-8fbd-4bb1-a9e0-068dbdf34cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:32:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-217941773',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36b3a3e4-26f9-479b-9061-d09aa0f2bf86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff932e4c5e334586a4e350025f9a4355',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:32:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:32:59Z,use_quota=True,user_id='624e59eaea3b42f29a5e12444710f045',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-af4a4800-dc87-4b14-b6f7-91d8b5d253d2 tempest-CreateVolumesFromImageTest-1083614734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46adc40f-dc07-4d80-8889-b08e3805df3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-af4a4800-dc87-4b14-b6f7-91d8b5d253d2 tempest-CreateVolumesFromImageTest-1083614734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46adc40f-dc07-4d80-8889-b08e3805df3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:59 devstack sudo[98752]: pam_unix(sudo:session): session closed for user root
Jul 14 16:32:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-af4a4800-dc87-4b14-b6f7-91d8b5d253d2 tempest-CreateVolumesFromImageTest-1083614734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e990fc63-e55f-4530-82aa-21ba4d738c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-af4a4800-dc87-4b14-b6f7-91d8b5d253d2 tempest-CreateVolumesFromImageTest-1083614734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e990fc63-e55f-4530-82aa-21ba4d738c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36b3a3e4-26f9-479b-9061-d09aa0f2bf86', 'volume_name': 'volume-36b3a3e4-26f9-479b-9061-d09aa0f2bf86', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-af4a4800-dc87-4b14-b6f7-91d8b5d253d2 tempest-CreateVolumesFromImageTest-1083614734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af34e25d-4602-429e-b232-7b97b8e11117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-af4a4800-dc87-4b14-b6f7-91d8b5d253d2 tempest-CreateVolumesFromImageTest-1083614734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af34e25d-4602-429e-b232-7b97b8e11117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:32:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-af4a4800-dc87-4b14-b6f7-91d8b5d253d2 tempest-CreateVolumesFromImageTest-1083614734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73b89eaa-1652-4980-8f0e-ee2ab466d21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:32:59 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-af4a4800-dc87-4b14-b6f7-91d8b5d253d2 tempest-CreateVolumesFromImageTest-1083614734 None] Volume 36b3a3e4-26f9-479b-9061-d09aa0f2bf86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36b3a3e4-26f9-479b-9061-d09aa0f2bf86', 'volume_size': 1}
Jul 14 16:32:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-af4a4800-dc87-4b14-b6f7-91d8b5d253d2 tempest-CreateVolumesFromImageTest-1083614734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:32:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f4d5210d-9d91-4c24-a1f3-931126202c0f tempest-CreateVolumesFromImageTest-1083614734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f9815071-e48a-4b15-b48b-8d5bda59dea9 1073741824" returned: 0 in 1.024s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:32:59 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f83dd18c-6c58-4d55-9aa6-8e356e39ab90 tempest-VolumesTransfersV355Test-887425671 None] Lock "cinder-quobyte-47ff2af3-e98a-47c6-8c8a-878063c96024" acquired by "delete_volume" :: waited 0.113s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:32:59 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[a47a599b-5fc6-42e9-b2ec-5064c79082ea]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:32:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f83dd18c-6c58-4d55-9aa6-8e356e39ab90 tempest-VolumesTransfersV355Test-887425671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-47ff2af3-e98a-47c6-8c8a-878063c96024 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f4d5210d-9d91-4c24-a1f3-931126202c0f tempest-CreateVolumesFromImageTest-1083614734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f9815071-e48a-4b15-b48b-8d5bda59dea9 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:32:59 devstack sudo[98768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f9815071-e48a-4b15-b48b-8d5bda59dea9
Jul 14 16:32:59 devstack sudo[98768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:00 devstack sudo[98767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-47ff2af3-e98a-47c6-8c8a-878063c96024
Jul 14 16:33:00 devstack sudo[98767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:00 devstack sudo[98768]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f4d5210d-9d91-4c24-a1f3-931126202c0f tempest-CreateVolumesFromImageTest-1083614734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f9815071-e48a-4b15-b48b-8d5bda59dea9" returned: 0 in 0.287s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:00 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f4d5210d-9d91-4c24-a1f3-931126202c0f tempest-CreateVolumesFromImageTest-1083614734 None] <== create_volume: return (1476ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:33:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f4d5210d-9d91-4c24-a1f3-931126202c0f tempest-CreateVolumesFromImageTest-1083614734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.482s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:33:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-af4a4800-dc87-4b14-b6f7-91d8b5d253d2 tempest-CreateVolumesFromImageTest-1083614734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.449s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:33:00 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-af4a4800-dc87-4b14-b6f7-91d8b5d253d2 tempest-CreateVolumesFromImageTest-1083614734 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:32:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-217941773',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36b3a3e4-26f9-479b-9061-d09aa0f2bf86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff932e4c5e334586a4e350025f9a4355',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:32:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:32:59Z,use_quota=True,user_id='624e59eaea3b42f29a5e12444710f045',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:33:00 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-af4a4800-dc87-4b14-b6f7-91d8b5d253d2 tempest-CreateVolumesFromImageTest-1083614734 None] Creating volume 36b3a3e4-26f9-479b-9061-d09aa0f2bf86 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:33:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-af4a4800-dc87-4b14-b6f7-91d8b5d253d2 tempest-CreateVolumesFromImageTest-1083614734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:33:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-af4a4800-dc87-4b14-b6f7-91d8b5d253d2 tempest-CreateVolumesFromImageTest-1083614734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:33:00 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-af4a4800-dc87-4b14-b6f7-91d8b5d253d2 tempest-CreateVolumesFromImageTest-1083614734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:33:00 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-af4a4800-dc87-4b14-b6f7-91d8b5d253d2 tempest-CreateVolumesFromImageTest-1083614734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:33:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-af4a4800-dc87-4b14-b6f7-91d8b5d253d2 tempest-CreateVolumesFromImageTest-1083614734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:33:00 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-af4a4800-dc87-4b14-b6f7-91d8b5d253d2 tempest-CreateVolumesFromImageTest-1083614734 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:33:00 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-af4a4800-dc87-4b14-b6f7-91d8b5d253d2 tempest-CreateVolumesFromImageTest-1083614734 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:33:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-af4a4800-dc87-4b14-b6f7-91d8b5d253d2 tempest-CreateVolumesFromImageTest-1083614734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-36b3a3e4-26f9-479b-9061-d09aa0f2bf86 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:00 devstack sudo[98772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-36b3a3e4-26f9-479b-9061-d09aa0f2bf86 1073741824
Jul 14 16:33:00 devstack sudo[98772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f4d5210d-9d91-4c24-a1f3-931126202c0f tempest-CreateVolumesFromImageTest-1083614734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43bc51f1-dce3-42ab-9169-0ac431abd1c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9815071-e48a-4b15-b48b-8d5bda59dea9', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f4d5210d-9d91-4c24-a1f3-931126202c0f tempest-CreateVolumesFromImageTest-1083614734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6090782f-02af-40c4-b45d-593e49725f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:00 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-f4d5210d-9d91-4c24-a1f3-931126202c0f tempest-CreateVolumesFromImageTest-1083614734 None] Volume volume-f9815071-e48a-4b15-b48b-8d5bda59dea9 (f9815071-e48a-4b15-b48b-8d5bda59dea9): created successfully
Jul 14 16:33:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f4d5210d-9d91-4c24-a1f3-931126202c0f tempest-CreateVolumesFromImageTest-1083614734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6090782f-02af-40c4-b45d-593e49725f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f4d5210d-9d91-4c24-a1f3-931126202c0f tempest-CreateVolumesFromImageTest-1083614734 None] Flow 'volume_create_manager' (8deaceb8-eb9b-4976-8301-f198c88fc2da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:33:00 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-9359454f-0e4c-4553-8d07-b20bbae72c99 tempest-CreateVolumesFromImageTest-1083614734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:33:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9359454f-0e4c-4553-8d07-b20bbae72c99 tempest-CreateVolumesFromImageTest-1083614734 None] Flow 'volume_create_manager' (8fc5f4e6-7c1a-4b79-b43b-c512168e67f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:33:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9359454f-0e4c-4553-8d07-b20bbae72c99 tempest-CreateVolumesFromImageTest-1083614734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a13848ca-b3db-4664-8019-c03f7e0671f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:00 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-f4d5210d-9d91-4c24-a1f3-931126202c0f tempest-CreateVolumesFromImageTest-1083614734 None] Created volume successfully.
Jul 14 16:33:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9359454f-0e4c-4553-8d07-b20bbae72c99 tempest-CreateVolumesFromImageTest-1083614734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a13848ca-b3db-4664-8019-c03f7e0671f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:33:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1239097394',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb89c332-1b3d-4ece-81b0-fecedb765a72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff932e4c5e334586a4e350025f9a4355',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:33:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:33:00Z,use_quota=True,user_id='624e59eaea3b42f29a5e12444710f045',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9359454f-0e4c-4553-8d07-b20bbae72c99 tempest-CreateVolumesFromImageTest-1083614734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d872e621-f1f9-476a-b086-13d7fdee8d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9359454f-0e4c-4553-8d07-b20bbae72c99 tempest-CreateVolumesFromImageTest-1083614734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d872e621-f1f9-476a-b086-13d7fdee8d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9359454f-0e4c-4553-8d07-b20bbae72c99 tempest-CreateVolumesFromImageTest-1083614734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c66eec6-5f70-436f-a60f-07df82f30b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9359454f-0e4c-4553-8d07-b20bbae72c99 tempest-CreateVolumesFromImageTest-1083614734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c66eec6-5f70-436f-a60f-07df82f30b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb89c332-1b3d-4ece-81b0-fecedb765a72', 'volume_name': 'volume-eb89c332-1b3d-4ece-81b0-fecedb765a72', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9359454f-0e4c-4553-8d07-b20bbae72c99 tempest-CreateVolumesFromImageTest-1083614734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfdf9107-f823-4061-8ac6-3f9d71c582e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9359454f-0e4c-4553-8d07-b20bbae72c99 tempest-CreateVolumesFromImageTest-1083614734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfdf9107-f823-4061-8ac6-3f9d71c582e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9359454f-0e4c-4553-8d07-b20bbae72c99 tempest-CreateVolumesFromImageTest-1083614734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4cc524a-567a-42f4-8d51-08d289bd4169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:00 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-9359454f-0e4c-4553-8d07-b20bbae72c99 tempest-CreateVolumesFromImageTest-1083614734 None] Volume eb89c332-1b3d-4ece-81b0-fecedb765a72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb89c332-1b3d-4ece-81b0-fecedb765a72', 'volume_size': 1}
Jul 14 16:33:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9359454f-0e4c-4553-8d07-b20bbae72c99 tempest-CreateVolumesFromImageTest-1083614734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:33:00 devstack sudo[98767]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f83dd18c-6c58-4d55-9aa6-8e356e39ab90 tempest-VolumesTransfersV355Test-887425671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-47ff2af3-e98a-47c6-8c8a-878063c96024" returned: 0 in 0.859s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f83dd18c-6c58-4d55-9aa6-8e356e39ab90 tempest-VolumesTransfersV355Test-887425671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-47ff2af3-e98a-47c6-8c8a-878063c96024 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:00 devstack sudo[98781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-47ff2af3-e98a-47c6-8c8a-878063c96024
Jul 14 16:33:00 devstack sudo[98781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:00 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e37398d-54b1-4bcf-a358-2c3b6013cf7f tempest-CreateVolumesFromImageTest-1083614734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:33:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3e37398d-54b1-4bcf-a358-2c3b6013cf7f tempest-CreateVolumesFromImageTest-1083614734 None] Flow 'volume_create_manager' (8f5365b0-12fc-4936-b1f4-af64afc2a54f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:33:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3e37398d-54b1-4bcf-a358-2c3b6013cf7f tempest-CreateVolumesFromImageTest-1083614734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20c300c4-a2ad-4aa6-b626-1e63ae3368ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3e37398d-54b1-4bcf-a358-2c3b6013cf7f tempest-CreateVolumesFromImageTest-1083614734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20c300c4-a2ad-4aa6-b626-1e63ae3368ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:33:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-401725949',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eccb5c4e-a50c-4912-a6a4-fd7312f0a063,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff932e4c5e334586a4e350025f9a4355',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:33:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:33:01Z,use_quota=True,user_id='624e59eaea3b42f29a5e12444710f045',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3e37398d-54b1-4bcf-a358-2c3b6013cf7f tempest-CreateVolumesFromImageTest-1083614734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7a22a9a-bf65-49a7-9ea6-c93923b170bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3e37398d-54b1-4bcf-a358-2c3b6013cf7f tempest-CreateVolumesFromImageTest-1083614734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7a22a9a-bf65-49a7-9ea6-c93923b170bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3e37398d-54b1-4bcf-a358-2c3b6013cf7f tempest-CreateVolumesFromImageTest-1083614734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6ee95a1-9241-448b-ab4b-97872b074119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:00 devstack sudo[98772]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3e37398d-54b1-4bcf-a358-2c3b6013cf7f tempest-CreateVolumesFromImageTest-1083614734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6ee95a1-9241-448b-ab4b-97872b074119) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eccb5c4e-a50c-4912-a6a4-fd7312f0a063', 'volume_name': 'volume-eccb5c4e-a50c-4912-a6a4-fd7312f0a063', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3e37398d-54b1-4bcf-a358-2c3b6013cf7f tempest-CreateVolumesFromImageTest-1083614734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52c7163b-c0bf-4f01-92a3-80e430e07387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3e37398d-54b1-4bcf-a358-2c3b6013cf7f tempest-CreateVolumesFromImageTest-1083614734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52c7163b-c0bf-4f01-92a3-80e430e07387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3e37398d-54b1-4bcf-a358-2c3b6013cf7f tempest-CreateVolumesFromImageTest-1083614734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4c8ea1c-c354-4d95-96f3-b3ee323df579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:00 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-3e37398d-54b1-4bcf-a358-2c3b6013cf7f tempest-CreateVolumesFromImageTest-1083614734 None] Volume eccb5c4e-a50c-4912-a6a4-fd7312f0a063: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eccb5c4e-a50c-4912-a6a4-fd7312f0a063', 'volume_size': 1}
Jul 14 16:33:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3e37398d-54b1-4bcf-a358-2c3b6013cf7f tempest-CreateVolumesFromImageTest-1083614734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:33:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-af4a4800-dc87-4b14-b6f7-91d8b5d253d2 tempest-CreateVolumesFromImageTest-1083614734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-36b3a3e4-26f9-479b-9061-d09aa0f2bf86 1073741824" returned: 0 in 0.853s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-af4a4800-dc87-4b14-b6f7-91d8b5d253d2 tempest-CreateVolumesFromImageTest-1083614734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-36b3a3e4-26f9-479b-9061-d09aa0f2bf86 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:01 devstack sudo[98784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-36b3a3e4-26f9-479b-9061-d09aa0f2bf86
Jul 14 16:33:01 devstack sudo[98784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:01 devstack sudo[98781]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f83dd18c-6c58-4d55-9aa6-8e356e39ab90 tempest-VolumesTransfersV355Test-887425671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-47ff2af3-e98a-47c6-8c8a-878063c96024" returned: 0 in 0.628s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:01 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f83dd18c-6c58-4d55-9aa6-8e356e39ab90 tempest-VolumesTransfersV355Test-887425671 None] Lock "cinder-quobyte-47ff2af3-e98a-47c6-8c8a-878063c96024" released by "delete_volume" :: held 1.586s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:33:01 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-f83dd18c-6c58-4d55-9aa6-8e356e39ab90 tempest-VolumesTransfersV355Test-887425671 None] Created reservations ['1b2ef75e-be1b-4d57-95cf-786b218007f5', '167415cd-50ef-40c9-a56f-a2d7667bb41b', '63941a70-7d4e-407b-a060-81295c2bf4ee', '689b708b-6325-4cb1-8518-ef4d99f2fef5'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:33:01 devstack sudo[98784]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-af4a4800-dc87-4b14-b6f7-91d8b5d253d2 tempest-CreateVolumesFromImageTest-1083614734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-36b3a3e4-26f9-479b-9061-d09aa0f2bf86" returned: 0 in 0.397s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:01 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-af4a4800-dc87-4b14-b6f7-91d8b5d253d2 tempest-CreateVolumesFromImageTest-1083614734 None] <== create_volume: return (1331ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:33:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-af4a4800-dc87-4b14-b6f7-91d8b5d253d2 tempest-CreateVolumesFromImageTest-1083614734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.336s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:33:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9359454f-0e4c-4553-8d07-b20bbae72c99 tempest-CreateVolumesFromImageTest-1083614734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.052s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:33:01 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-9359454f-0e4c-4553-8d07-b20bbae72c99 tempest-CreateVolumesFromImageTest-1083614734 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:33:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1239097394',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb89c332-1b3d-4ece-81b0-fecedb765a72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff932e4c5e334586a4e350025f9a4355',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:33:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:33:00Z,use_quota=True,user_id='624e59eaea3b42f29a5e12444710f045',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:33:01 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-9359454f-0e4c-4553-8d07-b20bbae72c99 tempest-CreateVolumesFromImageTest-1083614734 None] Creating volume eb89c332-1b3d-4ece-81b0-fecedb765a72 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:33:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9359454f-0e4c-4553-8d07-b20bbae72c99 tempest-CreateVolumesFromImageTest-1083614734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:33:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9359454f-0e4c-4553-8d07-b20bbae72c99 tempest-CreateVolumesFromImageTest-1083614734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:33:01 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-9359454f-0e4c-4553-8d07-b20bbae72c99 tempest-CreateVolumesFromImageTest-1083614734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:33:01 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-9359454f-0e4c-4553-8d07-b20bbae72c99 tempest-CreateVolumesFromImageTest-1083614734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:33:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9359454f-0e4c-4553-8d07-b20bbae72c99 tempest-CreateVolumesFromImageTest-1083614734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:33:01 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-9359454f-0e4c-4553-8d07-b20bbae72c99 tempest-CreateVolumesFromImageTest-1083614734 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:33:01 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-9359454f-0e4c-4553-8d07-b20bbae72c99 tempest-CreateVolumesFromImageTest-1083614734 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:33:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9359454f-0e4c-4553-8d07-b20bbae72c99 tempest-CreateVolumesFromImageTest-1083614734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-eb89c332-1b3d-4ece-81b0-fecedb765a72 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:01 devstack sudo[98788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-eb89c332-1b3d-4ece-81b0-fecedb765a72 1073741824
Jul 14 16:33:01 devstack sudo[98788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-af4a4800-dc87-4b14-b6f7-91d8b5d253d2 tempest-CreateVolumesFromImageTest-1083614734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73b89eaa-1652-4980-8f0e-ee2ab466d21d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36b3a3e4-26f9-479b-9061-d09aa0f2bf86', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-af4a4800-dc87-4b14-b6f7-91d8b5d253d2 tempest-CreateVolumesFromImageTest-1083614734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (025ec4b8-7ebe-4926-9397-20dbbb05d470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f83dd18c-6c58-4d55-9aa6-8e356e39ab90 tempest-VolumesTransfersV355Test-887425671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:33:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f83dd18c-6c58-4d55-9aa6-8e356e39ab90 tempest-VolumesTransfersV355Test-887425671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:33:01 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f83dd18c-6c58-4d55-9aa6-8e356e39ab90 tempest-VolumesTransfersV355Test-887425671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:33:01 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f83dd18c-6c58-4d55-9aa6-8e356e39ab90 tempest-VolumesTransfersV355Test-887425671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:33:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f83dd18c-6c58-4d55-9aa6-8e356e39ab90 tempest-VolumesTransfersV355Test-887425671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:33:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f83dd18c-6c58-4d55-9aa6-8e356e39ab90 tempest-VolumesTransfersV355Test-887425671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:01 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-af4a4800-dc87-4b14-b6f7-91d8b5d253d2 tempest-CreateVolumesFromImageTest-1083614734 None] Volume volume-36b3a3e4-26f9-479b-9061-d09aa0f2bf86 (36b3a3e4-26f9-479b-9061-d09aa0f2bf86): created successfully
Jul 14 16:33:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-af4a4800-dc87-4b14-b6f7-91d8b5d253d2 tempest-CreateVolumesFromImageTest-1083614734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (025ec4b8-7ebe-4926-9397-20dbbb05d470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-af4a4800-dc87-4b14-b6f7-91d8b5d253d2 tempest-CreateVolumesFromImageTest-1083614734 None] Flow 'volume_create_manager' (ca887ac7-61b1-43f6-aba8-84b90457ea20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:33:01 devstack sudo[98790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:33:01 devstack sudo[98790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:01 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-af4a4800-dc87-4b14-b6f7-91d8b5d253d2 tempest-CreateVolumesFromImageTest-1083614734 None] Created volume successfully.
Jul 14 16:33:01 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-02956405-b894-4dd7-bf1f-ee2814256140 tempest-CreateVolumesFromImageTest-1083614734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:33:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-02956405-b894-4dd7-bf1f-ee2814256140 tempest-CreateVolumesFromImageTest-1083614734 None] Flow 'volume_create_manager' (549c6dc7-e69f-4f5b-a0a6-8ee97a1d4548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:33:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-02956405-b894-4dd7-bf1f-ee2814256140 tempest-CreateVolumesFromImageTest-1083614734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b35cde98-8356-421f-b6f2-268f39c22c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-02956405-b894-4dd7-bf1f-ee2814256140 tempest-CreateVolumesFromImageTest-1083614734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b35cde98-8356-421f-b6f2-268f39c22c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:33:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-871851988',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18ee7421-4275-410c-aac1-7af6cca3916a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff932e4c5e334586a4e350025f9a4355',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:33:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:33:01Z,use_quota=True,user_id='624e59eaea3b42f29a5e12444710f045',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-02956405-b894-4dd7-bf1f-ee2814256140 tempest-CreateVolumesFromImageTest-1083614734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3472bf53-950d-4e48-95a4-7bf1dbc61315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-02956405-b894-4dd7-bf1f-ee2814256140 tempest-CreateVolumesFromImageTest-1083614734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3472bf53-950d-4e48-95a4-7bf1dbc61315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-02956405-b894-4dd7-bf1f-ee2814256140 tempest-CreateVolumesFromImageTest-1083614734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4834f4f6-afd3-4ab1-91a7-70ffb5f0ddc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-02956405-b894-4dd7-bf1f-ee2814256140 tempest-CreateVolumesFromImageTest-1083614734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4834f4f6-afd3-4ab1-91a7-70ffb5f0ddc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18ee7421-4275-410c-aac1-7af6cca3916a', 'volume_name': 'volume-18ee7421-4275-410c-aac1-7af6cca3916a', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-02956405-b894-4dd7-bf1f-ee2814256140 tempest-CreateVolumesFromImageTest-1083614734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcf4f0dd-4f69-41e8-8685-ca4d16bcf88b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-02956405-b894-4dd7-bf1f-ee2814256140 tempest-CreateVolumesFromImageTest-1083614734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcf4f0dd-4f69-41e8-8685-ca4d16bcf88b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-02956405-b894-4dd7-bf1f-ee2814256140 tempest-CreateVolumesFromImageTest-1083614734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21022f5f-0321-4c3a-8226-b9269a1261e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:02 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-02956405-b894-4dd7-bf1f-ee2814256140 tempest-CreateVolumesFromImageTest-1083614734 None] Volume 18ee7421-4275-410c-aac1-7af6cca3916a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18ee7421-4275-410c-aac1-7af6cca3916a', 'volume_size': 1}
Jul 14 16:33:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-02956405-b894-4dd7-bf1f-ee2814256140 tempest-CreateVolumesFromImageTest-1083614734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:33:02 devstack sudo[98788]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9359454f-0e4c-4553-8d07-b20bbae72c99 tempest-CreateVolumesFromImageTest-1083614734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-eb89c332-1b3d-4ece-81b0-fecedb765a72 1073741824" returned: 0 in 0.748s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:02 devstack sudo[98790]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f83dd18c-6c58-4d55-9aa6-8e356e39ab90 tempest-VolumesTransfersV355Test-887425671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.491s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:02 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-f83dd18c-6c58-4d55-9aa6-8e356e39ab90 tempest-VolumesTransfersV355Test-887425671 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:33:02 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-f83dd18c-6c58-4d55-9aa6-8e356e39ab90 tempest-VolumesTransfersV355Test-887425671 None] Deleted volume successfully.
Jul 14 16:33:02 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f83dd18c-6c58-4d55-9aa6-8e356e39ab90 tempest-VolumesTransfersV355Test-887425671 None] Lock "cinder-47ff2af3-e98a-47c6-8c8a-878063c96024-delete_volume" released by "delete_volume" :: held 2.909s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:33:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9359454f-0e4c-4553-8d07-b20bbae72c99 tempest-CreateVolumesFromImageTest-1083614734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-eb89c332-1b3d-4ece-81b0-fecedb765a72 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:02 devstack sudo[98797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-eb89c332-1b3d-4ece-81b0-fecedb765a72
Jul 14 16:33:02 devstack sudo[98797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:02 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-a394b04a-65a7-48bc-a934-e75c1243eec7 tempest-VolumesTransfersV355Test-1727580817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:33:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a394b04a-65a7-48bc-a934-e75c1243eec7 tempest-VolumesTransfersV355Test-1727580817 None] Flow 'volume_create_manager' (57ffba67-53b9-437e-a999-ff9145dfb1d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:33:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a394b04a-65a7-48bc-a934-e75c1243eec7 tempest-VolumesTransfersV355Test-1727580817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd7b3323-1448-410a-95a6-b251a3c75061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a394b04a-65a7-48bc-a934-e75c1243eec7 tempest-VolumesTransfersV355Test-1727580817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd7b3323-1448-410a-95a6-b251a3c75061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:33:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-391744792',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=234b4f26-df2f-4e8d-9d48-10e7b3c5b290,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a6ef327a05a4c9b90d357606aafd6d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:33:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:33:02Z,use_quota=True,user_id='024dcf927f9b42a28a8b356b56b94f3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a394b04a-65a7-48bc-a934-e75c1243eec7 tempest-VolumesTransfersV355Test-1727580817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea23d0d6-a872-4417-a3bc-600ccc48c46e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a394b04a-65a7-48bc-a934-e75c1243eec7 tempest-VolumesTransfersV355Test-1727580817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea23d0d6-a872-4417-a3bc-600ccc48c46e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a394b04a-65a7-48bc-a934-e75c1243eec7 tempest-VolumesTransfersV355Test-1727580817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37fbd1a3-fd0b-4054-bea4-7f7deb50731a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a394b04a-65a7-48bc-a934-e75c1243eec7 tempest-VolumesTransfersV355Test-1727580817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37fbd1a3-fd0b-4054-bea4-7f7deb50731a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '234b4f26-df2f-4e8d-9d48-10e7b3c5b290', 'volume_name': 'volume-234b4f26-df2f-4e8d-9d48-10e7b3c5b290', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a394b04a-65a7-48bc-a934-e75c1243eec7 tempest-VolumesTransfersV355Test-1727580817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bada135-6cf3-4596-8bb0-ef41a2621627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a394b04a-65a7-48bc-a934-e75c1243eec7 tempest-VolumesTransfersV355Test-1727580817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bada135-6cf3-4596-8bb0-ef41a2621627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:02 devstack sudo[98797]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a394b04a-65a7-48bc-a934-e75c1243eec7 tempest-VolumesTransfersV355Test-1727580817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68d5db04-1dfc-41c9-a5f9-1f10ee9c3d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:02 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-a394b04a-65a7-48bc-a934-e75c1243eec7 tempest-VolumesTransfersV355Test-1727580817 None] Volume 234b4f26-df2f-4e8d-9d48-10e7b3c5b290: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-234b4f26-df2f-4e8d-9d48-10e7b3c5b290', 'volume_size': 1}
Jul 14 16:33:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a394b04a-65a7-48bc-a934-e75c1243eec7 tempest-VolumesTransfersV355Test-1727580817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:33:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9359454f-0e4c-4553-8d07-b20bbae72c99 tempest-CreateVolumesFromImageTest-1083614734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-eb89c332-1b3d-4ece-81b0-fecedb765a72" returned: 0 in 0.376s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:02 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-9359454f-0e4c-4553-8d07-b20bbae72c99 tempest-CreateVolumesFromImageTest-1083614734 None] <== create_volume: return (1242ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:33:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9359454f-0e4c-4553-8d07-b20bbae72c99 tempest-CreateVolumesFromImageTest-1083614734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.245s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:33:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3e37398d-54b1-4bcf-a358-2c3b6013cf7f tempest-CreateVolumesFromImageTest-1083614734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.716s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:33:02 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-3e37398d-54b1-4bcf-a358-2c3b6013cf7f tempest-CreateVolumesFromImageTest-1083614734 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:33:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-401725949',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eccb5c4e-a50c-4912-a6a4-fd7312f0a063,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff932e4c5e334586a4e350025f9a4355',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:33:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:33:01Z,use_quota=True,user_id='624e59eaea3b42f29a5e12444710f045',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:33:02 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-3e37398d-54b1-4bcf-a358-2c3b6013cf7f tempest-CreateVolumesFromImageTest-1083614734 None] Creating volume eccb5c4e-a50c-4912-a6a4-fd7312f0a063 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:33:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3e37398d-54b1-4bcf-a358-2c3b6013cf7f tempest-CreateVolumesFromImageTest-1083614734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:33:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3e37398d-54b1-4bcf-a358-2c3b6013cf7f tempest-CreateVolumesFromImageTest-1083614734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:33:02 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-3e37398d-54b1-4bcf-a358-2c3b6013cf7f tempest-CreateVolumesFromImageTest-1083614734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:33:02 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-3e37398d-54b1-4bcf-a358-2c3b6013cf7f tempest-CreateVolumesFromImageTest-1083614734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:33:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3e37398d-54b1-4bcf-a358-2c3b6013cf7f tempest-CreateVolumesFromImageTest-1083614734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:33:02 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-3e37398d-54b1-4bcf-a358-2c3b6013cf7f tempest-CreateVolumesFromImageTest-1083614734 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:33:02 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-3e37398d-54b1-4bcf-a358-2c3b6013cf7f tempest-CreateVolumesFromImageTest-1083614734 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:33:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3e37398d-54b1-4bcf-a358-2c3b6013cf7f tempest-CreateVolumesFromImageTest-1083614734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-eccb5c4e-a50c-4912-a6a4-fd7312f0a063 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:02 devstack sudo[98800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-eccb5c4e-a50c-4912-a6a4-fd7312f0a063 1073741824
Jul 14 16:33:02 devstack sudo[98800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9359454f-0e4c-4553-8d07-b20bbae72c99 tempest-CreateVolumesFromImageTest-1083614734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4cc524a-567a-42f4-8d51-08d289bd4169) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb89c332-1b3d-4ece-81b0-fecedb765a72', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9359454f-0e4c-4553-8d07-b20bbae72c99 tempest-CreateVolumesFromImageTest-1083614734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ce47db8-48b3-4112-af69-2a34f0c1e813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:02 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-9359454f-0e4c-4553-8d07-b20bbae72c99 tempest-CreateVolumesFromImageTest-1083614734 None] Volume volume-eb89c332-1b3d-4ece-81b0-fecedb765a72 (eb89c332-1b3d-4ece-81b0-fecedb765a72): created successfully
Jul 14 16:33:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9359454f-0e4c-4553-8d07-b20bbae72c99 tempest-CreateVolumesFromImageTest-1083614734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ce47db8-48b3-4112-af69-2a34f0c1e813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9359454f-0e4c-4553-8d07-b20bbae72c99 tempest-CreateVolumesFromImageTest-1083614734 None] Flow 'volume_create_manager' (8fc5f4e6-7c1a-4b79-b43b-c512168e67f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:33:02 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-9359454f-0e4c-4553-8d07-b20bbae72c99 tempest-CreateVolumesFromImageTest-1083614734 None] Created volume successfully.
Jul 14 16:33:03 devstack sudo[98800]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3e37398d-54b1-4bcf-a358-2c3b6013cf7f tempest-CreateVolumesFromImageTest-1083614734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-eccb5c4e-a50c-4912-a6a4-fd7312f0a063 1073741824" returned: 0 in 0.556s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3e37398d-54b1-4bcf-a358-2c3b6013cf7f tempest-CreateVolumesFromImageTest-1083614734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-eccb5c4e-a50c-4912-a6a4-fd7312f0a063 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:03 devstack sudo[98819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-eccb5c4e-a50c-4912-a6a4-fd7312f0a063
Jul 14 16:33:03 devstack sudo[98819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:03 devstack sudo[98819]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3e37398d-54b1-4bcf-a358-2c3b6013cf7f tempest-CreateVolumesFromImageTest-1083614734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-eccb5c4e-a50c-4912-a6a4-fd7312f0a063" returned: 0 in 0.500s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-3e37398d-54b1-4bcf-a358-2c3b6013cf7f tempest-CreateVolumesFromImageTest-1083614734 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:33:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3e37398d-54b1-4bcf-a358-2c3b6013cf7f tempest-CreateVolumesFromImageTest-1083614734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:33:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-02956405-b894-4dd7-bf1f-ee2814256140 tempest-CreateVolumesFromImageTest-1083614734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.835s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:33:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-02956405-b894-4dd7-bf1f-ee2814256140 tempest-CreateVolumesFromImageTest-1083614734 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:33:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-871851988',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18ee7421-4275-410c-aac1-7af6cca3916a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff932e4c5e334586a4e350025f9a4355',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:33:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:33:01Z,use_quota=True,user_id='624e59eaea3b42f29a5e12444710f045',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:33:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-02956405-b894-4dd7-bf1f-ee2814256140 tempest-CreateVolumesFromImageTest-1083614734 None] Creating volume 18ee7421-4275-410c-aac1-7af6cca3916a {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:33:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-02956405-b894-4dd7-bf1f-ee2814256140 tempest-CreateVolumesFromImageTest-1083614734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:33:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-02956405-b894-4dd7-bf1f-ee2814256140 tempest-CreateVolumesFromImageTest-1083614734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:33:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-02956405-b894-4dd7-bf1f-ee2814256140 tempest-CreateVolumesFromImageTest-1083614734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:33:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-02956405-b894-4dd7-bf1f-ee2814256140 tempest-CreateVolumesFromImageTest-1083614734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:33:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-02956405-b894-4dd7-bf1f-ee2814256140 tempest-CreateVolumesFromImageTest-1083614734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:33:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-02956405-b894-4dd7-bf1f-ee2814256140 tempest-CreateVolumesFromImageTest-1083614734 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:33:03 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-02956405-b894-4dd7-bf1f-ee2814256140 tempest-CreateVolumesFromImageTest-1083614734 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:33:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-02956405-b894-4dd7-bf1f-ee2814256140 tempest-CreateVolumesFromImageTest-1083614734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-18ee7421-4275-410c-aac1-7af6cca3916a 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3e37398d-54b1-4bcf-a358-2c3b6013cf7f tempest-CreateVolumesFromImageTest-1083614734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4c8ea1c-c354-4d95-96f3-b3ee323df579) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eccb5c4e-a50c-4912-a6a4-fd7312f0a063', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3e37398d-54b1-4bcf-a358-2c3b6013cf7f tempest-CreateVolumesFromImageTest-1083614734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f00b92b-1ed5-4882-ad3e-f2e6650c0b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:03 devstack sudo[98842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-18ee7421-4275-410c-aac1-7af6cca3916a 1073741824
Jul 14 16:33:03 devstack sudo[98842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:03 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-3e37398d-54b1-4bcf-a358-2c3b6013cf7f tempest-CreateVolumesFromImageTest-1083614734 None] Volume volume-eccb5c4e-a50c-4912-a6a4-fd7312f0a063 (eccb5c4e-a50c-4912-a6a4-fd7312f0a063): created successfully
Jul 14 16:33:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3e37398d-54b1-4bcf-a358-2c3b6013cf7f tempest-CreateVolumesFromImageTest-1083614734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f00b92b-1ed5-4882-ad3e-f2e6650c0b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3e37398d-54b1-4bcf-a358-2c3b6013cf7f tempest-CreateVolumesFromImageTest-1083614734 None] Flow 'volume_create_manager' (8f5365b0-12fc-4936-b1f4-af64afc2a54f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:33:03 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-3e37398d-54b1-4bcf-a358-2c3b6013cf7f tempest-CreateVolumesFromImageTest-1083614734 None] Created volume successfully.
Jul 14 16:33:04 devstack sudo[98842]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-02956405-b894-4dd7-bf1f-ee2814256140 tempest-CreateVolumesFromImageTest-1083614734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-18ee7421-4275-410c-aac1-7af6cca3916a 1073741824" returned: 0 in 0.560s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-02956405-b894-4dd7-bf1f-ee2814256140 tempest-CreateVolumesFromImageTest-1083614734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-18ee7421-4275-410c-aac1-7af6cca3916a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:04 devstack sudo[98849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-18ee7421-4275-410c-aac1-7af6cca3916a
Jul 14 16:33:04 devstack sudo[98849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:04 devstack sudo[98849]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-02956405-b894-4dd7-bf1f-ee2814256140 tempest-CreateVolumesFromImageTest-1083614734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-18ee7421-4275-410c-aac1-7af6cca3916a" returned: 0 in 0.290s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:04 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-02956405-b894-4dd7-bf1f-ee2814256140 tempest-CreateVolumesFromImageTest-1083614734 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:33:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-02956405-b894-4dd7-bf1f-ee2814256140 tempest-CreateVolumesFromImageTest-1083614734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:33:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a394b04a-65a7-48bc-a934-e75c1243eec7 tempest-VolumesTransfersV355Test-1727580817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.081s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:33:04 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a394b04a-65a7-48bc-a934-e75c1243eec7 tempest-VolumesTransfersV355Test-1727580817 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:33:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-391744792',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=234b4f26-df2f-4e8d-9d48-10e7b3c5b290,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a6ef327a05a4c9b90d357606aafd6d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:33:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:33:02Z,use_quota=True,user_id='024dcf927f9b42a28a8b356b56b94f3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:33:04 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-a394b04a-65a7-48bc-a934-e75c1243eec7 tempest-VolumesTransfersV355Test-1727580817 None] Creating volume 234b4f26-df2f-4e8d-9d48-10e7b3c5b290 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:33:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a394b04a-65a7-48bc-a934-e75c1243eec7 tempest-VolumesTransfersV355Test-1727580817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:33:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a394b04a-65a7-48bc-a934-e75c1243eec7 tempest-VolumesTransfersV355Test-1727580817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:33:04 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a394b04a-65a7-48bc-a934-e75c1243eec7 tempest-VolumesTransfersV355Test-1727580817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:33:04 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a394b04a-65a7-48bc-a934-e75c1243eec7 tempest-VolumesTransfersV355Test-1727580817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:33:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a394b04a-65a7-48bc-a934-e75c1243eec7 tempest-VolumesTransfersV355Test-1727580817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:33:04 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a394b04a-65a7-48bc-a934-e75c1243eec7 tempest-VolumesTransfersV355Test-1727580817 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:33:04 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-a394b04a-65a7-48bc-a934-e75c1243eec7 tempest-VolumesTransfersV355Test-1727580817 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:33:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a394b04a-65a7-48bc-a934-e75c1243eec7 tempest-VolumesTransfersV355Test-1727580817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-234b4f26-df2f-4e8d-9d48-10e7b3c5b290 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:04 devstack sudo[98852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-234b4f26-df2f-4e8d-9d48-10e7b3c5b290 1073741824
Jul 14 16:33:04 devstack sudo[98852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-02956405-b894-4dd7-bf1f-ee2814256140 tempest-CreateVolumesFromImageTest-1083614734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21022f5f-0321-4c3a-8226-b9269a1261e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18ee7421-4275-410c-aac1-7af6cca3916a', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-02956405-b894-4dd7-bf1f-ee2814256140 tempest-CreateVolumesFromImageTest-1083614734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4256ff23-c151-4e50-bcaf-f2ee798e02c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:04 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-02956405-b894-4dd7-bf1f-ee2814256140 tempest-CreateVolumesFromImageTest-1083614734 None] Volume volume-18ee7421-4275-410c-aac1-7af6cca3916a (18ee7421-4275-410c-aac1-7af6cca3916a): created successfully
Jul 14 16:33:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-02956405-b894-4dd7-bf1f-ee2814256140 tempest-CreateVolumesFromImageTest-1083614734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4256ff23-c151-4e50-bcaf-f2ee798e02c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-02956405-b894-4dd7-bf1f-ee2814256140 tempest-CreateVolumesFromImageTest-1083614734 None] Flow 'volume_create_manager' (549c6dc7-e69f-4f5b-a0a6-8ee97a1d4548) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:33:04 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-02956405-b894-4dd7-bf1f-ee2814256140 tempest-CreateVolumesFromImageTest-1083614734 None] Created volume successfully.
Jul 14 16:33:05 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-9e5192b4-06a1-4f41-93b9-8843b6d78eea tempest-CreateVolumesFromImageTest-1083614734 None] Acquiring lock "cinder-18ee7421-4275-410c-aac1-7af6cca3916a-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:33:05 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-9e5192b4-06a1-4f41-93b9-8843b6d78eea tempest-CreateVolumesFromImageTest-1083614734 None] Lock "cinder-18ee7421-4275-410c-aac1-7af6cca3916a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:33:05 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-9e5192b4-06a1-4f41-93b9-8843b6d78eea tempest-CreateVolumesFromImageTest-1083614734 None] Acquiring lock "cinder-quobyte-18ee7421-4275-410c-aac1-7af6cca3916a" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:33:05 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-9e5192b4-06a1-4f41-93b9-8843b6d78eea tempest-CreateVolumesFromImageTest-1083614734 None] Lock "cinder-quobyte-18ee7421-4275-410c-aac1-7af6cca3916a" acquired by "delete_volume" :: waited 0.026s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:33:05 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[888065f6-e01b-42c9-8aed-c1f61945744f]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:33:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9e5192b4-06a1-4f41-93b9-8843b6d78eea tempest-CreateVolumesFromImageTest-1083614734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-18ee7421-4275-410c-aac1-7af6cca3916a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:05 devstack sudo[98858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-18ee7421-4275-410c-aac1-7af6cca3916a
Jul 14 16:33:05 devstack sudo[98858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:05 devstack sudo[98852]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a394b04a-65a7-48bc-a934-e75c1243eec7 tempest-VolumesTransfersV355Test-1727580817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-234b4f26-df2f-4e8d-9d48-10e7b3c5b290 1073741824" returned: 0 in 0.732s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a394b04a-65a7-48bc-a934-e75c1243eec7 tempest-VolumesTransfersV355Test-1727580817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-234b4f26-df2f-4e8d-9d48-10e7b3c5b290 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:05 devstack sudo[98861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-234b4f26-df2f-4e8d-9d48-10e7b3c5b290
Jul 14 16:33:05 devstack sudo[98861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:05 devstack sudo[98858]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9e5192b4-06a1-4f41-93b9-8843b6d78eea tempest-CreateVolumesFromImageTest-1083614734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-18ee7421-4275-410c-aac1-7af6cca3916a" returned: 0 in 0.500s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9e5192b4-06a1-4f41-93b9-8843b6d78eea tempest-CreateVolumesFromImageTest-1083614734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-18ee7421-4275-410c-aac1-7af6cca3916a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:05 devstack sudo[98867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-18ee7421-4275-410c-aac1-7af6cca3916a
Jul 14 16:33:05 devstack sudo[98867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:05 devstack sudo[98861]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a394b04a-65a7-48bc-a934-e75c1243eec7 tempest-VolumesTransfersV355Test-1727580817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-234b4f26-df2f-4e8d-9d48-10e7b3c5b290" returned: 0 in 0.398s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:05 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a394b04a-65a7-48bc-a934-e75c1243eec7 tempest-VolumesTransfersV355Test-1727580817 None] <== create_volume: return (1210ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:33:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a394b04a-65a7-48bc-a934-e75c1243eec7 tempest-VolumesTransfersV355Test-1727580817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.214s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:33:06 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a394b04a-65a7-48bc-a934-e75c1243eec7 tempest-VolumesTransfersV355Test-1727580817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68d5db04-1dfc-41c9-a5f9-1f10ee9c3d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-234b4f26-df2f-4e8d-9d48-10e7b3c5b290', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:06 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a394b04a-65a7-48bc-a934-e75c1243eec7 tempest-VolumesTransfersV355Test-1727580817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbdf0e74-d1b8-4e65-9ccf-3ff1ed29f64d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:06 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-a394b04a-65a7-48bc-a934-e75c1243eec7 tempest-VolumesTransfersV355Test-1727580817 None] Volume volume-234b4f26-df2f-4e8d-9d48-10e7b3c5b290 (234b4f26-df2f-4e8d-9d48-10e7b3c5b290): created successfully
Jul 14 16:33:06 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a394b04a-65a7-48bc-a934-e75c1243eec7 tempest-VolumesTransfersV355Test-1727580817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbdf0e74-d1b8-4e65-9ccf-3ff1ed29f64d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:06 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a394b04a-65a7-48bc-a934-e75c1243eec7 tempest-VolumesTransfersV355Test-1727580817 None] Flow 'volume_create_manager' (57ffba67-53b9-437e-a999-ff9145dfb1d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:33:06 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-a394b04a-65a7-48bc-a934-e75c1243eec7 tempest-VolumesTransfersV355Test-1727580817 None] Created volume successfully.
Jul 14 16:33:06 devstack sudo[98867]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9e5192b4-06a1-4f41-93b9-8843b6d78eea tempest-CreateVolumesFromImageTest-1083614734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-18ee7421-4275-410c-aac1-7af6cca3916a" returned: 0 in 0.319s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:06 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-9e5192b4-06a1-4f41-93b9-8843b6d78eea tempest-CreateVolumesFromImageTest-1083614734 None] Lock "cinder-quobyte-18ee7421-4275-410c-aac1-7af6cca3916a" released by "delete_volume" :: held 0.881s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:33:06 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-9e5192b4-06a1-4f41-93b9-8843b6d78eea tempest-CreateVolumesFromImageTest-1083614734 None] Created reservations ['0a7b8807-20e7-4958-9aea-da91cda7f050', 'c6219048-b1bb-4005-94c0-7df31b7f028e', '513cff26-7505-478e-9c9d-79eeb8c7d6b8', 'eb38d50d-9d53-40bd-8d7c-24e073db0c29'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:33:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9e5192b4-06a1-4f41-93b9-8843b6d78eea tempest-CreateVolumesFromImageTest-1083614734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:33:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9e5192b4-06a1-4f41-93b9-8843b6d78eea tempest-CreateVolumesFromImageTest-1083614734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:33:06 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-9e5192b4-06a1-4f41-93b9-8843b6d78eea tempest-CreateVolumesFromImageTest-1083614734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:33:06 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-9e5192b4-06a1-4f41-93b9-8843b6d78eea tempest-CreateVolumesFromImageTest-1083614734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:33:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9e5192b4-06a1-4f41-93b9-8843b6d78eea tempest-CreateVolumesFromImageTest-1083614734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:33:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9e5192b4-06a1-4f41-93b9-8843b6d78eea tempest-CreateVolumesFromImageTest-1083614734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:06 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-24b910ab-8013-4240-ae6e-51e3f39976c5 tempest-CreateVolumesFromImageTest-1083614734 None] Acquiring lock "cinder-eccb5c4e-a50c-4912-a6a4-fd7312f0a063-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:33:06 devstack sudo[98885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:33:06 devstack sudo[98885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:06 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-24b910ab-8013-4240-ae6e-51e3f39976c5 tempest-CreateVolumesFromImageTest-1083614734 None] Lock "cinder-eccb5c4e-a50c-4912-a6a4-fd7312f0a063-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:33:06 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-24b910ab-8013-4240-ae6e-51e3f39976c5 tempest-CreateVolumesFromImageTest-1083614734 None] Acquiring lock "cinder-quobyte-eccb5c4e-a50c-4912-a6a4-fd7312f0a063" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:33:06 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-24b910ab-8013-4240-ae6e-51e3f39976c5 tempest-CreateVolumesFromImageTest-1083614734 None] Lock "cinder-quobyte-eccb5c4e-a50c-4912-a6a4-fd7312f0a063" acquired by "delete_volume" :: waited 0.039s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:33:06 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ced8bf-8ebd-4703-9f67-ba9b15c5fb00]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:33:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-24b910ab-8013-4240-ae6e-51e3f39976c5 tempest-CreateVolumesFromImageTest-1083614734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-eccb5c4e-a50c-4912-a6a4-fd7312f0a063 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:07 devstack sudo[98911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-eccb5c4e-a50c-4912-a6a4-fd7312f0a063
Jul 14 16:33:07 devstack sudo[98911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:07 devstack sudo[98885]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9e5192b4-06a1-4f41-93b9-8843b6d78eea tempest-CreateVolumesFromImageTest-1083614734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.710s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:07 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-9e5192b4-06a1-4f41-93b9-8843b6d78eea tempest-CreateVolumesFromImageTest-1083614734 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:33:07 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-9e5192b4-06a1-4f41-93b9-8843b6d78eea tempest-CreateVolumesFromImageTest-1083614734 None] Deleted volume successfully.
Jul 14 16:33:07 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-9e5192b4-06a1-4f41-93b9-8843b6d78eea tempest-CreateVolumesFromImageTest-1083614734 None] Lock "cinder-18ee7421-4275-410c-aac1-7af6cca3916a-delete_volume" released by "delete_volume" :: held 2.083s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:33:07 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ddbc6eb4-bf71-4fd7-89d3-0a33bc779a76 tempest-VolumesTransfersV355Test-887425671 None] Acquiring lock "cinder-234b4f26-df2f-4e8d-9d48-10e7b3c5b290-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:33:07 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ddbc6eb4-bf71-4fd7-89d3-0a33bc779a76 tempest-VolumesTransfersV355Test-887425671 None] Lock "cinder-234b4f26-df2f-4e8d-9d48-10e7b3c5b290-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:33:07 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ddbc6eb4-bf71-4fd7-89d3-0a33bc779a76 tempest-VolumesTransfersV355Test-887425671 None] Acquiring lock "cinder-quobyte-234b4f26-df2f-4e8d-9d48-10e7b3c5b290" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:33:07 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ddbc6eb4-bf71-4fd7-89d3-0a33bc779a76 tempest-VolumesTransfersV355Test-887425671 None] Lock "cinder-quobyte-234b4f26-df2f-4e8d-9d48-10e7b3c5b290" acquired by "delete_volume" :: waited 0.030s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:33:07 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ec43c5-fcc3-4ac2-a16e-0c048a34557e]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:33:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ddbc6eb4-bf71-4fd7-89d3-0a33bc779a76 tempest-VolumesTransfersV355Test-887425671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-234b4f26-df2f-4e8d-9d48-10e7b3c5b290 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:07 devstack sudo[98911]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-24b910ab-8013-4240-ae6e-51e3f39976c5 tempest-CreateVolumesFromImageTest-1083614734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-eccb5c4e-a50c-4912-a6a4-fd7312f0a063" returned: 0 in 0.967s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-24b910ab-8013-4240-ae6e-51e3f39976c5 tempest-CreateVolumesFromImageTest-1083614734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-eccb5c4e-a50c-4912-a6a4-fd7312f0a063 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:07 devstack sudo[98941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-234b4f26-df2f-4e8d-9d48-10e7b3c5b290
Jul 14 16:33:07 devstack sudo[98941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:07 devstack sudo[98943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-eccb5c4e-a50c-4912-a6a4-fd7312f0a063
Jul 14 16:33:07 devstack sudo[98943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:08 devstack sudo[98941]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ddbc6eb4-bf71-4fd7-89d3-0a33bc779a76 tempest-VolumesTransfersV355Test-887425671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-234b4f26-df2f-4e8d-9d48-10e7b3c5b290" returned: 0 in 0.544s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ddbc6eb4-bf71-4fd7-89d3-0a33bc779a76 tempest-VolumesTransfersV355Test-887425671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-234b4f26-df2f-4e8d-9d48-10e7b3c5b290 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:08 devstack sudo[98953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-234b4f26-df2f-4e8d-9d48-10e7b3c5b290
Jul 14 16:33:08 devstack sudo[98953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:08 devstack sudo[98943]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-24b910ab-8013-4240-ae6e-51e3f39976c5 tempest-CreateVolumesFromImageTest-1083614734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-eccb5c4e-a50c-4912-a6a4-fd7312f0a063" returned: 0 in 0.588s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:08 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-24b910ab-8013-4240-ae6e-51e3f39976c5 tempest-CreateVolumesFromImageTest-1083614734 None] Lock "cinder-quobyte-eccb5c4e-a50c-4912-a6a4-fd7312f0a063" released by "delete_volume" :: held 1.686s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:33:08 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-24b910ab-8013-4240-ae6e-51e3f39976c5 tempest-CreateVolumesFromImageTest-1083614734 None] Created reservations ['9aa2dac6-6b94-4939-b81b-08d5fe368e02', '949e9788-3a5b-40b0-b6da-c83646a7ae40', '1f57d216-a5a4-4129-ae9c-ee0704de28a1', '918ba165-9eab-406f-8477-b2c2e951b955'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:33:08 devstack sudo[98953]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ddbc6eb4-bf71-4fd7-89d3-0a33bc779a76 tempest-VolumesTransfersV355Test-887425671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-234b4f26-df2f-4e8d-9d48-10e7b3c5b290" returned: 0 in 0.505s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:08 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ddbc6eb4-bf71-4fd7-89d3-0a33bc779a76 tempest-VolumesTransfersV355Test-887425671 None] Lock "cinder-quobyte-234b4f26-df2f-4e8d-9d48-10e7b3c5b290" released by "delete_volume" :: held 1.145s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:33:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-24b910ab-8013-4240-ae6e-51e3f39976c5 tempest-CreateVolumesFromImageTest-1083614734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:33:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-24b910ab-8013-4240-ae6e-51e3f39976c5 tempest-CreateVolumesFromImageTest-1083614734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:33:08 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-24b910ab-8013-4240-ae6e-51e3f39976c5 tempest-CreateVolumesFromImageTest-1083614734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:33:08 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-24b910ab-8013-4240-ae6e-51e3f39976c5 tempest-CreateVolumesFromImageTest-1083614734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:33:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-24b910ab-8013-4240-ae6e-51e3f39976c5 tempest-CreateVolumesFromImageTest-1083614734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:33:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-24b910ab-8013-4240-ae6e-51e3f39976c5 tempest-CreateVolumesFromImageTest-1083614734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:08 devstack sudo[98958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:33:08 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-ddbc6eb4-bf71-4fd7-89d3-0a33bc779a76 tempest-VolumesTransfersV355Test-887425671 None] Created reservations ['54ee51c7-e047-48aa-a3f5-a30ca59d3a53', '6f78a7c6-6d74-4017-9d3b-2593aabaf04b', '8ebcffec-8c66-4f91-b85a-d3ff9d08ad14', '110201a8-bef5-4ff6-94ed-eccf2e517b52'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:33:08 devstack sudo[98958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:09 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7724d979-7e09-405c-9279-974313b55a82 tempest-CreateVolumesFromImageTest-1083614734 None] Acquiring lock "cinder-eb89c332-1b3d-4ece-81b0-fecedb765a72-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:33:09 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7724d979-7e09-405c-9279-974313b55a82 tempest-CreateVolumesFromImageTest-1083614734 None] Lock "cinder-eb89c332-1b3d-4ece-81b0-fecedb765a72-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:33:09 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7724d979-7e09-405c-9279-974313b55a82 tempest-CreateVolumesFromImageTest-1083614734 None] Acquiring lock "cinder-quobyte-eb89c332-1b3d-4ece-81b0-fecedb765a72" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:33:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ddbc6eb4-bf71-4fd7-89d3-0a33bc779a76 tempest-VolumesTransfersV355Test-887425671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:33:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ddbc6eb4-bf71-4fd7-89d3-0a33bc779a76 tempest-VolumesTransfersV355Test-887425671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:33:09 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ddbc6eb4-bf71-4fd7-89d3-0a33bc779a76 tempest-VolumesTransfersV355Test-887425671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:33:09 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ddbc6eb4-bf71-4fd7-89d3-0a33bc779a76 tempest-VolumesTransfersV355Test-887425671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:33:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ddbc6eb4-bf71-4fd7-89d3-0a33bc779a76 tempest-VolumesTransfersV355Test-887425671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:33:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ddbc6eb4-bf71-4fd7-89d3-0a33bc779a76 tempest-VolumesTransfersV355Test-887425671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:09 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7724d979-7e09-405c-9279-974313b55a82 tempest-CreateVolumesFromImageTest-1083614734 None] Lock "cinder-quobyte-eb89c332-1b3d-4ece-81b0-fecedb765a72" acquired by "delete_volume" :: waited 0.052s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:33:09 devstack sudo[98961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:33:09 devstack sudo[98961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:09 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebfe1f5d-2c96-49d0-9f3a-82db12b9a8ce]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:33:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7724d979-7e09-405c-9279-974313b55a82 tempest-CreateVolumesFromImageTest-1083614734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-eb89c332-1b3d-4ece-81b0-fecedb765a72 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:09 devstack sudo[98963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-eb89c332-1b3d-4ece-81b0-fecedb765a72
Jul 14 16:33:09 devstack sudo[98963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:09 devstack sudo[98958]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-24b910ab-8013-4240-ae6e-51e3f39976c5 tempest-CreateVolumesFromImageTest-1083614734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.522s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:09 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-24b910ab-8013-4240-ae6e-51e3f39976c5 tempest-CreateVolumesFromImageTest-1083614734 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:33:09 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-24b910ab-8013-4240-ae6e-51e3f39976c5 tempest-CreateVolumesFromImageTest-1083614734 None] Deleted volume successfully.
Jul 14 16:33:09 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-24b910ab-8013-4240-ae6e-51e3f39976c5 tempest-CreateVolumesFromImageTest-1083614734 None] Lock "cinder-eccb5c4e-a50c-4912-a6a4-fd7312f0a063-delete_volume" released by "delete_volume" :: held 2.872s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:33:09 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-27b0dd3b-95d8-4a4e-b23c-8319251a4c77 tempest-VolumesActionsTest-1397689694 None] Acquiring lock "cinder-3c1af111-f7de-48b5-bb7e-f8e09a5ce399" by "attach_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:33:09 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-27b0dd3b-95d8-4a4e-b23c-8319251a4c77 tempest-VolumesActionsTest-1397689694 None] Lock "cinder-3c1af111-f7de-48b5-bb7e-f8e09a5ce399" acquired by "attach_volume" :: waited 0.027s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:33:09 devstack sudo[98961]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ddbc6eb4-bf71-4fd7-89d3-0a33bc779a76 tempest-VolumesTransfersV355Test-887425671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.655s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:09 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-ddbc6eb4-bf71-4fd7-89d3-0a33bc779a76 tempest-VolumesTransfersV355Test-887425671 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:33:09 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-ddbc6eb4-bf71-4fd7-89d3-0a33bc779a76 tempest-VolumesTransfersV355Test-887425671 None] Deleted volume successfully.
Jul 14 16:33:09 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-27b0dd3b-95d8-4a4e-b23c-8319251a4c77 tempest-VolumesActionsTest-1397689694 None] Attaching volume 3c1af111-f7de-48b5-bb7e-f8e09a5ce399 to instance 080bfaeb-4da6-4ac4-a957-94ca9214962b at mountpoint /dev/vdb on host None.
Jul 14 16:33:09 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ddbc6eb4-bf71-4fd7-89d3-0a33bc779a76 tempest-VolumesTransfersV355Test-887425671 None] Lock "cinder-234b4f26-df2f-4e8d-9d48-10e7b3c5b290-delete_volume" released by "delete_volume" :: held 2.312s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:33:09 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-27b0dd3b-95d8-4a4e-b23c-8319251a4c77 tempest-VolumesActionsTest-1397689694 None] Attach volume completed successfully.
Jul 14 16:33:09 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-27b0dd3b-95d8-4a4e-b23c-8319251a4c77 tempest-VolumesActionsTest-1397689694 None] Lock "cinder-3c1af111-f7de-48b5-bb7e-f8e09a5ce399" released by "attach_volume" :: held 0.170s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:33:10 devstack sudo[98963]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7724d979-7e09-405c-9279-974313b55a82 tempest-CreateVolumesFromImageTest-1083614734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-eb89c332-1b3d-4ece-81b0-fecedb765a72" returned: 0 in 0.824s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7724d979-7e09-405c-9279-974313b55a82 tempest-CreateVolumesFromImageTest-1083614734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-eb89c332-1b3d-4ece-81b0-fecedb765a72 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:10 devstack sudo[98970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-eb89c332-1b3d-4ece-81b0-fecedb765a72
Jul 14 16:33:10 devstack sudo[98970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:10 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c2848492-f090-4ab2-aa98-7c3eaedd6ca2 tempest-VolumesActionsTest-1397689694 None] Acquiring lock "cinder-3c1af111-f7de-48b5-bb7e-f8e09a5ce399-detach_volume" by "detach_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:33:10 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c2848492-f090-4ab2-aa98-7c3eaedd6ca2 tempest-VolumesActionsTest-1397689694 None] Lock "cinder-3c1af111-f7de-48b5-bb7e-f8e09a5ce399-detach_volume" acquired by "detach_volume" :: waited 0.039s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:33:10 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-c2848492-f090-4ab2-aa98-7c3eaedd6ca2 tempest-VolumesActionsTest-1397689694 None] Detaching volume 3c1af111-f7de-48b5-bb7e-f8e09a5ce399 from instance 080bfaeb-4da6-4ac4-a957-94ca9214962b.
Jul 14 16:33:10 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-c2848492-f090-4ab2-aa98-7c3eaedd6ca2 tempest-VolumesActionsTest-1397689694 None] Detach volume completed successfully.
Jul 14 16:33:10 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c2848492-f090-4ab2-aa98-7c3eaedd6ca2 tempest-VolumesActionsTest-1397689694 None] Lock "cinder-3c1af111-f7de-48b5-bb7e-f8e09a5ce399-detach_volume" released by "detach_volume" :: held 0.147s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:33:10 devstack sudo[98970]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7724d979-7e09-405c-9279-974313b55a82 tempest-CreateVolumesFromImageTest-1083614734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-eb89c332-1b3d-4ece-81b0-fecedb765a72" returned: 0 in 0.483s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:10 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7724d979-7e09-405c-9279-974313b55a82 tempest-CreateVolumesFromImageTest-1083614734 None] Lock "cinder-quobyte-eb89c332-1b3d-4ece-81b0-fecedb765a72" released by "delete_volume" :: held 1.396s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:33:10 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-7724d979-7e09-405c-9279-974313b55a82 tempest-CreateVolumesFromImageTest-1083614734 None] Created reservations ['68bf2238-6178-4a98-bda0-442e2ab76f58', '50b7d7dc-6921-4b22-a46c-d88da331700c', 'cf92e582-331d-48cc-8366-d84dfb0b5010', 'c9c7e52a-1ab0-41d9-ad52-191fe085c0e9'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:33:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-7724d979-7e09-405c-9279-974313b55a82 tempest-CreateVolumesFromImageTest-1083614734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:33:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-7724d979-7e09-405c-9279-974313b55a82 tempest-CreateVolumesFromImageTest-1083614734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:33:11 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-7724d979-7e09-405c-9279-974313b55a82 tempest-CreateVolumesFromImageTest-1083614734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:33:11 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-7724d979-7e09-405c-9279-974313b55a82 tempest-CreateVolumesFromImageTest-1083614734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:33:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-7724d979-7e09-405c-9279-974313b55a82 tempest-CreateVolumesFromImageTest-1083614734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:33:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7724d979-7e09-405c-9279-974313b55a82 tempest-CreateVolumesFromImageTest-1083614734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:11 devstack sudo[98975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:33:11 devstack sudo[98975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:11 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-9b064e93-c15c-478e-885f-5c67508afd50 tempest-CreateVolumesFromImageTest-1083614734 None] Acquiring lock "cinder-36b3a3e4-26f9-479b-9061-d09aa0f2bf86-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:33:11 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-9b064e93-c15c-478e-885f-5c67508afd50 tempest-CreateVolumesFromImageTest-1083614734 None] Lock "cinder-36b3a3e4-26f9-479b-9061-d09aa0f2bf86-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:33:11 devstack sudo[98975]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7724d979-7e09-405c-9279-974313b55a82 tempest-CreateVolumesFromImageTest-1083614734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.576s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:11 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-7724d979-7e09-405c-9279-974313b55a82 tempest-CreateVolumesFromImageTest-1083614734 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:33:11 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-7724d979-7e09-405c-9279-974313b55a82 tempest-CreateVolumesFromImageTest-1083614734 None] Deleted volume successfully.
Jul 14 16:33:11 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-9b064e93-c15c-478e-885f-5c67508afd50 tempest-CreateVolumesFromImageTest-1083614734 None] Acquiring lock "cinder-quobyte-36b3a3e4-26f9-479b-9061-d09aa0f2bf86" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:33:11 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7724d979-7e09-405c-9279-974313b55a82 tempest-CreateVolumesFromImageTest-1083614734 None] Lock "cinder-eb89c332-1b3d-4ece-81b0-fecedb765a72-delete_volume" released by "delete_volume" :: held 2.701s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:33:11 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-9b064e93-c15c-478e-885f-5c67508afd50 tempest-CreateVolumesFromImageTest-1083614734 None] Lock "cinder-quobyte-36b3a3e4-26f9-479b-9061-d09aa0f2bf86" acquired by "delete_volume" :: waited 0.026s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:33:11 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce5b47c-2fe7-47dd-8e0d-a83e2651baf1]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:33:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9b064e93-c15c-478e-885f-5c67508afd50 tempest-CreateVolumesFromImageTest-1083614734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-36b3a3e4-26f9-479b-9061-d09aa0f2bf86 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:11 devstack sudo[99006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-36b3a3e4-26f9-479b-9061-d09aa0f2bf86
Jul 14 16:33:11 devstack sudo[99006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:12 devstack sudo[99006]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9b064e93-c15c-478e-885f-5c67508afd50 tempest-CreateVolumesFromImageTest-1083614734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-36b3a3e4-26f9-479b-9061-d09aa0f2bf86" returned: 0 in 0.429s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9b064e93-c15c-478e-885f-5c67508afd50 tempest-CreateVolumesFromImageTest-1083614734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-36b3a3e4-26f9-479b-9061-d09aa0f2bf86 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:12 devstack sudo[99011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-36b3a3e4-26f9-479b-9061-d09aa0f2bf86
Jul 14 16:33:12 devstack sudo[99011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:12 devstack sudo[99011]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9b064e93-c15c-478e-885f-5c67508afd50 tempest-CreateVolumesFromImageTest-1083614734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-36b3a3e4-26f9-479b-9061-d09aa0f2bf86" returned: 0 in 0.357s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:12 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-9b064e93-c15c-478e-885f-5c67508afd50 tempest-CreateVolumesFromImageTest-1083614734 None] Lock "cinder-quobyte-36b3a3e4-26f9-479b-9061-d09aa0f2bf86" released by "delete_volume" :: held 0.844s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:33:12 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-9b064e93-c15c-478e-885f-5c67508afd50 tempest-CreateVolumesFromImageTest-1083614734 None] Created reservations ['74d15927-7463-4be6-9db2-bb837a03b1b6', 'a0b8bb32-32f4-4b61-8468-b321e040089f', '5d6bcb0b-4c17-4f71-95f5-924861e92f3c', '1c50cded-149d-4093-9329-24d0c6c51769'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:33:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9b064e93-c15c-478e-885f-5c67508afd50 tempest-CreateVolumesFromImageTest-1083614734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:33:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9b064e93-c15c-478e-885f-5c67508afd50 tempest-CreateVolumesFromImageTest-1083614734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:33:12 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-9b064e93-c15c-478e-885f-5c67508afd50 tempest-CreateVolumesFromImageTest-1083614734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:33:12 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-9b064e93-c15c-478e-885f-5c67508afd50 tempest-CreateVolumesFromImageTest-1083614734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:33:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9b064e93-c15c-478e-885f-5c67508afd50 tempest-CreateVolumesFromImageTest-1083614734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:33:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9b064e93-c15c-478e-885f-5c67508afd50 tempest-CreateVolumesFromImageTest-1083614734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:12 devstack sudo[99015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:33:12 devstack sudo[99015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:12 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e014bbed-6068-4d63-b64a-7784a3130875 tempest-CreateVolumesFromImageTest-1083614734 None] Acquiring lock "cinder-f9815071-e48a-4b15-b48b-8d5bda59dea9-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:33:12 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e014bbed-6068-4d63-b64a-7784a3130875 tempest-CreateVolumesFromImageTest-1083614734 None] Lock "cinder-f9815071-e48a-4b15-b48b-8d5bda59dea9-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:33:12 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e014bbed-6068-4d63-b64a-7784a3130875 tempest-CreateVolumesFromImageTest-1083614734 None] Acquiring lock "cinder-quobyte-f9815071-e48a-4b15-b48b-8d5bda59dea9" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:33:12 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e014bbed-6068-4d63-b64a-7784a3130875 tempest-CreateVolumesFromImageTest-1083614734 None] Lock "cinder-quobyte-f9815071-e48a-4b15-b48b-8d5bda59dea9" acquired by "delete_volume" :: waited 0.020s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:33:12 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f67692-e1aa-46c0-b3b9-943978739769]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:33:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e014bbed-6068-4d63-b64a-7784a3130875 tempest-CreateVolumesFromImageTest-1083614734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f9815071-e48a-4b15-b48b-8d5bda59dea9 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:13 devstack sudo[99017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f9815071-e48a-4b15-b48b-8d5bda59dea9
Jul 14 16:33:13 devstack sudo[99017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:13 devstack sudo[99015]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9b064e93-c15c-478e-885f-5c67508afd50 tempest-CreateVolumesFromImageTest-1083614734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.340s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:13 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-9b064e93-c15c-478e-885f-5c67508afd50 tempest-CreateVolumesFromImageTest-1083614734 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:33:13 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-9b064e93-c15c-478e-885f-5c67508afd50 tempest-CreateVolumesFromImageTest-1083614734 None] Deleted volume successfully.
Jul 14 16:33:13 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-9b064e93-c15c-478e-885f-5c67508afd50 tempest-CreateVolumesFromImageTest-1083614734 None] Lock "cinder-36b3a3e4-26f9-479b-9061-d09aa0f2bf86-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:33:13 devstack sudo[99017]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e014bbed-6068-4d63-b64a-7784a3130875 tempest-CreateVolumesFromImageTest-1083614734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f9815071-e48a-4b15-b48b-8d5bda59dea9" returned: 0 in 0.467s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e014bbed-6068-4d63-b64a-7784a3130875 tempest-CreateVolumesFromImageTest-1083614734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f9815071-e48a-4b15-b48b-8d5bda59dea9 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:13 devstack sudo[99023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f9815071-e48a-4b15-b48b-8d5bda59dea9
Jul 14 16:33:13 devstack sudo[99023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:13 devstack sudo[99023]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e014bbed-6068-4d63-b64a-7784a3130875 tempest-CreateVolumesFromImageTest-1083614734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f9815071-e48a-4b15-b48b-8d5bda59dea9" returned: 0 in 0.361s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:13 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e014bbed-6068-4d63-b64a-7784a3130875 tempest-CreateVolumesFromImageTest-1083614734 None] Lock "cinder-quobyte-f9815071-e48a-4b15-b48b-8d5bda59dea9" released by "delete_volume" :: held 0.889s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:33:13 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-e014bbed-6068-4d63-b64a-7784a3130875 tempest-CreateVolumesFromImageTest-1083614734 None] Created reservations ['f1f25467-1eff-4284-af52-b85f7cc626c3', '10bcc556-d418-43ac-bb41-d9662066a978', '6b6375ed-3f2a-4d07-a875-cb6d7eb4ad44', '98397825-826b-4199-8ee3-476689187c85'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:33:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e014bbed-6068-4d63-b64a-7784a3130875 tempest-CreateVolumesFromImageTest-1083614734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:33:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e014bbed-6068-4d63-b64a-7784a3130875 tempest-CreateVolumesFromImageTest-1083614734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:33:14 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-e014bbed-6068-4d63-b64a-7784a3130875 tempest-CreateVolumesFromImageTest-1083614734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:33:14 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-e014bbed-6068-4d63-b64a-7784a3130875 tempest-CreateVolumesFromImageTest-1083614734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:33:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e014bbed-6068-4d63-b64a-7784a3130875 tempest-CreateVolumesFromImageTest-1083614734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:33:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e014bbed-6068-4d63-b64a-7784a3130875 tempest-CreateVolumesFromImageTest-1083614734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:14 devstack sudo[99027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:33:14 devstack sudo[99027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:14 devstack sudo[99027]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e014bbed-6068-4d63-b64a-7784a3130875 tempest-CreateVolumesFromImageTest-1083614734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.325s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:14 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-e014bbed-6068-4d63-b64a-7784a3130875 tempest-CreateVolumesFromImageTest-1083614734 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:33:14 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-e014bbed-6068-4d63-b64a-7784a3130875 tempest-CreateVolumesFromImageTest-1083614734 None] Deleted volume successfully.
Jul 14 16:33:14 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e014bbed-6068-4d63-b64a-7784a3130875 tempest-CreateVolumesFromImageTest-1083614734 None] Lock "cinder-f9815071-e48a-4b15-b48b-8d5bda59dea9-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:33:19 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-52ef1662-b1d4-4ce6-8383-322a49f7d52f tempest-TestServerVolumeAttachmentScenario-1040687344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:33:20 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-52ef1662-b1d4-4ce6-8383-322a49f7d52f tempest-TestServerVolumeAttachmentScenario-1040687344 None] Flow 'volume_create_manager' (abb1c595-f214-4fcf-a5cb-9c591a40ab71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:33:20 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-52ef1662-b1d4-4ce6-8383-322a49f7d52f tempest-TestServerVolumeAttachmentScenario-1040687344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5ea9f3a-1691-49f1-b8c1-958a96ab021f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:20 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-52ef1662-b1d4-4ce6-8383-322a49f7d52f tempest-TestServerVolumeAttachmentScenario-1040687344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5ea9f3a-1691-49f1-b8c1-958a96ab021f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:33:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-575240075',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a247759-154f-4a91-9c77-93149a217448,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80c4947c36a84e88828f5440dead4989',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:33:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:33:20Z,use_quota=True,user_id='824e310583194525ac1ed0c7a8e9b119',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:20 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-52ef1662-b1d4-4ce6-8383-322a49f7d52f tempest-TestServerVolumeAttachmentScenario-1040687344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1e0fef5-ec84-43f6-84be-a6d9736c6f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:20 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-52ef1662-b1d4-4ce6-8383-322a49f7d52f tempest-TestServerVolumeAttachmentScenario-1040687344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1e0fef5-ec84-43f6-84be-a6d9736c6f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:20 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-52ef1662-b1d4-4ce6-8383-322a49f7d52f tempest-TestServerVolumeAttachmentScenario-1040687344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfcc63ce-ee53-4724-953c-5e4608e8e00f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:20 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-52ef1662-b1d4-4ce6-8383-322a49f7d52f tempest-TestServerVolumeAttachmentScenario-1040687344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfcc63ce-ee53-4724-953c-5e4608e8e00f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a247759-154f-4a91-9c77-93149a217448', 'volume_name': 'volume-4a247759-154f-4a91-9c77-93149a217448', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:20 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-52ef1662-b1d4-4ce6-8383-322a49f7d52f tempest-TestServerVolumeAttachmentScenario-1040687344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (628624a0-37dd-4f89-b81d-1d69f460b89a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:20 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-52ef1662-b1d4-4ce6-8383-322a49f7d52f tempest-TestServerVolumeAttachmentScenario-1040687344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (628624a0-37dd-4f89-b81d-1d69f460b89a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:20 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-52ef1662-b1d4-4ce6-8383-322a49f7d52f tempest-TestServerVolumeAttachmentScenario-1040687344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (297418ea-9805-49c1-9c2b-e16cc21fc8fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:20 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-52ef1662-b1d4-4ce6-8383-322a49f7d52f tempest-TestServerVolumeAttachmentScenario-1040687344 None] Volume 4a247759-154f-4a91-9c77-93149a217448: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a247759-154f-4a91-9c77-93149a217448', 'volume_size': 1}
Jul 14 16:33:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-52ef1662-b1d4-4ce6-8383-322a49f7d52f tempest-TestServerVolumeAttachmentScenario-1040687344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:33:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-52ef1662-b1d4-4ce6-8383-322a49f7d52f tempest-TestServerVolumeAttachmentScenario-1040687344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:33:20 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-52ef1662-b1d4-4ce6-8383-322a49f7d52f tempest-TestServerVolumeAttachmentScenario-1040687344 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:33:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-575240075',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a247759-154f-4a91-9c77-93149a217448,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80c4947c36a84e88828f5440dead4989',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:33:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:33:20Z,use_quota=True,user_id='824e310583194525ac1ed0c7a8e9b119',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:33:20 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-52ef1662-b1d4-4ce6-8383-322a49f7d52f tempest-TestServerVolumeAttachmentScenario-1040687344 None] Creating volume 4a247759-154f-4a91-9c77-93149a217448 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:33:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-52ef1662-b1d4-4ce6-8383-322a49f7d52f tempest-TestServerVolumeAttachmentScenario-1040687344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:33:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-52ef1662-b1d4-4ce6-8383-322a49f7d52f tempest-TestServerVolumeAttachmentScenario-1040687344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:33:20 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-52ef1662-b1d4-4ce6-8383-322a49f7d52f tempest-TestServerVolumeAttachmentScenario-1040687344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:33:20 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-52ef1662-b1d4-4ce6-8383-322a49f7d52f tempest-TestServerVolumeAttachmentScenario-1040687344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:33:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-52ef1662-b1d4-4ce6-8383-322a49f7d52f tempest-TestServerVolumeAttachmentScenario-1040687344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:33:20 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-52ef1662-b1d4-4ce6-8383-322a49f7d52f tempest-TestServerVolumeAttachmentScenario-1040687344 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:33:20 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-52ef1662-b1d4-4ce6-8383-322a49f7d52f tempest-TestServerVolumeAttachmentScenario-1040687344 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:33:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-52ef1662-b1d4-4ce6-8383-322a49f7d52f tempest-TestServerVolumeAttachmentScenario-1040687344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4a247759-154f-4a91-9c77-93149a217448 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:20 devstack sudo[99035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4a247759-154f-4a91-9c77-93149a217448 1073741824
Jul 14 16:33:20 devstack sudo[99035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:20 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2f1c55e-3ff8-41eb-b928-f00d87a22cd3 tempest-TestServerVolumeAttachmentScenario-1040687344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:33:20 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e2f1c55e-3ff8-41eb-b928-f00d87a22cd3 tempest-TestServerVolumeAttachmentScenario-1040687344 None] Flow 'volume_create_manager' (3589b485-19c2-4657-ba33-4dd75f423888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:33:20 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e2f1c55e-3ff8-41eb-b928-f00d87a22cd3 tempest-TestServerVolumeAttachmentScenario-1040687344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d5685f7-fe0f-4a04-a8e2-8df83f89b001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:20 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e2f1c55e-3ff8-41eb-b928-f00d87a22cd3 tempest-TestServerVolumeAttachmentScenario-1040687344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d5685f7-fe0f-4a04-a8e2-8df83f89b001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:33:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-944750799',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2d2c24b-42cf-48ed-8f78-62572d105604,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80c4947c36a84e88828f5440dead4989',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:33:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:33:20Z,use_quota=True,user_id='824e310583194525ac1ed0c7a8e9b119',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:20 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e2f1c55e-3ff8-41eb-b928-f00d87a22cd3 tempest-TestServerVolumeAttachmentScenario-1040687344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (833adb17-c522-4e75-aa4a-609e32c91863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:20 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e2f1c55e-3ff8-41eb-b928-f00d87a22cd3 tempest-TestServerVolumeAttachmentScenario-1040687344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (833adb17-c522-4e75-aa4a-609e32c91863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:20 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e2f1c55e-3ff8-41eb-b928-f00d87a22cd3 tempest-TestServerVolumeAttachmentScenario-1040687344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa3defec-7efe-4d20-80ea-d5aa52267170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:20 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e2f1c55e-3ff8-41eb-b928-f00d87a22cd3 tempest-TestServerVolumeAttachmentScenario-1040687344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa3defec-7efe-4d20-80ea-d5aa52267170) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2d2c24b-42cf-48ed-8f78-62572d105604', 'volume_name': 'volume-f2d2c24b-42cf-48ed-8f78-62572d105604', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:20 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e2f1c55e-3ff8-41eb-b928-f00d87a22cd3 tempest-TestServerVolumeAttachmentScenario-1040687344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8d828ef-456c-4f54-8f1f-2f3d0e905e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:20 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e2f1c55e-3ff8-41eb-b928-f00d87a22cd3 tempest-TestServerVolumeAttachmentScenario-1040687344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8d828ef-456c-4f54-8f1f-2f3d0e905e11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:20 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e2f1c55e-3ff8-41eb-b928-f00d87a22cd3 tempest-TestServerVolumeAttachmentScenario-1040687344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (450b22b3-47e0-4684-b71a-9e3532f8297a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:20 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-e2f1c55e-3ff8-41eb-b928-f00d87a22cd3 tempest-TestServerVolumeAttachmentScenario-1040687344 None] Volume f2d2c24b-42cf-48ed-8f78-62572d105604: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2d2c24b-42cf-48ed-8f78-62572d105604', 'volume_size': 1}
Jul 14 16:33:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e2f1c55e-3ff8-41eb-b928-f00d87a22cd3 tempest-TestServerVolumeAttachmentScenario-1040687344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:33:20 devstack sudo[99035]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-52ef1662-b1d4-4ce6-8383-322a49f7d52f tempest-TestServerVolumeAttachmentScenario-1040687344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4a247759-154f-4a91-9c77-93149a217448 1073741824" returned: 0 in 0.841s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-52ef1662-b1d4-4ce6-8383-322a49f7d52f tempest-TestServerVolumeAttachmentScenario-1040687344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4a247759-154f-4a91-9c77-93149a217448 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:21 devstack sudo[99041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4a247759-154f-4a91-9c77-93149a217448
Jul 14 16:33:21 devstack sudo[99041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:21 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc6477d5-3245-4679-8281-3c511b52e931 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:33:21 devstack sudo[99041]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:21 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fc6477d5-3245-4679-8281-3c511b52e931 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Flow 'volume_create_manager' (83d052ff-58c7-45a0-a886-4c8a8b261f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:33:21 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fc6477d5-3245-4679-8281-3c511b52e931 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52aac76b-e721-410d-ad5c-2fb1b3f9da84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-52ef1662-b1d4-4ce6-8383-322a49f7d52f tempest-TestServerVolumeAttachmentScenario-1040687344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4a247759-154f-4a91-9c77-93149a217448" returned: 0 in 0.558s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:21 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-52ef1662-b1d4-4ce6-8383-322a49f7d52f tempest-TestServerVolumeAttachmentScenario-1040687344 None] <== create_volume: return (1480ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:33:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-52ef1662-b1d4-4ce6-8383-322a49f7d52f tempest-TestServerVolumeAttachmentScenario-1040687344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.483s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:33:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e2f1c55e-3ff8-41eb-b928-f00d87a22cd3 tempest-TestServerVolumeAttachmentScenario-1040687344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.848s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:33:21 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-e2f1c55e-3ff8-41eb-b928-f00d87a22cd3 tempest-TestServerVolumeAttachmentScenario-1040687344 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:33:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-944750799',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2d2c24b-42cf-48ed-8f78-62572d105604,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80c4947c36a84e88828f5440dead4989',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:33:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:33:20Z,use_quota=True,user_id='824e310583194525ac1ed0c7a8e9b119',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:33:21 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-e2f1c55e-3ff8-41eb-b928-f00d87a22cd3 tempest-TestServerVolumeAttachmentScenario-1040687344 None] Creating volume f2d2c24b-42cf-48ed-8f78-62572d105604 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:33:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e2f1c55e-3ff8-41eb-b928-f00d87a22cd3 tempest-TestServerVolumeAttachmentScenario-1040687344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:33:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e2f1c55e-3ff8-41eb-b928-f00d87a22cd3 tempest-TestServerVolumeAttachmentScenario-1040687344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:33:21 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-e2f1c55e-3ff8-41eb-b928-f00d87a22cd3 tempest-TestServerVolumeAttachmentScenario-1040687344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:33:21 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-e2f1c55e-3ff8-41eb-b928-f00d87a22cd3 tempest-TestServerVolumeAttachmentScenario-1040687344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:33:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e2f1c55e-3ff8-41eb-b928-f00d87a22cd3 tempest-TestServerVolumeAttachmentScenario-1040687344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:33:21 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-e2f1c55e-3ff8-41eb-b928-f00d87a22cd3 tempest-TestServerVolumeAttachmentScenario-1040687344 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:33:21 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-e2f1c55e-3ff8-41eb-b928-f00d87a22cd3 tempest-TestServerVolumeAttachmentScenario-1040687344 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:33:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e2f1c55e-3ff8-41eb-b928-f00d87a22cd3 tempest-TestServerVolumeAttachmentScenario-1040687344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f2d2c24b-42cf-48ed-8f78-62572d105604 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:21 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-52ef1662-b1d4-4ce6-8383-322a49f7d52f tempest-TestServerVolumeAttachmentScenario-1040687344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (297418ea-9805-49c1-9c2b-e16cc21fc8fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a247759-154f-4a91-9c77-93149a217448', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:21 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-52ef1662-b1d4-4ce6-8383-322a49f7d52f tempest-TestServerVolumeAttachmentScenario-1040687344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (944f6944-dc8c-420c-bbcb-9db5c8e2ac33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:21 devstack sudo[99045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f2d2c24b-42cf-48ed-8f78-62572d105604 1073741824
Jul 14 16:33:21 devstack sudo[99045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:21 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fc6477d5-3245-4679-8281-3c511b52e931 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52aac76b-e721-410d-ad5c-2fb1b3f9da84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:33:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1421881308',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38383638-bdd1-4094-98e5-e1f4c129bd6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fa7864c52a24d52906da8195f532c63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:33:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:33:21Z,use_quota=True,user_id='2a3980ed09c24b3e98977a5423d034f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:21 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fc6477d5-3245-4679-8281-3c511b52e931 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c52ba1f-dcc9-43aa-8cfc-8adbf39edafe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:21 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fc6477d5-3245-4679-8281-3c511b52e931 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c52ba1f-dcc9-43aa-8cfc-8adbf39edafe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:21 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fc6477d5-3245-4679-8281-3c511b52e931 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b47f2537-85fe-4509-8a3f-54e3b07d0ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:21 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fc6477d5-3245-4679-8281-3c511b52e931 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b47f2537-85fe-4509-8a3f-54e3b07d0ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38383638-bdd1-4094-98e5-e1f4c129bd6e', 'volume_name': 'volume-38383638-bdd1-4094-98e5-e1f4c129bd6e', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:21 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fc6477d5-3245-4679-8281-3c511b52e931 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95372f68-95ad-4890-a6cd-efe16a7c5bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:21 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fc6477d5-3245-4679-8281-3c511b52e931 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95372f68-95ad-4890-a6cd-efe16a7c5bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:21 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fc6477d5-3245-4679-8281-3c511b52e931 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30bd2ba2-6e46-4963-98b2-d00b14895ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:21 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-fc6477d5-3245-4679-8281-3c511b52e931 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Volume 38383638-bdd1-4094-98e5-e1f4c129bd6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38383638-bdd1-4094-98e5-e1f4c129bd6e', 'volume_size': 1}
Jul 14 16:33:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-fc6477d5-3245-4679-8281-3c511b52e931 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:33:21 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-52ef1662-b1d4-4ce6-8383-322a49f7d52f tempest-TestServerVolumeAttachmentScenario-1040687344 None] Volume volume-4a247759-154f-4a91-9c77-93149a217448 (4a247759-154f-4a91-9c77-93149a217448): created successfully
Jul 14 16:33:21 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-52ef1662-b1d4-4ce6-8383-322a49f7d52f tempest-TestServerVolumeAttachmentScenario-1040687344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (944f6944-dc8c-420c-bbcb-9db5c8e2ac33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:21 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-52ef1662-b1d4-4ce6-8383-322a49f7d52f tempest-TestServerVolumeAttachmentScenario-1040687344 None] Flow 'volume_create_manager' (abb1c595-f214-4fcf-a5cb-9c591a40ab71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:33:21 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-52ef1662-b1d4-4ce6-8383-322a49f7d52f tempest-TestServerVolumeAttachmentScenario-1040687344 None] Created volume successfully.
Jul 14 16:33:22 devstack sudo[99045]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e2f1c55e-3ff8-41eb-b928-f00d87a22cd3 tempest-TestServerVolumeAttachmentScenario-1040687344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f2d2c24b-42cf-48ed-8f78-62572d105604 1073741824" returned: 0 in 0.777s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e2f1c55e-3ff8-41eb-b928-f00d87a22cd3 tempest-TestServerVolumeAttachmentScenario-1040687344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f2d2c24b-42cf-48ed-8f78-62572d105604 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:22 devstack sudo[99063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f2d2c24b-42cf-48ed-8f78-62572d105604
Jul 14 16:33:22 devstack sudo[99063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:22 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc0c5072-6f10-4af8-82a2-1db4de1de20c tempest-VolumesExtendTest-1210615344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:33:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fc0c5072-6f10-4af8-82a2-1db4de1de20c tempest-VolumesExtendTest-1210615344 None] Flow 'volume_create_manager' (87abac61-1b5b-4cef-87c7-873e9ba45116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:33:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fc0c5072-6f10-4af8-82a2-1db4de1de20c tempest-VolumesExtendTest-1210615344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41f6f8a0-8b36-4a9b-a247-388822774937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fc0c5072-6f10-4af8-82a2-1db4de1de20c tempest-VolumesExtendTest-1210615344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41f6f8a0-8b36-4a9b-a247-388822774937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:33:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-541788463',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1eceb1fa-c7eb-49dc-8697-61de7d3f2c3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c8c021fe15145da980d12cbec63fd46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:33:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:33:23Z,use_quota=True,user_id='9eed4cd42c74431ebe300eca648b8014',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fc0c5072-6f10-4af8-82a2-1db4de1de20c tempest-VolumesExtendTest-1210615344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d58bd390-e6db-43f0-8ef4-f87fe5c9b514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fc0c5072-6f10-4af8-82a2-1db4de1de20c tempest-VolumesExtendTest-1210615344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d58bd390-e6db-43f0-8ef4-f87fe5c9b514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fc0c5072-6f10-4af8-82a2-1db4de1de20c tempest-VolumesExtendTest-1210615344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a97ab3ff-0934-4edf-a895-18613afd0a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:22 devstack cinder-volume[87166]: DEBUG cinder.image.glance [None req-fc0c5072-6f10-4af8-82a2-1db4de1de20c tempest-VolumesExtendTest-1210615344 None] Creating Keystone auth plugin from conf {{(pid=87166) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 14 16:33:22 devstack sudo[99063]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e2f1c55e-3ff8-41eb-b928-f00d87a22cd3 tempest-TestServerVolumeAttachmentScenario-1040687344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f2d2c24b-42cf-48ed-8f78-62572d105604" returned: 0 in 0.469s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:22 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-e2f1c55e-3ff8-41eb-b928-f00d87a22cd3 tempest-TestServerVolumeAttachmentScenario-1040687344 None] <== create_volume: return (1312ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:33:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e2f1c55e-3ff8-41eb-b928-f00d87a22cd3 tempest-TestServerVolumeAttachmentScenario-1040687344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.316s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:33:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-fc6477d5-3245-4679-8281-3c511b52e931 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.221s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:33:22 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-fc6477d5-3245-4679-8281-3c511b52e931 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:33:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1421881308',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38383638-bdd1-4094-98e5-e1f4c129bd6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fa7864c52a24d52906da8195f532c63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:33:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:33:21Z,use_quota=True,user_id='2a3980ed09c24b3e98977a5423d034f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:33:22 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-fc6477d5-3245-4679-8281-3c511b52e931 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Creating volume 38383638-bdd1-4094-98e5-e1f4c129bd6e {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:33:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-fc6477d5-3245-4679-8281-3c511b52e931 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:33:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-fc6477d5-3245-4679-8281-3c511b52e931 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:33:22 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-fc6477d5-3245-4679-8281-3c511b52e931 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:33:22 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-fc6477d5-3245-4679-8281-3c511b52e931 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:33:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-fc6477d5-3245-4679-8281-3c511b52e931 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:33:22 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-fc6477d5-3245-4679-8281-3c511b52e931 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:33:22 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-fc6477d5-3245-4679-8281-3c511b52e931 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:33:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fc6477d5-3245-4679-8281-3c511b52e931 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-38383638-bdd1-4094-98e5-e1f4c129bd6e 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:22 devstack sudo[99070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-38383638-bdd1-4094-98e5-e1f4c129bd6e 1073741824
Jul 14 16:33:22 devstack sudo[99070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:23 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e2f1c55e-3ff8-41eb-b928-f00d87a22cd3 tempest-TestServerVolumeAttachmentScenario-1040687344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (450b22b3-47e0-4684-b71a-9e3532f8297a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2d2c24b-42cf-48ed-8f78-62572d105604', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:23 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e2f1c55e-3ff8-41eb-b928-f00d87a22cd3 tempest-TestServerVolumeAttachmentScenario-1040687344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ee3c55d-091a-45bd-8124-39d417d56230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:23 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-e2f1c55e-3ff8-41eb-b928-f00d87a22cd3 tempest-TestServerVolumeAttachmentScenario-1040687344 None] Volume volume-f2d2c24b-42cf-48ed-8f78-62572d105604 (f2d2c24b-42cf-48ed-8f78-62572d105604): created successfully
Jul 14 16:33:23 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e2f1c55e-3ff8-41eb-b928-f00d87a22cd3 tempest-TestServerVolumeAttachmentScenario-1040687344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ee3c55d-091a-45bd-8124-39d417d56230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:23 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e2f1c55e-3ff8-41eb-b928-f00d87a22cd3 tempest-TestServerVolumeAttachmentScenario-1040687344 None] Flow 'volume_create_manager' (3589b485-19c2-4657-ba33-4dd75f423888) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:33:23 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-e2f1c55e-3ff8-41eb-b928-f00d87a22cd3 tempest-TestServerVolumeAttachmentScenario-1040687344 None] Created volume successfully.
Jul 14 16:33:23 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fc0c5072-6f10-4af8-82a2-1db4de1de20c tempest-VolumesExtendTest-1210615344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a97ab3ff-0934-4edf-a895-18613afd0a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1eceb1fa-c7eb-49dc-8697-61de7d3f2c3f', 'volume_name': 'volume-1eceb1fa-c7eb-49dc-8697-61de7d3f2c3f', 'volume_size': 1, 'image_id': '9a5fa908-fde1-4478-9fb5-d52ec5aeacfd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9a5fa908-fde1-4478-9fb5-d52ec5aeacfd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6db24ec5a0f441c18a787b3e9a478713', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9a5fa908-fde1-4478-9fb5-d52ec5aeacfd', 'created_at': datetime.datetime(2026, 7, 14, 14, 17, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 14, 17, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9a5fa908-fde1-4478-9fb5-d52ec5aeacfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74f780d896a0>}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:23 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fc0c5072-6f10-4af8-82a2-1db4de1de20c tempest-VolumesExtendTest-1210615344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf844643-1c90-4647-af04-434281391288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:23 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fc0c5072-6f10-4af8-82a2-1db4de1de20c tempest-VolumesExtendTest-1210615344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf844643-1c90-4647-af04-434281391288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:23 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fc0c5072-6f10-4af8-82a2-1db4de1de20c tempest-VolumesExtendTest-1210615344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebb2a887-c893-4877-93e5-a428beb8a6b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:23 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-fc0c5072-6f10-4af8-82a2-1db4de1de20c tempest-VolumesExtendTest-1210615344 None] Volume 1eceb1fa-c7eb-49dc-8697-61de7d3f2c3f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1eceb1fa-c7eb-49dc-8697-61de7d3f2c3f', 'volume_size': 1, 'image_id': '9a5fa908-fde1-4478-9fb5-d52ec5aeacfd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9a5fa908-fde1-4478-9fb5-d52ec5aeacfd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6db24ec5a0f441c18a787b3e9a478713', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9a5fa908-fde1-4478-9fb5-d52ec5aeacfd', 'created_at': datetime.datetime(2026, 7, 14, 14, 17, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 14, 17, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9a5fa908-fde1-4478-9fb5-d52ec5aeacfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74f780d896a0>}
Jul 14 16:33:23 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc0c5072-6f10-4af8-82a2-1db4de1de20c tempest-VolumesExtendTest-1210615344 None] Trying to clone 1eceb1fa-c7eb-49dc-8697-61de7d3f2c3f from image 9a5fa908-fde1-4478-9fb5-d52ec5aeacfd at location (None, [{'url': 'file:///opt/stack/data/glance/images/9a5fa908-fde1-4478-9fb5-d52ec5aeacfd', 'metadata': {}}]). {{(pid=87166) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 14 16:33:23 devstack sudo[99070]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fc6477d5-3245-4679-8281-3c511b52e931 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-38383638-bdd1-4094-98e5-e1f4c129bd6e 1073741824" returned: 0 in 0.566s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fc6477d5-3245-4679-8281-3c511b52e931 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-38383638-bdd1-4094-98e5-e1f4c129bd6e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:23 devstack sudo[99077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-38383638-bdd1-4094-98e5-e1f4c129bd6e
Jul 14 16:33:23 devstack sudo[99077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:23 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-fc0c5072-6f10-4af8-82a2-1db4de1de20c tempest-VolumesExtendTest-1210615344 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_afhdolamdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87166) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 14 16:33:23 devstack cinder-volume[87166]: INFO cinder.image.image_utils [None req-fc0c5072-6f10-4af8-82a2-1db4de1de20c tempest-VolumesExtendTest-1210615344 None] Image download 20.69 MB at 20.69 MB/s
Jul 14 16:33:23 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a4b8a4f-526e-4b41-ab15-eb5966f4bdf3]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:33:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fc0c5072-6f10-4af8-82a2-1db4de1de20c tempest-VolumesExtendTest-1210615344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_afhdolamdevstack@QuobyteHD {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:24 devstack sudo[99077]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:24 devstack sudo[99079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_afhdolamdevstack@QuobyteHD
Jul 14 16:33:24 devstack sudo[99079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fc6477d5-3245-4679-8281-3c511b52e931 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-38383638-bdd1-4094-98e5-e1f4c129bd6e" returned: 0 in 0.391s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:24 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-fc6477d5-3245-4679-8281-3c511b52e931 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] <== create_volume: return (1099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:33:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-fc6477d5-3245-4679-8281-3c511b52e931 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:33:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fc6477d5-3245-4679-8281-3c511b52e931 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30bd2ba2-6e46-4963-98b2-d00b14895ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38383638-bdd1-4094-98e5-e1f4c129bd6e', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fc6477d5-3245-4679-8281-3c511b52e931 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a114e088-b146-4839-b349-0d1f169d0405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:24 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-fc6477d5-3245-4679-8281-3c511b52e931 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Volume volume-38383638-bdd1-4094-98e5-e1f4c129bd6e (38383638-bdd1-4094-98e5-e1f4c129bd6e): created successfully
Jul 14 16:33:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fc6477d5-3245-4679-8281-3c511b52e931 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a114e088-b146-4839-b349-0d1f169d0405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fc6477d5-3245-4679-8281-3c511b52e931 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Flow 'volume_create_manager' (83d052ff-58c7-45a0-a886-4c8a8b261f0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:33:24 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-fc6477d5-3245-4679-8281-3c511b52e931 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Created volume successfully.
Jul 14 16:33:24 devstack sudo[99079]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fc0c5072-6f10-4af8-82a2-1db4de1de20c tempest-VolumesExtendTest-1210615344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_afhdolamdevstack@QuobyteHD" returned: 0 in 0.466s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:24 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-fc0c5072-6f10-4af8-82a2-1db4de1de20c tempest-VolumesExtendTest-1210615344 None] Temporary image 9a5fa908-fde1-4478-9fb5-d52ec5aeacfd is fetched for user 9eed4cd42c74431ebe300eca648b8014. {{(pid=87166) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 14 16:33:24 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7eb479-7538-4250-8ab1-c29aaf6813ff]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:33:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fc0c5072-6f10-4af8-82a2-1db4de1de20c tempest-VolumesExtendTest-1210615344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_afhdolamdevstack@QuobyteHD {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:24 devstack sudo[99086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_afhdolamdevstack@QuobyteHD
Jul 14 16:33:24 devstack sudo[99086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:24 devstack sudo[99086]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fc0c5072-6f10-4af8-82a2-1db4de1de20c tempest-VolumesExtendTest-1210615344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_afhdolamdevstack@QuobyteHD" returned: 0 in 0.398s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-fc0c5072-6f10-4af8-82a2-1db4de1de20c tempest-VolumesExtendTest-1210615344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:33:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-fc0c5072-6f10-4af8-82a2-1db4de1de20c tempest-VolumesExtendTest-1210615344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:33:24 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-fc0c5072-6f10-4af8-82a2-1db4de1de20c tempest-VolumesExtendTest-1210615344 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:33:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-541788463',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1eceb1fa-c7eb-49dc-8697-61de7d3f2c3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c8c021fe15145da980d12cbec63fd46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:33:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:33:23Z,use_quota=True,user_id='9eed4cd42c74431ebe300eca648b8014',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:33:24 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-fc0c5072-6f10-4af8-82a2-1db4de1de20c tempest-VolumesExtendTest-1210615344 None] Creating volume 1eceb1fa-c7eb-49dc-8697-61de7d3f2c3f {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:33:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-fc0c5072-6f10-4af8-82a2-1db4de1de20c tempest-VolumesExtendTest-1210615344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:33:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-fc0c5072-6f10-4af8-82a2-1db4de1de20c tempest-VolumesExtendTest-1210615344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:33:24 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-fc0c5072-6f10-4af8-82a2-1db4de1de20c tempest-VolumesExtendTest-1210615344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:33:24 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-fc0c5072-6f10-4af8-82a2-1db4de1de20c tempest-VolumesExtendTest-1210615344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:33:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-fc0c5072-6f10-4af8-82a2-1db4de1de20c tempest-VolumesExtendTest-1210615344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:33:24 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-fc0c5072-6f10-4af8-82a2-1db4de1de20c tempest-VolumesExtendTest-1210615344 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:33:24 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-fc0c5072-6f10-4af8-82a2-1db4de1de20c tempest-VolumesExtendTest-1210615344 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:33:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fc0c5072-6f10-4af8-82a2-1db4de1de20c tempest-VolumesExtendTest-1210615344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1eceb1fa-c7eb-49dc-8697-61de7d3f2c3f 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:24 devstack sudo[99091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1eceb1fa-c7eb-49dc-8697-61de7d3f2c3f 1073741824
Jul 14 16:33:24 devstack sudo[99091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:26 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-08d73190-a342-4150-b861-ceb5dc57cb11 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:33:26 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-08d73190-a342-4150-b861-ceb5dc57cb11 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Flow 'volume_create_manager' (e29f9db7-e6f7-4d18-bd98-0dcfc5dece9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:33:26 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-08d73190-a342-4150-b861-ceb5dc57cb11 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1102508-fdbb-4a69-9af1-370ba7a8e63d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:26 devstack sudo[99091]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fc0c5072-6f10-4af8-82a2-1db4de1de20c tempest-VolumesExtendTest-1210615344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1eceb1fa-c7eb-49dc-8697-61de7d3f2c3f 1073741824" returned: 0 in 1.272s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:26 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-08d73190-a342-4150-b861-ceb5dc57cb11 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1102508-fdbb-4a69-9af1-370ba7a8e63d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:33:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1559464713',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58f7bd88-146c-4b61-b8d9-aefb8cfcae34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fa7864c52a24d52906da8195f532c63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:33:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:33:26Z,use_quota=True,user_id='2a3980ed09c24b3e98977a5423d034f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:26 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-08d73190-a342-4150-b861-ceb5dc57cb11 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9287867-00b1-4906-b69a-6d3ebde32ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:26 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-08d73190-a342-4150-b861-ceb5dc57cb11 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9287867-00b1-4906-b69a-6d3ebde32ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:26 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-08d73190-a342-4150-b861-ceb5dc57cb11 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd8ca7c3-c4c3-4f58-8896-0ee7369e91c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:26 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-08d73190-a342-4150-b861-ceb5dc57cb11 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd8ca7c3-c4c3-4f58-8896-0ee7369e91c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58f7bd88-146c-4b61-b8d9-aefb8cfcae34', 'volume_name': 'volume-58f7bd88-146c-4b61-b8d9-aefb8cfcae34', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:26 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-08d73190-a342-4150-b861-ceb5dc57cb11 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edd34d8f-009f-4ee2-865c-9827da727c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:26 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-08d73190-a342-4150-b861-ceb5dc57cb11 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edd34d8f-009f-4ee2-865c-9827da727c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:26 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-08d73190-a342-4150-b861-ceb5dc57cb11 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (584fa752-a8f5-4a0e-b811-ba14988d0f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:26 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-08d73190-a342-4150-b861-ceb5dc57cb11 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Volume 58f7bd88-146c-4b61-b8d9-aefb8cfcae34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58f7bd88-146c-4b61-b8d9-aefb8cfcae34', 'volume_size': 1}
Jul 14 16:33:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-08d73190-a342-4150-b861-ceb5dc57cb11 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:33:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fc0c5072-6f10-4af8-82a2-1db4de1de20c tempest-VolumesExtendTest-1210615344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1eceb1fa-c7eb-49dc-8697-61de7d3f2c3f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:26 devstack sudo[99164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1eceb1fa-c7eb-49dc-8697-61de7d3f2c3f
Jul 14 16:33:26 devstack sudo[99164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:26 devstack sudo[99164]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fc0c5072-6f10-4af8-82a2-1db4de1de20c tempest-VolumesExtendTest-1210615344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1eceb1fa-c7eb-49dc-8697-61de7d3f2c3f" returned: 0 in 0.665s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:26 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-fc0c5072-6f10-4af8-82a2-1db4de1de20c tempest-VolumesExtendTest-1210615344 None] <== create_volume: return (2120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:33:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-fc0c5072-6f10-4af8-82a2-1db4de1de20c tempest-VolumesExtendTest-1210615344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.142s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:33:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-08d73190-a342-4150-b861-ceb5dc57cb11 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.761s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:33:26 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-08d73190-a342-4150-b861-ceb5dc57cb11 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:33:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1559464713',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58f7bd88-146c-4b61-b8d9-aefb8cfcae34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fa7864c52a24d52906da8195f532c63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:33:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:33:26Z,use_quota=True,user_id='2a3980ed09c24b3e98977a5423d034f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:33:26 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-08d73190-a342-4150-b861-ceb5dc57cb11 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Creating volume 58f7bd88-146c-4b61-b8d9-aefb8cfcae34 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:33:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-08d73190-a342-4150-b861-ceb5dc57cb11 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:33:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-08d73190-a342-4150-b861-ceb5dc57cb11 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:33:26 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-08d73190-a342-4150-b861-ceb5dc57cb11 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:33:27 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-08d73190-a342-4150-b861-ceb5dc57cb11 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:33:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-08d73190-a342-4150-b861-ceb5dc57cb11 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:33:27 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-08d73190-a342-4150-b861-ceb5dc57cb11 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:33:27 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-08d73190-a342-4150-b861-ceb5dc57cb11 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:33:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-08d73190-a342-4150-b861-ceb5dc57cb11 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-58f7bd88-146c-4b61-b8d9-aefb8cfcae34 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:27 devstack sudo[99171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-58f7bd88-146c-4b61-b8d9-aefb8cfcae34 1073741824
Jul 14 16:33:27 devstack sudo[99171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:27 devstack cinder-volume[87166]: DEBUG cinder.volume.volume_utils [None req-fc0c5072-6f10-4af8-82a2-1db4de1de20c tempest-VolumesExtendTest-1210615344 None] Attempting download of 9a5fa908-fde1-4478-9fb5-d52ec5aeacfd ((None, [{'url': 'file:///opt/stack/data/glance/images/9a5fa908-fde1-4478-9fb5-d52ec5aeacfd', 'metadata': {}}])) to volume 1eceb1fa-c7eb-49dc-8697-61de7d3f2c3f. {{(pid=87166) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 14 16:33:27 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[480e28bd-4122-4ab2-b0a1-aa9a08aefa96]: (4, 'raw') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:33:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fc0c5072-6f10-4af8-82a2-1db4de1de20c tempest-VolumesExtendTest-1210615344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_eb_5era0 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:27 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d5aa3b9-0de9-4197-b96c-99ddcceafb12 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:33:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8d5aa3b9-0de9-4197-b96c-99ddcceafb12 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Flow 'volume_create_manager' (444eefb5-fd4a-43cc-a722-1d71048862af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:33:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8d5aa3b9-0de9-4197-b96c-99ddcceafb12 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62a7a362-0279-4ff8-8dc0-1719028c83ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8d5aa3b9-0de9-4197-b96c-99ddcceafb12 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62a7a362-0279-4ff8-8dc0-1719028c83ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:33:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-579874841',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fa9bc69-4b2c-48e1-a4cd-ba0382836cb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fa7864c52a24d52906da8195f532c63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:33:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:33:27Z,use_quota=True,user_id='2a3980ed09c24b3e98977a5423d034f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:27 devstack sudo[99174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_eb_5era0
Jul 14 16:33:27 devstack sudo[99174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8d5aa3b9-0de9-4197-b96c-99ddcceafb12 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5be702c-7520-432c-8ab0-7059049ea4e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8d5aa3b9-0de9-4197-b96c-99ddcceafb12 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5be702c-7520-432c-8ab0-7059049ea4e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8d5aa3b9-0de9-4197-b96c-99ddcceafb12 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (087668f3-4b48-41a9-83cd-02fa74ab86c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8d5aa3b9-0de9-4197-b96c-99ddcceafb12 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (087668f3-4b48-41a9-83cd-02fa74ab86c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fa9bc69-4b2c-48e1-a4cd-ba0382836cb2', 'volume_name': 'volume-2fa9bc69-4b2c-48e1-a4cd-ba0382836cb2', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8d5aa3b9-0de9-4197-b96c-99ddcceafb12 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eeeace37-cac5-46d1-88e4-ccc283604a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8d5aa3b9-0de9-4197-b96c-99ddcceafb12 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eeeace37-cac5-46d1-88e4-ccc283604a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8d5aa3b9-0de9-4197-b96c-99ddcceafb12 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a45c5606-5174-4866-a32d-e9f831d22407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:27 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-8d5aa3b9-0de9-4197-b96c-99ddcceafb12 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Volume 2fa9bc69-4b2c-48e1-a4cd-ba0382836cb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fa9bc69-4b2c-48e1-a4cd-ba0382836cb2', 'volume_size': 1}
Jul 14 16:33:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-8d5aa3b9-0de9-4197-b96c-99ddcceafb12 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:33:28 devstack sudo[99174]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fc0c5072-6f10-4af8-82a2-1db4de1de20c tempest-VolumesExtendTest-1210615344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_eb_5era0" returned: 0 in 0.780s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fc0c5072-6f10-4af8-82a2-1db4de1de20c tempest-VolumesExtendTest-1210615344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_eb_5era0 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:28 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e2dc9ec-1e44-4997-8c14-9b6dc1a7f781 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:33:28 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0e2dc9ec-1e44-4997-8c14-9b6dc1a7f781 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Flow 'volume_create_manager' (dde5b6c1-ff44-4628-b113-23b8ed61ee19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:33:28 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0e2dc9ec-1e44-4997-8c14-9b6dc1a7f781 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2485371a-04de-4699-b999-4b775b65bcb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:28 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0e2dc9ec-1e44-4997-8c14-9b6dc1a7f781 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2485371a-04de-4699-b999-4b775b65bcb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:33:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1155705348',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3a3108e-4577-4a6d-8881-dd48410a5da3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fa7864c52a24d52906da8195f532c63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:33:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:33:28Z,use_quota=True,user_id='2a3980ed09c24b3e98977a5423d034f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:28 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0e2dc9ec-1e44-4997-8c14-9b6dc1a7f781 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67293bb5-7900-4440-8db0-c9fcea5097ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:28 devstack sudo[99181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_eb_5era0
Jul 14 16:33:28 devstack sudo[99181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:28 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0e2dc9ec-1e44-4997-8c14-9b6dc1a7f781 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67293bb5-7900-4440-8db0-c9fcea5097ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:28 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0e2dc9ec-1e44-4997-8c14-9b6dc1a7f781 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (826db9b3-a68c-42d4-b8fa-2b742e282398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:28 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0e2dc9ec-1e44-4997-8c14-9b6dc1a7f781 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (826db9b3-a68c-42d4-b8fa-2b742e282398) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3a3108e-4577-4a6d-8881-dd48410a5da3', 'volume_name': 'volume-f3a3108e-4577-4a6d-8881-dd48410a5da3', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:28 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0e2dc9ec-1e44-4997-8c14-9b6dc1a7f781 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fa58bf3-1a1b-489c-bd5f-4d49c7de0f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:28 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0e2dc9ec-1e44-4997-8c14-9b6dc1a7f781 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fa58bf3-1a1b-489c-bd5f-4d49c7de0f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:28 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0e2dc9ec-1e44-4997-8c14-9b6dc1a7f781 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d09786e5-95b5-471b-9f5e-acc43fee2290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:28 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-0e2dc9ec-1e44-4997-8c14-9b6dc1a7f781 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Volume f3a3108e-4577-4a6d-8881-dd48410a5da3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3a3108e-4577-4a6d-8881-dd48410a5da3', 'volume_size': 1}
Jul 14 16:33:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0e2dc9ec-1e44-4997-8c14-9b6dc1a7f781 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:33:28 devstack sudo[99171]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-08d73190-a342-4150-b861-ceb5dc57cb11 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-58f7bd88-146c-4b61-b8d9-aefb8cfcae34 1073741824" returned: 0 in 1.531s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-08d73190-a342-4150-b861-ceb5dc57cb11 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-58f7bd88-146c-4b61-b8d9-aefb8cfcae34 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:28 devstack sudo[99184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-58f7bd88-146c-4b61-b8d9-aefb8cfcae34
Jul 14 16:33:28 devstack sudo[99184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:28 devstack sudo[99181]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fc0c5072-6f10-4af8-82a2-1db4de1de20c tempest-VolumesExtendTest-1210615344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_eb_5era0" returned: 1 in 0.765s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fc0c5072-6f10-4af8-82a2-1db4de1de20c tempest-VolumesExtendTest-1210615344 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_eb_5era0' failed. Not Retrying. {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 16:33:28 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[39768591-d7be-40fb-8537-1b122bb51a49]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:33:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fc0c5072-6f10-4af8-82a2-1db4de1de20c tempest-VolumesExtendTest-1210615344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_afhdolamdevstack@QuobyteHD {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:29 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-a11cefc9-c036-470d-8805-9502d43479a0 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:33:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a11cefc9-c036-470d-8805-9502d43479a0 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Flow 'volume_create_manager' (00c11daa-4127-451b-a51c-b5367286f0af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:33:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a11cefc9-c036-470d-8805-9502d43479a0 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93e24cc0-fc82-4cba-954b-3d72568ceadf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:29 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2a5ac445-aee4-4656-8b37-368f1dc94f11 tempest-VolumesActionsTest-1397689694 None] Acquiring lock "cinder-3c1af111-f7de-48b5-bb7e-f8e09a5ce399" by "attach_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:33:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a11cefc9-c036-470d-8805-9502d43479a0 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93e24cc0-fc82-4cba-954b-3d72568ceadf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:33:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1296364952',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d509e22a-e582-4e81-9d92-2f7ab192d69a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fa7864c52a24d52906da8195f532c63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:33:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:33:29Z,use_quota=True,user_id='2a3980ed09c24b3e98977a5423d034f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a11cefc9-c036-470d-8805-9502d43479a0 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c61d5701-93b2-43a1-8824-8cf1f22699c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a11cefc9-c036-470d-8805-9502d43479a0 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c61d5701-93b2-43a1-8824-8cf1f22699c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a11cefc9-c036-470d-8805-9502d43479a0 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df7200d7-0639-4266-a581-9fa96630eb90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a11cefc9-c036-470d-8805-9502d43479a0 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df7200d7-0639-4266-a581-9fa96630eb90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd509e22a-e582-4e81-9d92-2f7ab192d69a', 'volume_name': 'volume-d509e22a-e582-4e81-9d92-2f7ab192d69a', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a11cefc9-c036-470d-8805-9502d43479a0 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fbd8fc5-98b9-4dd5-855f-83042cb5612b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a11cefc9-c036-470d-8805-9502d43479a0 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fbd8fc5-98b9-4dd5-855f-83042cb5612b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a11cefc9-c036-470d-8805-9502d43479a0 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54806fe8-789f-47f1-aaa3-4d3b8d2c81b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:29 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-a11cefc9-c036-470d-8805-9502d43479a0 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Volume d509e22a-e582-4e81-9d92-2f7ab192d69a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d509e22a-e582-4e81-9d92-2f7ab192d69a', 'volume_size': 1}
Jul 14 16:33:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a11cefc9-c036-470d-8805-9502d43479a0 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:33:29 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2a5ac445-aee4-4656-8b37-368f1dc94f11 tempest-VolumesActionsTest-1397689694 None] Lock "cinder-3c1af111-f7de-48b5-bb7e-f8e09a5ce399" acquired by "attach_volume" :: waited 0.107s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:33:29 devstack sudo[99184]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-08d73190-a342-4150-b861-ceb5dc57cb11 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-58f7bd88-146c-4b61-b8d9-aefb8cfcae34" returned: 0 in 0.703s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-08d73190-a342-4150-b861-ceb5dc57cb11 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] <== create_volume: return (2305ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:33:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-08d73190-a342-4150-b861-ceb5dc57cb11 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.313s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:33:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-8d5aa3b9-0de9-4197-b96c-99ddcceafb12 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.552s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:33:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-8d5aa3b9-0de9-4197-b96c-99ddcceafb12 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:33:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-579874841',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fa9bc69-4b2c-48e1-a4cd-ba0382836cb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fa7864c52a24d52906da8195f532c63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:33:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:33:27Z,use_quota=True,user_id='2a3980ed09c24b3e98977a5423d034f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:33:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-8d5aa3b9-0de9-4197-b96c-99ddcceafb12 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Creating volume 2fa9bc69-4b2c-48e1-a4cd-ba0382836cb2 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:33:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-8d5aa3b9-0de9-4197-b96c-99ddcceafb12 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:33:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-8d5aa3b9-0de9-4197-b96c-99ddcceafb12 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:33:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-8d5aa3b9-0de9-4197-b96c-99ddcceafb12 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:33:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-8d5aa3b9-0de9-4197-b96c-99ddcceafb12 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:33:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-8d5aa3b9-0de9-4197-b96c-99ddcceafb12 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:33:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-8d5aa3b9-0de9-4197-b96c-99ddcceafb12 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:33:29 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-8d5aa3b9-0de9-4197-b96c-99ddcceafb12 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:33:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-8d5aa3b9-0de9-4197-b96c-99ddcceafb12 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2fa9bc69-4b2c-48e1-a4cd-ba0382836cb2 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:29 devstack sudo[99188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_afhdolamdevstack@QuobyteHD
Jul 14 16:33:29 devstack sudo[99188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-08d73190-a342-4150-b861-ceb5dc57cb11 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (584fa752-a8f5-4a0e-b811-ba14988d0f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58f7bd88-146c-4b61-b8d9-aefb8cfcae34', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-08d73190-a342-4150-b861-ceb5dc57cb11 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (789f551f-eb0e-4261-8466-61f04534e9ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:29 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-08d73190-a342-4150-b861-ceb5dc57cb11 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Volume volume-58f7bd88-146c-4b61-b8d9-aefb8cfcae34 (58f7bd88-146c-4b61-b8d9-aefb8cfcae34): created successfully
Jul 14 16:33:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-08d73190-a342-4150-b861-ceb5dc57cb11 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (789f551f-eb0e-4261-8466-61f04534e9ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-08d73190-a342-4150-b861-ceb5dc57cb11 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Flow 'volume_create_manager' (e29f9db7-e6f7-4d18-bd98-0dcfc5dece9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:33:29 devstack sudo[99192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2fa9bc69-4b2c-48e1-a4cd-ba0382836cb2 1073741824
Jul 14 16:33:29 devstack sudo[99192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:29 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-2a5ac445-aee4-4656-8b37-368f1dc94f11 tempest-VolumesActionsTest-1397689694 None] Attaching volume 3c1af111-f7de-48b5-bb7e-f8e09a5ce399 to instance 604fd74c-c4ac-410b-8cc9-65ee42eeba98 at mountpoint /dev/vdb on host None.
Jul 14 16:33:29 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-08d73190-a342-4150-b861-ceb5dc57cb11 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Created volume successfully.
Jul 14 16:33:29 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-2a5ac445-aee4-4656-8b37-368f1dc94f11 tempest-VolumesActionsTest-1397689694 None] Attach volume completed successfully.
Jul 14 16:33:29 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2a5ac445-aee4-4656-8b37-368f1dc94f11 tempest-VolumesActionsTest-1397689694 None] Lock "cinder-3c1af111-f7de-48b5-bb7e-f8e09a5ce399" released by "attach_volume" :: held 0.348s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:33:29 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-acb381b7-387b-4668-b62a-51ff5c9c5648 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:33:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-acb381b7-387b-4668-b62a-51ff5c9c5648 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Flow 'volume_create_manager' (bc823661-c5e9-46c5-9d6c-409d79ec70e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:33:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-acb381b7-387b-4668-b62a-51ff5c9c5648 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (999ca41a-390a-4fa6-852b-efced48af53e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:30 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-acb381b7-387b-4668-b62a-51ff5c9c5648 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (999ca41a-390a-4fa6-852b-efced48af53e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:33:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-586933070',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1b75662-fe13-49c1-aad0-f546a7d1a1da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fa7864c52a24d52906da8195f532c63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:33:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:33:30Z,use_quota=True,user_id='2a3980ed09c24b3e98977a5423d034f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:30 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-acb381b7-387b-4668-b62a-51ff5c9c5648 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fab3735-205a-456b-8aad-85679c96b74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:30 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-acb381b7-387b-4668-b62a-51ff5c9c5648 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fab3735-205a-456b-8aad-85679c96b74e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:30 devstack sudo[99188]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:30 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-acb381b7-387b-4668-b62a-51ff5c9c5648 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f471035-0be7-4e1f-b046-0c2cc8c2eef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:30 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-acb381b7-387b-4668-b62a-51ff5c9c5648 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f471035-0be7-4e1f-b046-0c2cc8c2eef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1b75662-fe13-49c1-aad0-f546a7d1a1da', 'volume_name': 'volume-b1b75662-fe13-49c1-aad0-f546a7d1a1da', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:30 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-acb381b7-387b-4668-b62a-51ff5c9c5648 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40a3b4f0-aa4f-474d-bbd6-9da58ef8af6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:30 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-acb381b7-387b-4668-b62a-51ff5c9c5648 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40a3b4f0-aa4f-474d-bbd6-9da58ef8af6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:30 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-acb381b7-387b-4668-b62a-51ff5c9c5648 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53f8703b-2a97-412d-a455-8e49ab268a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:30 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-acb381b7-387b-4668-b62a-51ff5c9c5648 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Volume b1b75662-fe13-49c1-aad0-f546a7d1a1da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1b75662-fe13-49c1-aad0-f546a7d1a1da', 'volume_size': 1}
Jul 14 16:33:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-acb381b7-387b-4668-b62a-51ff5c9c5648 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:33:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fc0c5072-6f10-4af8-82a2-1db4de1de20c tempest-VolumesExtendTest-1210615344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_afhdolamdevstack@QuobyteHD" returned: 0 in 1.223s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:30 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-fc0c5072-6f10-4af8-82a2-1db4de1de20c tempest-VolumesExtendTest-1210615344 None] 9a5fa908-fde1-4478-9fb5-d52ec5aeacfd was qcow2, converting to raw {{(pid=87166) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 14 16:33:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fc0c5072-6f10-4af8-82a2-1db4de1de20c tempest-VolumesExtendTest-1210615344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_afhdolamdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1eceb1fa-c7eb-49dc-8697-61de7d3f2c3f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:30 devstack sudo[99200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_afhdolamdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1eceb1fa-c7eb-49dc-8697-61de7d3f2c3f
Jul 14 16:33:30 devstack sudo[99200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:30 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-52a8d6d3-0c52-4b79-aec1-e859895136c5 tempest-VolumesActionsTest-1397689694 None] Acquiring lock "cinder-3c1af111-f7de-48b5-bb7e-f8e09a5ce399-detach_volume" by "detach_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:33:30 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-52a8d6d3-0c52-4b79-aec1-e859895136c5 tempest-VolumesActionsTest-1397689694 None] Lock "cinder-3c1af111-f7de-48b5-bb7e-f8e09a5ce399-detach_volume" acquired by "detach_volume" :: waited 0.034s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:33:30 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-52a8d6d3-0c52-4b79-aec1-e859895136c5 tempest-VolumesActionsTest-1397689694 None] Detaching volume 3c1af111-f7de-48b5-bb7e-f8e09a5ce399 from instance 604fd74c-c4ac-410b-8cc9-65ee42eeba98.
Jul 14 16:33:30 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-52a8d6d3-0c52-4b79-aec1-e859895136c5 tempest-VolumesActionsTest-1397689694 None] Detach volume completed successfully.
Jul 14 16:33:30 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-52a8d6d3-0c52-4b79-aec1-e859895136c5 tempest-VolumesActionsTest-1397689694 None] Lock "cinder-3c1af111-f7de-48b5-bb7e-f8e09a5ce399-detach_volume" released by "detach_volume" :: held 0.150s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:33:30 devstack sudo[99192]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-8d5aa3b9-0de9-4197-b96c-99ddcceafb12 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2fa9bc69-4b2c-48e1-a4cd-ba0382836cb2 1073741824" returned: 0 in 1.359s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-8d5aa3b9-0de9-4197-b96c-99ddcceafb12 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2fa9bc69-4b2c-48e1-a4cd-ba0382836cb2 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:30 devstack sudo[99219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2fa9bc69-4b2c-48e1-a4cd-ba0382836cb2
Jul 14 16:33:30 devstack sudo[99219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:31 devstack sudo[99219]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-8d5aa3b9-0de9-4197-b96c-99ddcceafb12 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2fa9bc69-4b2c-48e1-a4cd-ba0382836cb2" returned: 0 in 0.685s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:31 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-8d5aa3b9-0de9-4197-b96c-99ddcceafb12 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] <== create_volume: return (2172ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:33:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-8d5aa3b9-0de9-4197-b96c-99ddcceafb12 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.177s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:33:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0e2dc9ec-1e44-4997-8c14-9b6dc1a7f781 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.131s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:33:31 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0e2dc9ec-1e44-4997-8c14-9b6dc1a7f781 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:33:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1155705348',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3a3108e-4577-4a6d-8881-dd48410a5da3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fa7864c52a24d52906da8195f532c63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:33:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:33:28Z,use_quota=True,user_id='2a3980ed09c24b3e98977a5423d034f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:33:31 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-0e2dc9ec-1e44-4997-8c14-9b6dc1a7f781 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Creating volume f3a3108e-4577-4a6d-8881-dd48410a5da3 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:33:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0e2dc9ec-1e44-4997-8c14-9b6dc1a7f781 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:33:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0e2dc9ec-1e44-4997-8c14-9b6dc1a7f781 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:33:31 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0e2dc9ec-1e44-4997-8c14-9b6dc1a7f781 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:33:31 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0e2dc9ec-1e44-4997-8c14-9b6dc1a7f781 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:33:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0e2dc9ec-1e44-4997-8c14-9b6dc1a7f781 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:33:31 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0e2dc9ec-1e44-4997-8c14-9b6dc1a7f781 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:33:31 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-0e2dc9ec-1e44-4997-8c14-9b6dc1a7f781 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:33:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0e2dc9ec-1e44-4997-8c14-9b6dc1a7f781 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f3a3108e-4577-4a6d-8881-dd48410a5da3 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:31 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8d5aa3b9-0de9-4197-b96c-99ddcceafb12 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a45c5606-5174-4866-a32d-e9f831d22407) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fa9bc69-4b2c-48e1-a4cd-ba0382836cb2', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:31 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8d5aa3b9-0de9-4197-b96c-99ddcceafb12 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5d2c0cb-46f2-41fb-ae74-76298fed5e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:31 devstack sudo[99237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f3a3108e-4577-4a6d-8881-dd48410a5da3 1073741824
Jul 14 16:33:31 devstack sudo[99237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:31 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-8d5aa3b9-0de9-4197-b96c-99ddcceafb12 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Volume volume-2fa9bc69-4b2c-48e1-a4cd-ba0382836cb2 (2fa9bc69-4b2c-48e1-a4cd-ba0382836cb2): created successfully
Jul 14 16:33:31 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8d5aa3b9-0de9-4197-b96c-99ddcceafb12 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5d2c0cb-46f2-41fb-ae74-76298fed5e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:31 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8d5aa3b9-0de9-4197-b96c-99ddcceafb12 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Flow 'volume_create_manager' (444eefb5-fd4a-43cc-a722-1d71048862af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:33:31 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-8d5aa3b9-0de9-4197-b96c-99ddcceafb12 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Created volume successfully.
Jul 14 16:33:32 devstack sudo[99237]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0e2dc9ec-1e44-4997-8c14-9b6dc1a7f781 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f3a3108e-4577-4a6d-8881-dd48410a5da3 1073741824" returned: 0 in 0.822s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0e2dc9ec-1e44-4997-8c14-9b6dc1a7f781 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f3a3108e-4577-4a6d-8881-dd48410a5da3 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:32 devstack sudo[99254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f3a3108e-4577-4a6d-8881-dd48410a5da3
Jul 14 16:33:32 devstack sudo[99254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:32 devstack sudo[99254]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0e2dc9ec-1e44-4997-8c14-9b6dc1a7f781 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f3a3108e-4577-4a6d-8881-dd48410a5da3" returned: 0 in 0.492s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:32 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0e2dc9ec-1e44-4997-8c14-9b6dc1a7f781 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] <== create_volume: return (1398ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:33:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0e2dc9ec-1e44-4997-8c14-9b6dc1a7f781 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.401s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:33:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a11cefc9-c036-470d-8805-9502d43479a0 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.696s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:33:32 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a11cefc9-c036-470d-8805-9502d43479a0 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:33:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1296364952',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d509e22a-e582-4e81-9d92-2f7ab192d69a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fa7864c52a24d52906da8195f532c63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:33:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:33:29Z,use_quota=True,user_id='2a3980ed09c24b3e98977a5423d034f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:33:32 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-a11cefc9-c036-470d-8805-9502d43479a0 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Creating volume d509e22a-e582-4e81-9d92-2f7ab192d69a {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:33:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a11cefc9-c036-470d-8805-9502d43479a0 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:33:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a11cefc9-c036-470d-8805-9502d43479a0 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:33:32 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a11cefc9-c036-470d-8805-9502d43479a0 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:33:32 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a11cefc9-c036-470d-8805-9502d43479a0 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:33:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a11cefc9-c036-470d-8805-9502d43479a0 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:33:32 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a11cefc9-c036-470d-8805-9502d43479a0 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:33:32 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-a11cefc9-c036-470d-8805-9502d43479a0 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:33:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a11cefc9-c036-470d-8805-9502d43479a0 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d509e22a-e582-4e81-9d92-2f7ab192d69a 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:32 devstack sudo[99259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d509e22a-e582-4e81-9d92-2f7ab192d69a 1073741824
Jul 14 16:33:32 devstack sudo[99259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:32 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0e2dc9ec-1e44-4997-8c14-9b6dc1a7f781 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d09786e5-95b5-471b-9f5e-acc43fee2290) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3a3108e-4577-4a6d-8881-dd48410a5da3', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:32 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0e2dc9ec-1e44-4997-8c14-9b6dc1a7f781 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11f6cfc9-4a62-4d58-875b-87d2f29f4642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:33 devstack sudo[99200]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:33 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-0e2dc9ec-1e44-4997-8c14-9b6dc1a7f781 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Volume volume-f3a3108e-4577-4a6d-8881-dd48410a5da3 (f3a3108e-4577-4a6d-8881-dd48410a5da3): created successfully
Jul 14 16:33:33 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0e2dc9ec-1e44-4997-8c14-9b6dc1a7f781 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11f6cfc9-4a62-4d58-875b-87d2f29f4642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:33 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0e2dc9ec-1e44-4997-8c14-9b6dc1a7f781 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Flow 'volume_create_manager' (dde5b6c1-ff44-4628-b113-23b8ed61ee19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:33:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fc0c5072-6f10-4af8-82a2-1db4de1de20c tempest-VolumesExtendTest-1210615344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_afhdolamdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1eceb1fa-c7eb-49dc-8697-61de7d3f2c3f" returned: 0 in 2.890s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:33 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-fc0c5072-6f10-4af8-82a2-1db4de1de20c tempest-VolumesExtendTest-1210615344 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_afhdolamdevstack@QuobyteHD, size 112.00 MB, duration 2.89 sec, destination /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1eceb1fa-c7eb-49dc-8697-61de7d3f2c3f {{(pid=87166) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 14 16:33:33 devstack cinder-volume[87166]: INFO cinder.image.image_utils [None req-fc0c5072-6f10-4af8-82a2-1db4de1de20c tempest-VolumesExtendTest-1210615344 None] Converted 112.00 MB image at 38.73 MB/s
Jul 14 16:33:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fc0c5072-6f10-4af8-82a2-1db4de1de20c tempest-VolumesExtendTest-1210615344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1eceb1fa-c7eb-49dc-8697-61de7d3f2c3f 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:33 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-0e2dc9ec-1e44-4997-8c14-9b6dc1a7f781 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Created volume successfully.
Jul 14 16:33:33 devstack sudo[99261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1eceb1fa-c7eb-49dc-8697-61de7d3f2c3f 1G
Jul 14 16:33:33 devstack sudo[99261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:33 devstack sudo[99261]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fc0c5072-6f10-4af8-82a2-1db4de1de20c tempest-VolumesExtendTest-1210615344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1eceb1fa-c7eb-49dc-8697-61de7d3f2c3f 1G" returned: 0 in 0.386s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:33 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a5009a-c143-4b21-9a7a-e127ba88e5e1]: (4, 'raw') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:33:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fc0c5072-6f10-4af8-82a2-1db4de1de20c tempest-VolumesExtendTest-1210615344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1eceb1fa-c7eb-49dc-8697-61de7d3f2c3f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:33 devstack sudo[99270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1eceb1fa-c7eb-49dc-8697-61de7d3f2c3f
Jul 14 16:33:33 devstack sudo[99270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:33 devstack sudo[99259]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a11cefc9-c036-470d-8805-9502d43479a0 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d509e22a-e582-4e81-9d92-2f7ab192d69a 1073741824" returned: 0 in 0.703s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a11cefc9-c036-470d-8805-9502d43479a0 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d509e22a-e582-4e81-9d92-2f7ab192d69a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:33 devstack sudo[99273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d509e22a-e582-4e81-9d92-2f7ab192d69a
Jul 14 16:33:33 devstack sudo[99273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:33 devstack sudo[99270]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fc0c5072-6f10-4af8-82a2-1db4de1de20c tempest-VolumesExtendTest-1210615344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1eceb1fa-c7eb-49dc-8697-61de7d3f2c3f" returned: 0 in 0.400s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fc0c5072-6f10-4af8-82a2-1db4de1de20c tempest-VolumesExtendTest-1210615344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1eceb1fa-c7eb-49dc-8697-61de7d3f2c3f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:33 devstack sudo[99273]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a11cefc9-c036-470d-8805-9502d43479a0 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d509e22a-e582-4e81-9d92-2f7ab192d69a" returned: 0 in 0.265s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:33 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a11cefc9-c036-470d-8805-9502d43479a0 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:33:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a11cefc9-c036-470d-8805-9502d43479a0 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:33:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-acb381b7-387b-4668-b62a-51ff5c9c5648 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.788s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:33:33 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-acb381b7-387b-4668-b62a-51ff5c9c5648 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:33:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-586933070',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1b75662-fe13-49c1-aad0-f546a7d1a1da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fa7864c52a24d52906da8195f532c63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:33:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:33:30Z,use_quota=True,user_id='2a3980ed09c24b3e98977a5423d034f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:33:33 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-acb381b7-387b-4668-b62a-51ff5c9c5648 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Creating volume b1b75662-fe13-49c1-aad0-f546a7d1a1da {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:33:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-acb381b7-387b-4668-b62a-51ff5c9c5648 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:33:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-acb381b7-387b-4668-b62a-51ff5c9c5648 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:33:33 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-acb381b7-387b-4668-b62a-51ff5c9c5648 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:33:33 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-acb381b7-387b-4668-b62a-51ff5c9c5648 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:33:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-acb381b7-387b-4668-b62a-51ff5c9c5648 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:33:33 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-acb381b7-387b-4668-b62a-51ff5c9c5648 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:33:33 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-acb381b7-387b-4668-b62a-51ff5c9c5648 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:33:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-acb381b7-387b-4668-b62a-51ff5c9c5648 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1b75662-fe13-49c1-aad0-f546a7d1a1da 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:33 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a11cefc9-c036-470d-8805-9502d43479a0 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54806fe8-789f-47f1-aaa3-4d3b8d2c81b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d509e22a-e582-4e81-9d92-2f7ab192d69a', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:33 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a11cefc9-c036-470d-8805-9502d43479a0 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4b8f37e-c151-40a1-84f1-a3b2cf4ee2d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:33 devstack sudo[99280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1b75662-fe13-49c1-aad0-f546a7d1a1da 1073741824
Jul 14 16:33:33 devstack sudo[99280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:33 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-a11cefc9-c036-470d-8805-9502d43479a0 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Volume volume-d509e22a-e582-4e81-9d92-2f7ab192d69a (d509e22a-e582-4e81-9d92-2f7ab192d69a): created successfully
Jul 14 16:33:33 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a11cefc9-c036-470d-8805-9502d43479a0 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4b8f37e-c151-40a1-84f1-a3b2cf4ee2d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:33 devstack sudo[99278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1eceb1fa-c7eb-49dc-8697-61de7d3f2c3f
Jul 14 16:33:33 devstack sudo[99278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:33 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a11cefc9-c036-470d-8805-9502d43479a0 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Flow 'volume_create_manager' (00c11daa-4127-451b-a51c-b5367286f0af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:33:34 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-a11cefc9-c036-470d-8805-9502d43479a0 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Created volume successfully.
Jul 14 16:33:34 devstack sudo[99278]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fc0c5072-6f10-4af8-82a2-1db4de1de20c tempest-VolumesExtendTest-1210615344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1eceb1fa-c7eb-49dc-8697-61de7d3f2c3f" returned: 1 in 0.504s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fc0c5072-6f10-4af8-82a2-1db4de1de20c tempest-VolumesExtendTest-1210615344 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1eceb1fa-c7eb-49dc-8697-61de7d3f2c3f' failed. Not Retrying. {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 16:33:34 devstack cinder-volume[87166]: DEBUG cinder.volume.volume_utils [None req-fc0c5072-6f10-4af8-82a2-1db4de1de20c tempest-VolumesExtendTest-1210615344 None] Downloaded image 9a5fa908-fde1-4478-9fb5-d52ec5aeacfd ((None, [{'url': 'file:///opt/stack/data/glance/images/9a5fa908-fde1-4478-9fb5-d52ec5aeacfd', 'metadata': {}}])) to volume 1eceb1fa-c7eb-49dc-8697-61de7d3f2c3f successfully. {{(pid=87166) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 14 16:33:34 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-fc0c5072-6f10-4af8-82a2-1db4de1de20c tempest-VolumesExtendTest-1210615344 None] Temporary image 9a5fa908-fde1-4478-9fb5-d52ec5aeacfd for user 9eed4cd42c74431ebe300eca648b8014 is deleted. {{(pid=87166) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 14 16:33:34 devstack cinder-volume[87166]: DEBUG cinder.volume.volume_utils [None req-fc0c5072-6f10-4af8-82a2-1db4de1de20c tempest-VolumesExtendTest-1210615344 None] Marking volume 1eceb1fa-c7eb-49dc-8697-61de7d3f2c3f as bootable. {{(pid=87166) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 14 16:33:34 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc0c5072-6f10-4af8-82a2-1db4de1de20c tempest-VolumesExtendTest-1210615344 None] Copying metadata from image 9a5fa908-fde1-4478-9fb5-d52ec5aeacfd to 1eceb1fa-c7eb-49dc-8697-61de7d3f2c3f. {{(pid=87166) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 14 16:33:34 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc0c5072-6f10-4af8-82a2-1db4de1de20c tempest-VolumesExtendTest-1210615344 None] Creating volume glance metadata for volume 1eceb1fa-c7eb-49dc-8697-61de7d3f2c3f backed by image 9a5fa908-fde1-4478-9fb5-d52ec5aeacfd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9a5fa908-fde1-4478-9fb5-d52ec5aeacfd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87166) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 14 16:33:34 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fc0c5072-6f10-4af8-82a2-1db4de1de20c tempest-VolumesExtendTest-1210615344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebb2a887-c893-4877-93e5-a428beb8a6b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1eceb1fa-c7eb-49dc-8697-61de7d3f2c3f', 'volume_size': 1, 'image_id': '9a5fa908-fde1-4478-9fb5-d52ec5aeacfd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9a5fa908-fde1-4478-9fb5-d52ec5aeacfd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6db24ec5a0f441c18a787b3e9a478713', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9a5fa908-fde1-4478-9fb5-d52ec5aeacfd', 'created_at': datetime.datetime(2026, 7, 14, 14, 17, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 14, 17, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9a5fa908-fde1-4478-9fb5-d52ec5aeacfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74f780d896a0>}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:34 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fc0c5072-6f10-4af8-82a2-1db4de1de20c tempest-VolumesExtendTest-1210615344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30730347-9782-4582-a257-59ef4a8e2eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:34 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-fc0c5072-6f10-4af8-82a2-1db4de1de20c tempest-VolumesExtendTest-1210615344 None] Volume volume-1eceb1fa-c7eb-49dc-8697-61de7d3f2c3f (1eceb1fa-c7eb-49dc-8697-61de7d3f2c3f): created successfully
Jul 14 16:33:34 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fc0c5072-6f10-4af8-82a2-1db4de1de20c tempest-VolumesExtendTest-1210615344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30730347-9782-4582-a257-59ef4a8e2eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:34 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fc0c5072-6f10-4af8-82a2-1db4de1de20c tempest-VolumesExtendTest-1210615344 None] Flow 'volume_create_manager' (87abac61-1b5b-4cef-87c7-873e9ba45116) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:33:34 devstack sudo[99280]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:34 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-fc0c5072-6f10-4af8-82a2-1db4de1de20c tempest-VolumesExtendTest-1210615344 None] Created volume successfully.
Jul 14 16:33:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-acb381b7-387b-4668-b62a-51ff5c9c5648 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1b75662-fe13-49c1-aad0-f546a7d1a1da 1073741824" returned: 0 in 0.913s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-acb381b7-387b-4668-b62a-51ff5c9c5648 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1b75662-fe13-49c1-aad0-f546a7d1a1da {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:34 devstack sudo[99340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1b75662-fe13-49c1-aad0-f546a7d1a1da
Jul 14 16:33:35 devstack sudo[99340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:35 devstack sudo[99340]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-acb381b7-387b-4668-b62a-51ff5c9c5648 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1b75662-fe13-49c1-aad0-f546a7d1a1da" returned: 0 in 0.448s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-acb381b7-387b-4668-b62a-51ff5c9c5648 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] <== create_volume: return (1457ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:33:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-acb381b7-387b-4668-b62a-51ff5c9c5648 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.461s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:33:35 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 16:33:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:33:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:33:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:33:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:33:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:33:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:35 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-acb381b7-387b-4668-b62a-51ff5c9c5648 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53f8703b-2a97-412d-a455-8e49ab268a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1b75662-fe13-49c1-aad0-f546a7d1a1da', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:35 devstack sudo[99351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:33:35 devstack sudo[99351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:35 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-acb381b7-387b-4668-b62a-51ff5c9c5648 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bde8b22b-790e-4b4d-be22-312a7b6ae7d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d2d192fa-c5b6-40e1-8835-a8ad9c85065e tempest-VolumesExtendTest-1210615344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:33:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d2d192fa-c5b6-40e1-8835-a8ad9c85065e tempest-VolumesExtendTest-1210615344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.005s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:33:35 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-acb381b7-387b-4668-b62a-51ff5c9c5648 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Volume volume-b1b75662-fe13-49c1-aad0-f546a7d1a1da (b1b75662-fe13-49c1-aad0-f546a7d1a1da): created successfully
Jul 14 16:33:35 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-acb381b7-387b-4668-b62a-51ff5c9c5648 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bde8b22b-790e-4b4d-be22-312a7b6ae7d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:35 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-acb381b7-387b-4668-b62a-51ff5c9c5648 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Flow 'volume_create_manager' (bc823661-c5e9-46c5-9d6c-409d79ec70e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:33:35 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[b389476c-22c8-4da8-bd03-590961206286]: (4, 'raw') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:33:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d2d192fa-c5b6-40e1-8835-a8ad9c85065e tempest-VolumesExtendTest-1210615344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1eceb1fa-c7eb-49dc-8697-61de7d3f2c3f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:35 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-acb381b7-387b-4668-b62a-51ff5c9c5648 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Created volume successfully.
Jul 14 16:33:35 devstack sudo[99351]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:35 devstack sudo[99356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1eceb1fa-c7eb-49dc-8697-61de7d3f2c3f
Jul 14 16:33:35 devstack sudo[99356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.484s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:35 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:33:35 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Running periodic task VolumeManager._thread_info {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 16:33:35 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] thread count: 28 {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 14 16:33:35 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] thread info: [<_MainThread(MainThread, started 128606490927232)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128606415432960)>, <Thread(Thread-3 (stat_writer), started daemon 128606378859328)>, <Thread(Rabbit-heartbeat, started daemon 128606379646144)>, <Thread(Thread-5 (_runner), started daemon 128606377685824)>, <Thread(Thread-7 (_runner), started daemon 128606377701888)>, <Thread(fd_logger, started daemon 128606377091392)>, <Thread(privsep_reader, started daemon 128606375782080)>, <Thread(tpool_thread_0, started daemon 128606365607616)>, <Thread(tpool_thread_1, started daemon 128606357214912)>, <Thread(tpool_thread_2, started daemon 128606348822208)>, <Thread(tpool_thread_3, started daemon 128606340413120)>, <Thread(tpool_thread_4, started daemon 128606332004032)>, <Thread(tpool_thread_5, started daemon 128606323594944)>, <Thread(tpool_thread_6, started daemon 128606315185856)>, <Thread(tpool_thread_7, started daemon 128606306776768)>, <Thread(tpool_thread_8, started daemon 128606298367680)>, <Thread(tpool_thread_9, started daemon 128606289958592)>, <Thread(tpool_thread_10, started daemon 128606281549504)>, <Thread(tpool_thread_11, started daemon 128606273140416)>, <Thread(tpool_thread_12, started daemon 128606264731328)>, <Thread(tpool_thread_13, started daemon 128606256322240)>, <Thread(tpool_thread_14, started daemon 128606247913152)>, <Thread(tpool_thread_15, started daemon 128606239504064)>, <Thread(tpool_thread_16, started daemon 128606231094976)>, <Thread(tpool_thread_17, started daemon 128606222685888)>, <Thread(tpool_thread_18, started daemon 128606214276800)>, <Thread(tpool_thread_19, started daemon 128606205867712)>] {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 14 16:33:36 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4c9849b0-8e03-4f57-b632-2bd8b75703bb tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Acquiring lock "cinder-b1b75662-fe13-49c1-aad0-f546a7d1a1da-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:33:36 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4c9849b0-8e03-4f57-b632-2bd8b75703bb tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Lock "cinder-b1b75662-fe13-49c1-aad0-f546a7d1a1da-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:33:36 devstack sudo[99356]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d2d192fa-c5b6-40e1-8835-a8ad9c85065e tempest-VolumesExtendTest-1210615344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1eceb1fa-c7eb-49dc-8697-61de7d3f2c3f" returned: 0 in 0.611s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d2d192fa-c5b6-40e1-8835-a8ad9c85065e tempest-VolumesExtendTest-1210615344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1eceb1fa-c7eb-49dc-8697-61de7d3f2c3f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:36 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4c9849b0-8e03-4f57-b632-2bd8b75703bb tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Acquiring lock "cinder-quobyte-b1b75662-fe13-49c1-aad0-f546a7d1a1da" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:33:36 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4c9849b0-8e03-4f57-b632-2bd8b75703bb tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Lock "cinder-quobyte-b1b75662-fe13-49c1-aad0-f546a7d1a1da" acquired by "delete_volume" :: waited 0.030s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:33:36 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[20975d50-02dd-44fc-993c-c4fcf5488be5]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:33:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4c9849b0-8e03-4f57-b632-2bd8b75703bb tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1b75662-fe13-49c1-aad0-f546a7d1a1da {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:36 devstack sudo[99364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1eceb1fa-c7eb-49dc-8697-61de7d3f2c3f
Jul 14 16:33:36 devstack sudo[99364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:36 devstack sudo[99367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1b75662-fe13-49c1-aad0-f546a7d1a1da
Jul 14 16:33:36 devstack sudo[99367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:36 devstack sudo[99364]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d2d192fa-c5b6-40e1-8835-a8ad9c85065e tempest-VolumesExtendTest-1210615344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1eceb1fa-c7eb-49dc-8697-61de7d3f2c3f" returned: 1 in 0.387s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d2d192fa-c5b6-40e1-8835-a8ad9c85065e tempest-VolumesExtendTest-1210615344 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1eceb1fa-c7eb-49dc-8697-61de7d3f2c3f' failed. Not Retrying. {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 16:33:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d2d192fa-c5b6-40e1-8835-a8ad9c85065e tempest-VolumesExtendTest-1210615344 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1eceb1fa-c7eb-49dc-8697-61de7d3f2c3f 2G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:36 devstack sudo[99367]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4c9849b0-8e03-4f57-b632-2bd8b75703bb tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1b75662-fe13-49c1-aad0-f546a7d1a1da" returned: 0 in 0.398s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4c9849b0-8e03-4f57-b632-2bd8b75703bb tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1b75662-fe13-49c1-aad0-f546a7d1a1da {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d2d192fa-c5b6-40e1-8835-a8ad9c85065e tempest-VolumesExtendTest-1210615344 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1eceb1fa-c7eb-49dc-8697-61de7d3f2c3f 2G" returned: 0 in 0.095s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d2d192fa-c5b6-40e1-8835-a8ad9c85065e tempest-VolumesExtendTest-1210615344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.197s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:33:36 devstack sudo[99379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1b75662-fe13-49c1-aad0-f546a7d1a1da
Jul 14 16:33:36 devstack sudo[99379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:36 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-d2d192fa-c5b6-40e1-8835-a8ad9c85065e tempest-VolumesExtendTest-1210615344 None] Extend volume completed successfully.
Jul 14 16:33:37 devstack sudo[99379]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4c9849b0-8e03-4f57-b632-2bd8b75703bb tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b1b75662-fe13-49c1-aad0-f546a7d1a1da" returned: 0 in 0.314s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:37 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4c9849b0-8e03-4f57-b632-2bd8b75703bb tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Lock "cinder-quobyte-b1b75662-fe13-49c1-aad0-f546a7d1a1da" released by "delete_volume" :: held 0.773s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:33:37 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-4c9849b0-8e03-4f57-b632-2bd8b75703bb tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Created reservations ['ef49c545-108d-4320-a925-d59a408ea48a', '3b3b5fd1-dc95-4d3f-a58e-ef800cc451ec', '7b4e6f39-b22f-495a-beaf-3cbcf3a86810', '5e6f5466-c981-47e7-8ac5-8dc754b8dbfd'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:33:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1e76a799-aae7-4b8a-b786-dd83437afb9e tempest-VolumesActionsTest-1397689694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:33:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1e76a799-aae7-4b8a-b786-dd83437afb9e tempest-VolumesActionsTest-1397689694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:33:37 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[f882e781-61d0-491a-95d4-00281e68c7d2]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:33:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1e76a799-aae7-4b8a-b786-dd83437afb9e tempest-VolumesActionsTest-1397689694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-3c1af111-f7de-48b5-bb7e-f8e09a5ce399 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-4c9849b0-8e03-4f57-b632-2bd8b75703bb tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:33:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-4c9849b0-8e03-4f57-b632-2bd8b75703bb tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:33:37 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-4c9849b0-8e03-4f57-b632-2bd8b75703bb tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:33:37 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-4c9849b0-8e03-4f57-b632-2bd8b75703bb tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:33:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-4c9849b0-8e03-4f57-b632-2bd8b75703bb tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:33:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4c9849b0-8e03-4f57-b632-2bd8b75703bb tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:37 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c48ec75e-a874-4df2-afd4-29cbd56ce1eb tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Acquiring lock "cinder-d509e22a-e582-4e81-9d92-2f7ab192d69a-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:33:37 devstack sudo[99385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:33:37 devstack sudo[99385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:37 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c48ec75e-a874-4df2-afd4-29cbd56ce1eb tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Lock "cinder-d509e22a-e582-4e81-9d92-2f7ab192d69a-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:33:37 devstack sudo[99384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-3c1af111-f7de-48b5-bb7e-f8e09a5ce399
Jul 14 16:33:37 devstack sudo[99384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:37 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c48ec75e-a874-4df2-afd4-29cbd56ce1eb tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Acquiring lock "cinder-quobyte-d509e22a-e582-4e81-9d92-2f7ab192d69a" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:33:37 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c48ec75e-a874-4df2-afd4-29cbd56ce1eb tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Lock "cinder-quobyte-d509e22a-e582-4e81-9d92-2f7ab192d69a" acquired by "delete_volume" :: waited 0.029s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:33:37 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e3b982-1cc1-4a32-bcd3-d4fc4c749030]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:33:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c48ec75e-a874-4df2-afd4-29cbd56ce1eb tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d509e22a-e582-4e81-9d92-2f7ab192d69a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:37 devstack sudo[99385]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4c9849b0-8e03-4f57-b632-2bd8b75703bb tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.466s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:37 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-4c9849b0-8e03-4f57-b632-2bd8b75703bb tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:33:37 devstack sudo[99388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d509e22a-e582-4e81-9d92-2f7ab192d69a
Jul 14 16:33:37 devstack sudo[99388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:37 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-4c9849b0-8e03-4f57-b632-2bd8b75703bb tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Deleted volume successfully.
Jul 14 16:33:37 devstack sudo[99384]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:37 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4c9849b0-8e03-4f57-b632-2bd8b75703bb tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Lock "cinder-b1b75662-fe13-49c1-aad0-f546a7d1a1da-delete_volume" released by "delete_volume" :: held 1.750s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:33:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1e76a799-aae7-4b8a-b786-dd83437afb9e tempest-VolumesActionsTest-1397689694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-3c1af111-f7de-48b5-bb7e-f8e09a5ce399" returned: 0 in 0.584s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:37 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eff568b-3dae-4700-9960-688f9878e99b]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:33:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1e76a799-aae7-4b8a-b786-dd83437afb9e tempest-VolumesActionsTest-1397689694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-3c1af111-f7de-48b5-bb7e-f8e09a5ce399 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:38 devstack sudo[99394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-3c1af111-f7de-48b5-bb7e-f8e09a5ce399
Jul 14 16:33:38 devstack sudo[99394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:38 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-49bcb21e-3e9f-488a-a5fe-4a675df8720e tempest-VolumesExtendTest-1210615344 None] Acquiring lock "cinder-1eceb1fa-c7eb-49dc-8697-61de7d3f2c3f-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:33:38 devstack sudo[99388]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c48ec75e-a874-4df2-afd4-29cbd56ce1eb tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d509e22a-e582-4e81-9d92-2f7ab192d69a" returned: 0 in 0.630s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c48ec75e-a874-4df2-afd4-29cbd56ce1eb tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d509e22a-e582-4e81-9d92-2f7ab192d69a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:38 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-49bcb21e-3e9f-488a-a5fe-4a675df8720e tempest-VolumesExtendTest-1210615344 None] Lock "cinder-1eceb1fa-c7eb-49dc-8697-61de7d3f2c3f-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:33:38 devstack sudo[99399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d509e22a-e582-4e81-9d92-2f7ab192d69a
Jul 14 16:33:38 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-49bcb21e-3e9f-488a-a5fe-4a675df8720e tempest-VolumesExtendTest-1210615344 None] Acquiring lock "cinder-quobyte-1eceb1fa-c7eb-49dc-8697-61de7d3f2c3f" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:33:38 devstack sudo[99399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:38 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-49bcb21e-3e9f-488a-a5fe-4a675df8720e tempest-VolumesExtendTest-1210615344 None] Lock "cinder-quobyte-1eceb1fa-c7eb-49dc-8697-61de7d3f2c3f" acquired by "delete_volume" :: waited 0.024s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:33:38 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c4c6d1-a3a4-4f7e-ab1e-f15d227077d2]: (4, 'raw') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:33:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-49bcb21e-3e9f-488a-a5fe-4a675df8720e tempest-VolumesExtendTest-1210615344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1eceb1fa-c7eb-49dc-8697-61de7d3f2c3f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:38 devstack sudo[99394]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1e76a799-aae7-4b8a-b786-dd83437afb9e tempest-VolumesActionsTest-1397689694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-3c1af111-f7de-48b5-bb7e-f8e09a5ce399" returned: 0 in 0.682s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1e76a799-aae7-4b8a-b786-dd83437afb9e tempest-VolumesActionsTest-1397689694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-3c1af111-f7de-48b5-bb7e-f8e09a5ce399 /opt/stack/data/cinder/conversion/3c1af111-f7de-48b5-bb7e-f8e09a5ce399.temp_image.bab2ba85-c4f3-46b9-a725-58a713419183wtwc7v7y.img {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:38 devstack sudo[99406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-3c1af111-f7de-48b5-bb7e-f8e09a5ce399 /opt/stack/data/cinder/conversion/3c1af111-f7de-48b5-bb7e-f8e09a5ce399.temp_image.bab2ba85-c4f3-46b9-a725-58a713419183wtwc7v7y.img
Jul 14 16:33:38 devstack sudo[99406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:38 devstack sudo[99399]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c48ec75e-a874-4df2-afd4-29cbd56ce1eb tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d509e22a-e582-4e81-9d92-2f7ab192d69a" returned: 0 in 0.453s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:38 devstack sudo[99404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1eceb1fa-c7eb-49dc-8697-61de7d3f2c3f
Jul 14 16:33:38 devstack sudo[99404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:38 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c48ec75e-a874-4df2-afd4-29cbd56ce1eb tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Lock "cinder-quobyte-d509e22a-e582-4e81-9d92-2f7ab192d69a" released by "delete_volume" :: held 1.159s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:33:38 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:SELECT=110,cinder:INSERT=47,cinder:UPDATE=165,cinder:DELETE=11 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 16:33:38 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:SELECT=139,cinder:INSERT=43,cinder:UPDATE=149,cinder:DELETE=19 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 16:33:38 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-c48ec75e-a874-4df2-afd4-29cbd56ce1eb tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Created reservations ['f0ab8a53-e6a4-469a-8dcd-12623e9d441f', '9231889b-f6c9-4c12-bb84-718fe5b8387e', '55d281fc-0321-4bcb-9b60-6710a268c71c', '0aa5dd01-aeec-4045-904b-539095adc751'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:33:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c48ec75e-a874-4df2-afd4-29cbd56ce1eb tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:33:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c48ec75e-a874-4df2-afd4-29cbd56ce1eb tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:33:38 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-c48ec75e-a874-4df2-afd4-29cbd56ce1eb tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:33:38 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-c48ec75e-a874-4df2-afd4-29cbd56ce1eb tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:33:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c48ec75e-a874-4df2-afd4-29cbd56ce1eb tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:33:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c48ec75e-a874-4df2-afd4-29cbd56ce1eb tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:38 devstack sudo[99409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:33:38 devstack sudo[99409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:39 devstack sudo[99404]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-49bcb21e-3e9f-488a-a5fe-4a675df8720e tempest-VolumesExtendTest-1210615344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1eceb1fa-c7eb-49dc-8697-61de7d3f2c3f" returned: 0 in 0.703s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-49bcb21e-3e9f-488a-a5fe-4a675df8720e tempest-VolumesExtendTest-1210615344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1eceb1fa-c7eb-49dc-8697-61de7d3f2c3f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:39 devstack sudo[99409]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c48ec75e-a874-4df2-afd4-29cbd56ce1eb tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.710s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:39 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-c48ec75e-a874-4df2-afd4-29cbd56ce1eb tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:33:39 devstack sudo[99420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1eceb1fa-c7eb-49dc-8697-61de7d3f2c3f
Jul 14 16:33:39 devstack sudo[99420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:39 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-c48ec75e-a874-4df2-afd4-29cbd56ce1eb tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Deleted volume successfully.
Jul 14 16:33:39 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c48ec75e-a874-4df2-afd4-29cbd56ce1eb tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Lock "cinder-d509e22a-e582-4e81-9d92-2f7ab192d69a-delete_volume" released by "delete_volume" :: held 2.358s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:33:40 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3002b607-d59c-4178-805d-e04f75717b78 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Acquiring lock "cinder-f3a3108e-4577-4a6d-8881-dd48410a5da3-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:33:40 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3002b607-d59c-4178-805d-e04f75717b78 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Lock "cinder-f3a3108e-4577-4a6d-8881-dd48410a5da3-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:33:40 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3002b607-d59c-4178-805d-e04f75717b78 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Acquiring lock "cinder-quobyte-f3a3108e-4577-4a6d-8881-dd48410a5da3" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:33:40 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3002b607-d59c-4178-805d-e04f75717b78 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Lock "cinder-quobyte-f3a3108e-4577-4a6d-8881-dd48410a5da3" acquired by "delete_volume" :: waited 0.057s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:33:40 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9025410-673f-40b1-b30c-f971eedce3c7]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:33:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3002b607-d59c-4178-805d-e04f75717b78 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f3a3108e-4577-4a6d-8881-dd48410a5da3 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:40 devstack sudo[99420]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-49bcb21e-3e9f-488a-a5fe-4a675df8720e tempest-VolumesExtendTest-1210615344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1eceb1fa-c7eb-49dc-8697-61de7d3f2c3f" returned: 1 in 1.333s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-49bcb21e-3e9f-488a-a5fe-4a675df8720e tempest-VolumesExtendTest-1210615344 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1eceb1fa-c7eb-49dc-8697-61de7d3f2c3f' failed. Not Retrying. {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 16:33:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-49bcb21e-3e9f-488a-a5fe-4a675df8720e tempest-VolumesExtendTest-1210615344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1eceb1fa-c7eb-49dc-8697-61de7d3f2c3f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:40 devstack sudo[99432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1eceb1fa-c7eb-49dc-8697-61de7d3f2c3f
Jul 14 16:33:40 devstack sudo[99432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:40 devstack sudo[99431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f3a3108e-4577-4a6d-8881-dd48410a5da3
Jul 14 16:33:40 devstack sudo[99431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:41 devstack sudo[99432]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-49bcb21e-3e9f-488a-a5fe-4a675df8720e tempest-VolumesExtendTest-1210615344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1eceb1fa-c7eb-49dc-8697-61de7d3f2c3f" returned: 0 in 1.065s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:41 devstack sudo[99431]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3002b607-d59c-4178-805d-e04f75717b78 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f3a3108e-4577-4a6d-8881-dd48410a5da3" returned: 0 in 1.239s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3002b607-d59c-4178-805d-e04f75717b78 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f3a3108e-4577-4a6d-8881-dd48410a5da3 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:41 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-49bcb21e-3e9f-488a-a5fe-4a675df8720e tempest-VolumesExtendTest-1210615344 None] Lock "cinder-quobyte-1eceb1fa-c7eb-49dc-8697-61de7d3f2c3f" released by "delete_volume" :: held 3.290s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:33:41 devstack sudo[99440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f3a3108e-4577-4a6d-8881-dd48410a5da3
Jul 14 16:33:41 devstack sudo[99440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:41 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-49bcb21e-3e9f-488a-a5fe-4a675df8720e tempest-VolumesExtendTest-1210615344 None] Created reservations ['8c47fac4-975c-4e9c-8254-36426640a915', '09862ce3-7d37-46cf-a1b0-d09b5c99d02e', 'd2378752-22a1-405c-a58d-d26e58375d9e', '8d03d46a-66fd-428a-bd56-61339e387940'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:33:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-49bcb21e-3e9f-488a-a5fe-4a675df8720e tempest-VolumesExtendTest-1210615344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:33:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-49bcb21e-3e9f-488a-a5fe-4a675df8720e tempest-VolumesExtendTest-1210615344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:33:42 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-49bcb21e-3e9f-488a-a5fe-4a675df8720e tempest-VolumesExtendTest-1210615344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:33:42 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-49bcb21e-3e9f-488a-a5fe-4a675df8720e tempest-VolumesExtendTest-1210615344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:33:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-49bcb21e-3e9f-488a-a5fe-4a675df8720e tempest-VolumesExtendTest-1210615344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:33:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-49bcb21e-3e9f-488a-a5fe-4a675df8720e tempest-VolumesExtendTest-1210615344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:42 devstack sudo[99442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:33:42 devstack sudo[99442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:42 devstack sudo[99442]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:42 devstack sudo[99440]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-49bcb21e-3e9f-488a-a5fe-4a675df8720e tempest-VolumesExtendTest-1210615344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.662s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:42 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-49bcb21e-3e9f-488a-a5fe-4a675df8720e tempest-VolumesExtendTest-1210615344 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:33:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3002b607-d59c-4178-805d-e04f75717b78 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f3a3108e-4577-4a6d-8881-dd48410a5da3" returned: 0 in 1.269s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:42 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-49bcb21e-3e9f-488a-a5fe-4a675df8720e tempest-VolumesExtendTest-1210615344 None] Deleted volume successfully.
Jul 14 16:33:42 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3002b607-d59c-4178-805d-e04f75717b78 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Lock "cinder-quobyte-f3a3108e-4577-4a6d-8881-dd48410a5da3" released by "delete_volume" :: held 2.691s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:33:43 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-49bcb21e-3e9f-488a-a5fe-4a675df8720e tempest-VolumesExtendTest-1210615344 None] Lock "cinder-1eceb1fa-c7eb-49dc-8697-61de7d3f2c3f-delete_volume" released by "delete_volume" :: held 4.749s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:33:43 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-3002b607-d59c-4178-805d-e04f75717b78 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Created reservations ['d77711f4-a545-4c36-baa1-fe3eacfb12a1', '92d61f77-683a-4a02-8b0f-2232f2f4aea2', 'd02524b1-3702-42f7-b8fc-0a574ca82f8e', '7a7d8452-3327-4696-b972-92908cf52732'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:33:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3002b607-d59c-4178-805d-e04f75717b78 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:33:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3002b607-d59c-4178-805d-e04f75717b78 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:33:43 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-3002b607-d59c-4178-805d-e04f75717b78 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:33:43 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-3002b607-d59c-4178-805d-e04f75717b78 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:33:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3002b607-d59c-4178-805d-e04f75717b78 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:33:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3002b607-d59c-4178-805d-e04f75717b78 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:43 devstack sudo[99446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:33:43 devstack sudo[99446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:43 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-9fd3f84a-5c1f-452f-92ae-0826cae1f210 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Acquiring lock "cinder-2fa9bc69-4b2c-48e1-a4cd-ba0382836cb2-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:33:44 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-9fd3f84a-5c1f-452f-92ae-0826cae1f210 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Lock "cinder-2fa9bc69-4b2c-48e1-a4cd-ba0382836cb2-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:33:44 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-9fd3f84a-5c1f-452f-92ae-0826cae1f210 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Acquiring lock "cinder-quobyte-2fa9bc69-4b2c-48e1-a4cd-ba0382836cb2" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:33:44 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-9fd3f84a-5c1f-452f-92ae-0826cae1f210 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Lock "cinder-quobyte-2fa9bc69-4b2c-48e1-a4cd-ba0382836cb2" acquired by "delete_volume" :: waited 0.116s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:33:44 devstack sudo[99446]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3002b607-d59c-4178-805d-e04f75717b78 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 1.101s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:44 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-3002b607-d59c-4178-805d-e04f75717b78 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:33:44 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-3002b607-d59c-4178-805d-e04f75717b78 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Deleted volume successfully.
Jul 14 16:33:44 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df5f6f9-4887-4959-a0d4-197d4ea3ebb8]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:33:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9fd3f84a-5c1f-452f-92ae-0826cae1f210 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2fa9bc69-4b2c-48e1-a4cd-ba0382836cb2 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:44 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3002b607-d59c-4178-805d-e04f75717b78 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Lock "cinder-f3a3108e-4577-4a6d-8881-dd48410a5da3-delete_volume" released by "delete_volume" :: held 4.583s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:33:44 devstack sudo[99449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2fa9bc69-4b2c-48e1-a4cd-ba0382836cb2
Jul 14 16:33:44 devstack sudo[99449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:45 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9aace58-ffc3-455e-9864-0a644d2ddea2 tempest-VolumesExtendTest-1210615344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:33:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e9aace58-ffc3-455e-9864-0a644d2ddea2 tempest-VolumesExtendTest-1210615344 None] Flow 'volume_create_manager' (119ae3ab-cb11-4254-95b8-d52b29bc946e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:33:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e9aace58-ffc3-455e-9864-0a644d2ddea2 tempest-VolumesExtendTest-1210615344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79c72934-895b-450c-884c-0c6f29acb513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e9aace58-ffc3-455e-9864-0a644d2ddea2 tempest-VolumesExtendTest-1210615344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79c72934-895b-450c-884c-0c6f29acb513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:33:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2062006430',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a92f957-5fb2-4713-88ed-fadc079b6225,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c8c021fe15145da980d12cbec63fd46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:33:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:33:45Z,use_quota=True,user_id='9eed4cd42c74431ebe300eca648b8014',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e9aace58-ffc3-455e-9864-0a644d2ddea2 tempest-VolumesExtendTest-1210615344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba66392d-4eb1-4523-a3f2-c9a274952c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e9aace58-ffc3-455e-9864-0a644d2ddea2 tempest-VolumesExtendTest-1210615344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba66392d-4eb1-4523-a3f2-c9a274952c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e9aace58-ffc3-455e-9864-0a644d2ddea2 tempest-VolumesExtendTest-1210615344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d07ba8d-8593-4f1e-b68e-feaa695af825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e9aace58-ffc3-455e-9864-0a644d2ddea2 tempest-VolumesExtendTest-1210615344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d07ba8d-8593-4f1e-b68e-feaa695af825) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a92f957-5fb2-4713-88ed-fadc079b6225', 'volume_name': 'volume-6a92f957-5fb2-4713-88ed-fadc079b6225', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e9aace58-ffc3-455e-9864-0a644d2ddea2 tempest-VolumesExtendTest-1210615344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (667fb8ab-c007-4fba-9c66-e138ad789af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e9aace58-ffc3-455e-9864-0a644d2ddea2 tempest-VolumesExtendTest-1210615344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (667fb8ab-c007-4fba-9c66-e138ad789af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e9aace58-ffc3-455e-9864-0a644d2ddea2 tempest-VolumesExtendTest-1210615344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef91414e-0173-452c-a02f-4583eec02e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:45 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-e9aace58-ffc3-455e-9864-0a644d2ddea2 tempest-VolumesExtendTest-1210615344 None] Volume 6a92f957-5fb2-4713-88ed-fadc079b6225: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a92f957-5fb2-4713-88ed-fadc079b6225', 'volume_size': 1}
Jul 14 16:33:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e9aace58-ffc3-455e-9864-0a644d2ddea2 tempest-VolumesExtendTest-1210615344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:33:45 devstack sudo[99449]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9fd3f84a-5c1f-452f-92ae-0826cae1f210 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2fa9bc69-4b2c-48e1-a4cd-ba0382836cb2" returned: 0 in 1.265s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9fd3f84a-5c1f-452f-92ae-0826cae1f210 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2fa9bc69-4b2c-48e1-a4cd-ba0382836cb2 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:45 devstack sudo[99454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2fa9bc69-4b2c-48e1-a4cd-ba0382836cb2
Jul 14 16:33:45 devstack sudo[99454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:46 devstack sudo[99454]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9fd3f84a-5c1f-452f-92ae-0826cae1f210 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2fa9bc69-4b2c-48e1-a4cd-ba0382836cb2" returned: 0 in 0.594s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:46 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-9fd3f84a-5c1f-452f-92ae-0826cae1f210 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Lock "cinder-quobyte-2fa9bc69-4b2c-48e1-a4cd-ba0382836cb2" released by "delete_volume" :: held 2.029s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:33:46 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-9fd3f84a-5c1f-452f-92ae-0826cae1f210 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Created reservations ['58ff8651-de09-47a5-9bf0-3c649d65c34c', 'a477b500-15bf-4b31-82bc-ebc26f2662b1', 'beb2204a-fda1-44c0-b4c9-8ef8a955a594', 'da7d0f0d-e886-4478-a003-c38ffa7d3788'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:33:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9fd3f84a-5c1f-452f-92ae-0826cae1f210 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:33:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9fd3f84a-5c1f-452f-92ae-0826cae1f210 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:33:46 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-9fd3f84a-5c1f-452f-92ae-0826cae1f210 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:33:46 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-9fd3f84a-5c1f-452f-92ae-0826cae1f210 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:33:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9fd3f84a-5c1f-452f-92ae-0826cae1f210 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:33:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9fd3f84a-5c1f-452f-92ae-0826cae1f210 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:46 devstack sudo[99406]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1e76a799-aae7-4b8a-b786-dd83437afb9e tempest-VolumesActionsTest-1397689694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-3c1af111-f7de-48b5-bb7e-f8e09a5ce399 /opt/stack/data/cinder/conversion/3c1af111-f7de-48b5-bb7e-f8e09a5ce399.temp_image.bab2ba85-c4f3-46b9-a725-58a713419183wtwc7v7y.img" returned: 0 in 8.045s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:46 devstack sudo[99458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:33:46 devstack sudo[99458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:46 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ccf130-f60f-4070-8cbf-d80571667533]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:33:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1e76a799-aae7-4b8a-b786-dd83437afb9e tempest-VolumesActionsTest-1397689694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-3c1af111-f7de-48b5-bb7e-f8e09a5ce399 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:46 devstack sudo[99460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-3c1af111-f7de-48b5-bb7e-f8e09a5ce399
Jul 14 16:33:46 devstack sudo[99460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:46 devstack sudo[99458]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9fd3f84a-5c1f-452f-92ae-0826cae1f210 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.278s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:46 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-9fd3f84a-5c1f-452f-92ae-0826cae1f210 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:33:46 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-9fd3f84a-5c1f-452f-92ae-0826cae1f210 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Deleted volume successfully.
Jul 14 16:33:46 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-9fd3f84a-5c1f-452f-92ae-0826cae1f210 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Lock "cinder-2fa9bc69-4b2c-48e1-a4cd-ba0382836cb2-delete_volume" released by "delete_volume" :: held 2.901s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:33:47 devstack sudo[99460]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1e76a799-aae7-4b8a-b786-dd83437afb9e tempest-VolumesActionsTest-1397689694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-3c1af111-f7de-48b5-bb7e-f8e09a5ce399" returned: 0 in 0.550s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:47 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-1e76a799-aae7-4b8a-b786-dd83437afb9e tempest-VolumesActionsTest-1397689694 None] Image conversion details: src /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-3c1af111-f7de-48b5-bb7e-f8e09a5ce399, size 1024.00 MB, duration 8.05 sec, destination /opt/stack/data/cinder/conversion/3c1af111-f7de-48b5-bb7e-f8e09a5ce399.temp_image.bab2ba85-c4f3-46b9-a725-58a713419183wtwc7v7y.img {{(pid=87166) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 14 16:33:47 devstack cinder-volume[87166]: INFO cinder.image.image_utils [None req-1e76a799-aae7-4b8a-b786-dd83437afb9e tempest-VolumesActionsTest-1397689694 None] Converted 1024.00 MB image at 127.24 MB/s
Jul 14 16:33:47 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-1e76a799-aae7-4b8a-b786-dd83437afb9e tempest-VolumesActionsTest-1397689694 None] bab2ba85-c4f3-46b9-a725-58a713419183 was raw, no need to convert to raw {{(pid=87166) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}}
Jul 14 16:33:47 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-cdba8f8e-0162-4925-bba6-34973720cef6 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Acquiring lock "cinder-58f7bd88-146c-4b61-b8d9-aefb8cfcae34-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:33:47 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-cdba8f8e-0162-4925-bba6-34973720cef6 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Lock "cinder-58f7bd88-146c-4b61-b8d9-aefb8cfcae34-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:33:47 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-cdba8f8e-0162-4925-bba6-34973720cef6 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Acquiring lock "cinder-quobyte-58f7bd88-146c-4b61-b8d9-aefb8cfcae34" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:33:47 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-cdba8f8e-0162-4925-bba6-34973720cef6 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Lock "cinder-quobyte-58f7bd88-146c-4b61-b8d9-aefb8cfcae34" acquired by "delete_volume" :: waited 0.020s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:33:47 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bcaf227-2298-4d32-bb03-cfd260f1c325]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:33:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cdba8f8e-0162-4925-bba6-34973720cef6 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-58f7bd88-146c-4b61-b8d9-aefb8cfcae34 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:48 devstack sudo[99466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-58f7bd88-146c-4b61-b8d9-aefb8cfcae34
Jul 14 16:33:48 devstack sudo[99466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:48 devstack sudo[99466]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cdba8f8e-0162-4925-bba6-34973720cef6 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-58f7bd88-146c-4b61-b8d9-aefb8cfcae34" returned: 0 in 0.455s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cdba8f8e-0162-4925-bba6-34973720cef6 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-58f7bd88-146c-4b61-b8d9-aefb8cfcae34 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:48 devstack sudo[99471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-58f7bd88-146c-4b61-b8d9-aefb8cfcae34
Jul 14 16:33:48 devstack sudo[99471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:48 devstack sudo[99471]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cdba8f8e-0162-4925-bba6-34973720cef6 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-58f7bd88-146c-4b61-b8d9-aefb8cfcae34" returned: 0 in 0.303s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:48 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-cdba8f8e-0162-4925-bba6-34973720cef6 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Lock "cinder-quobyte-58f7bd88-146c-4b61-b8d9-aefb8cfcae34" released by "delete_volume" :: held 0.809s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:33:48 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-cdba8f8e-0162-4925-bba6-34973720cef6 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Created reservations ['0d5b1c33-d610-4209-84c3-ba8650750b20', '839a964d-3fa6-4780-a586-7519c14bd013', '797a7358-4553-4f83-a1ff-2b34221ad1c9', 'ee766554-6595-4b39-9bc7-5c4af7cddae5'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:33:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cdba8f8e-0162-4925-bba6-34973720cef6 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:33:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cdba8f8e-0162-4925-bba6-34973720cef6 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:33:48 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-cdba8f8e-0162-4925-bba6-34973720cef6 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:33:48 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-cdba8f8e-0162-4925-bba6-34973720cef6 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:33:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cdba8f8e-0162-4925-bba6-34973720cef6 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:33:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cdba8f8e-0162-4925-bba6-34973720cef6 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:48 devstack sudo[99474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:33:48 devstack sudo[99474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:48 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e21734ef-eff2-47c5-9444-5890230f23c3 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Acquiring lock "cinder-38383638-bdd1-4094-98e5-e1f4c129bd6e-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:33:48 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e21734ef-eff2-47c5-9444-5890230f23c3 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Lock "cinder-38383638-bdd1-4094-98e5-e1f4c129bd6e-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:33:49 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e21734ef-eff2-47c5-9444-5890230f23c3 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Acquiring lock "cinder-quobyte-38383638-bdd1-4094-98e5-e1f4c129bd6e" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:33:49 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e21734ef-eff2-47c5-9444-5890230f23c3 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Lock "cinder-quobyte-38383638-bdd1-4094-98e5-e1f4c129bd6e" acquired by "delete_volume" :: waited 0.015s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:33:49 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[184838c6-6328-408e-a73f-2583c7528d1f]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:33:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e21734ef-eff2-47c5-9444-5890230f23c3 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-38383638-bdd1-4094-98e5-e1f4c129bd6e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:49 devstack sudo[99477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-38383638-bdd1-4094-98e5-e1f4c129bd6e
Jul 14 16:33:49 devstack sudo[99477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:49 devstack sudo[99474]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cdba8f8e-0162-4925-bba6-34973720cef6 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.531s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:49 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-cdba8f8e-0162-4925-bba6-34973720cef6 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:33:49 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-cdba8f8e-0162-4925-bba6-34973720cef6 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Deleted volume successfully.
Jul 14 16:33:49 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-cdba8f8e-0162-4925-bba6-34973720cef6 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Lock "cinder-58f7bd88-146c-4b61-b8d9-aefb8cfcae34-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:33:49 devstack sudo[99477]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e21734ef-eff2-47c5-9444-5890230f23c3 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-38383638-bdd1-4094-98e5-e1f4c129bd6e" returned: 0 in 0.596s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e21734ef-eff2-47c5-9444-5890230f23c3 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-38383638-bdd1-4094-98e5-e1f4c129bd6e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:49 devstack sudo[99505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-38383638-bdd1-4094-98e5-e1f4c129bd6e
Jul 14 16:33:49 devstack sudo[99505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:49 devstack sudo[99505]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e21734ef-eff2-47c5-9444-5890230f23c3 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-38383638-bdd1-4094-98e5-e1f4c129bd6e" returned: 0 in 0.270s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:49 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e21734ef-eff2-47c5-9444-5890230f23c3 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Lock "cinder-quobyte-38383638-bdd1-4094-98e5-e1f4c129bd6e" released by "delete_volume" :: held 0.948s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:33:50 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-e21734ef-eff2-47c5-9444-5890230f23c3 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Created reservations ['9afbaae1-0ea3-4487-a47d-3f53ccd09af3', '2aa612c4-25b5-4685-a6e2-cde466b66f81', 'f48db8a4-40b7-41bb-b48e-d751f0b0c444', '7da4b287-fd54-4385-9ec2-e6c5031bf9d1'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:33:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e21734ef-eff2-47c5-9444-5890230f23c3 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:33:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e21734ef-eff2-47c5-9444-5890230f23c3 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:33:50 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-e21734ef-eff2-47c5-9444-5890230f23c3 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:33:50 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-e21734ef-eff2-47c5-9444-5890230f23c3 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:33:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e21734ef-eff2-47c5-9444-5890230f23c3 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:33:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e21734ef-eff2-47c5-9444-5890230f23c3 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:33:50 devstack sudo[99508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:33:50 devstack sudo[99508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:33:50 devstack sudo[99508]: pam_unix(sudo:session): session closed for user root
Jul 14 16:33:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e21734ef-eff2-47c5-9444-5890230f23c3 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.359s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:33:50 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-e21734ef-eff2-47c5-9444-5890230f23c3 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:33:50 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-e21734ef-eff2-47c5-9444-5890230f23c3 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Deleted volume successfully.
Jul 14 16:33:50 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e21734ef-eff2-47c5-9444-5890230f23c3 tempest-CreateVolumesFromSourceVolumeTest-1611242874 None] Lock "cinder-38383638-bdd1-4094-98e5-e1f4c129bd6e-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:33:59 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a35b39e-1279-4fad-b4af-a0816df5cd50 tempest-ProjectReaderTests-153736182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:33:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8a35b39e-1279-4fad-b4af-a0816df5cd50 tempest-ProjectReaderTests-153736182 None] Flow 'volume_create_manager' (071772ce-98b7-494d-9633-4d8e370011ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:33:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8a35b39e-1279-4fad-b4af-a0816df5cd50 tempest-ProjectReaderTests-153736182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebab9277-aa69-4cfa-885c-e87790adf250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8a35b39e-1279-4fad-b4af-a0816df5cd50 tempest-ProjectReaderTests-153736182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebab9277-aa69-4cfa-885c-e87790adf250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:33:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-796362629',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eea65e0-9b65-4bcb-942a-a1af17717f33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e11ad755b044372830d0a7e456bf8c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:33:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:33:59Z,use_quota=True,user_id='1749f7fa929c4e69b69440c0082a037a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8a35b39e-1279-4fad-b4af-a0816df5cd50 tempest-ProjectReaderTests-153736182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (678d0e02-c9ee-44f1-825e-50aff761158a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8a35b39e-1279-4fad-b4af-a0816df5cd50 tempest-ProjectReaderTests-153736182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (678d0e02-c9ee-44f1-825e-50aff761158a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8a35b39e-1279-4fad-b4af-a0816df5cd50 tempest-ProjectReaderTests-153736182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8816c7b0-7612-48b1-8eca-b301f1f4ba4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8a35b39e-1279-4fad-b4af-a0816df5cd50 tempest-ProjectReaderTests-153736182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8816c7b0-7612-48b1-8eca-b301f1f4ba4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9eea65e0-9b65-4bcb-942a-a1af17717f33', 'volume_name': 'volume-9eea65e0-9b65-4bcb-942a-a1af17717f33', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8a35b39e-1279-4fad-b4af-a0816df5cd50 tempest-ProjectReaderTests-153736182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (376fa374-da16-425d-9262-49c4a7b570b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8a35b39e-1279-4fad-b4af-a0816df5cd50 tempest-ProjectReaderTests-153736182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (376fa374-da16-425d-9262-49c4a7b570b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:33:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8a35b39e-1279-4fad-b4af-a0816df5cd50 tempest-ProjectReaderTests-153736182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee36fd09-c8c6-4286-a12e-ac722aff33b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:33:59 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-8a35b39e-1279-4fad-b4af-a0816df5cd50 tempest-ProjectReaderTests-153736182 None] Volume 9eea65e0-9b65-4bcb-942a-a1af17717f33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9eea65e0-9b65-4bcb-942a-a1af17717f33', 'volume_size': 1}
Jul 14 16:33:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-8a35b39e-1279-4fad-b4af-a0816df5cd50 tempest-ProjectReaderTests-153736182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:34:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-ec04e4ee-9f1a-4f43-8f02-f5f2f4608375 req-27f1cdb6-4083-4fb2-9aa1-185f0087b0ae tempest-TestServerVolumeAttachmentScenario-1040687344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:34:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1e76a799-aae7-4b8a-b786-dd83437afb9e tempest-VolumesActionsTest-1397689694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 30.248s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:34:07 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1e76a799-aae7-4b8a-b786-dd83437afb9e tempest-VolumesActionsTest-1397689694 None] Uploaded volume to glance image-id: bab2ba85-c4f3-46b9-a725-58a713419183. {{(pid=87166) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Jul 14 16:34:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e9aace58-ffc3-455e-9864-0a644d2ddea2 tempest-VolumesExtendTest-1210615344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 21.945s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:34:07 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-e9aace58-ffc3-455e-9864-0a644d2ddea2 tempest-VolumesExtendTest-1210615344 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:33:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2062006430',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a92f957-5fb2-4713-88ed-fadc079b6225,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c8c021fe15145da980d12cbec63fd46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:33:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:33:45Z,use_quota=True,user_id='9eed4cd42c74431ebe300eca648b8014',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:34:07 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-e9aace58-ffc3-455e-9864-0a644d2ddea2 tempest-VolumesExtendTest-1210615344 None] Creating volume 6a92f957-5fb2-4713-88ed-fadc079b6225 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:34:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e9aace58-ffc3-455e-9864-0a644d2ddea2 tempest-VolumesExtendTest-1210615344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:34:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e9aace58-ffc3-455e-9864-0a644d2ddea2 tempest-VolumesExtendTest-1210615344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:34:07 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-e9aace58-ffc3-455e-9864-0a644d2ddea2 tempest-VolumesExtendTest-1210615344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:34:07 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-e9aace58-ffc3-455e-9864-0a644d2ddea2 tempest-VolumesExtendTest-1210615344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:34:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e9aace58-ffc3-455e-9864-0a644d2ddea2 tempest-VolumesExtendTest-1210615344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:34:07 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-e9aace58-ffc3-455e-9864-0a644d2ddea2 tempest-VolumesExtendTest-1210615344 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:34:07 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-e9aace58-ffc3-455e-9864-0a644d2ddea2 tempest-VolumesExtendTest-1210615344 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:34:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e9aace58-ffc3-455e-9864-0a644d2ddea2 tempest-VolumesExtendTest-1210615344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6a92f957-5fb2-4713-88ed-fadc079b6225 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:07 devstack sudo[99569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6a92f957-5fb2-4713-88ed-fadc079b6225 1073741824
Jul 14 16:34:07 devstack sudo[99569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:07 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-1e76a799-aae7-4b8a-b786-dd83437afb9e tempest-VolumesActionsTest-1397689694 None] Copy volume to image completed successfully.
Jul 14 16:34:07 devstack sudo[99569]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e9aace58-ffc3-455e-9864-0a644d2ddea2 tempest-VolumesExtendTest-1210615344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6a92f957-5fb2-4713-88ed-fadc079b6225 1073741824" returned: 0 in 0.429s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e9aace58-ffc3-455e-9864-0a644d2ddea2 tempest-VolumesExtendTest-1210615344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6a92f957-5fb2-4713-88ed-fadc079b6225 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:07 devstack sudo[99575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6a92f957-5fb2-4713-88ed-fadc079b6225
Jul 14 16:34:08 devstack sudo[99575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:08 devstack sudo[99575]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e9aace58-ffc3-455e-9864-0a644d2ddea2 tempest-VolumesExtendTest-1210615344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6a92f957-5fb2-4713-88ed-fadc079b6225" returned: 0 in 0.260s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:08 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-e9aace58-ffc3-455e-9864-0a644d2ddea2 tempest-VolumesExtendTest-1210615344 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:34:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e9aace58-ffc3-455e-9864-0a644d2ddea2 tempest-VolumesExtendTest-1210615344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:34:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-8a35b39e-1279-4fad-b4af-a0816df5cd50 tempest-ProjectReaderTests-153736182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.642s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:34:08 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-8a35b39e-1279-4fad-b4af-a0816df5cd50 tempest-ProjectReaderTests-153736182 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:33:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-796362629',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eea65e0-9b65-4bcb-942a-a1af17717f33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e11ad755b044372830d0a7e456bf8c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:33:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:33:59Z,use_quota=True,user_id='1749f7fa929c4e69b69440c0082a037a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:34:08 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-8a35b39e-1279-4fad-b4af-a0816df5cd50 tempest-ProjectReaderTests-153736182 None] Creating volume 9eea65e0-9b65-4bcb-942a-a1af17717f33 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:34:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-8a35b39e-1279-4fad-b4af-a0816df5cd50 tempest-ProjectReaderTests-153736182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:34:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-8a35b39e-1279-4fad-b4af-a0816df5cd50 tempest-ProjectReaderTests-153736182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:34:08 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-8a35b39e-1279-4fad-b4af-a0816df5cd50 tempest-ProjectReaderTests-153736182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:34:08 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-8a35b39e-1279-4fad-b4af-a0816df5cd50 tempest-ProjectReaderTests-153736182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:34:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-8a35b39e-1279-4fad-b4af-a0816df5cd50 tempest-ProjectReaderTests-153736182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:34:08 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-8a35b39e-1279-4fad-b4af-a0816df5cd50 tempest-ProjectReaderTests-153736182 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:34:08 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-8a35b39e-1279-4fad-b4af-a0816df5cd50 tempest-ProjectReaderTests-153736182 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:34:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-8a35b39e-1279-4fad-b4af-a0816df5cd50 tempest-ProjectReaderTests-153736182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9eea65e0-9b65-4bcb-942a-a1af17717f33 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:08 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e9aace58-ffc3-455e-9864-0a644d2ddea2 tempest-VolumesExtendTest-1210615344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef91414e-0173-452c-a02f-4583eec02e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a92f957-5fb2-4713-88ed-fadc079b6225', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:34:08 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e9aace58-ffc3-455e-9864-0a644d2ddea2 tempest-VolumesExtendTest-1210615344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (637ace33-bd49-4e58-91af-0d041ca94dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:34:08 devstack sudo[99578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9eea65e0-9b65-4bcb-942a-a1af17717f33 1073741824
Jul 14 16:34:08 devstack sudo[99578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:08 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-e9aace58-ffc3-455e-9864-0a644d2ddea2 tempest-VolumesExtendTest-1210615344 None] Volume volume-6a92f957-5fb2-4713-88ed-fadc079b6225 (6a92f957-5fb2-4713-88ed-fadc079b6225): created successfully
Jul 14 16:34:08 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e9aace58-ffc3-455e-9864-0a644d2ddea2 tempest-VolumesExtendTest-1210615344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (637ace33-bd49-4e58-91af-0d041ca94dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:34:08 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e9aace58-ffc3-455e-9864-0a644d2ddea2 tempest-VolumesExtendTest-1210615344 None] Flow 'volume_create_manager' (119ae3ab-cb11-4254-95b8-d52b29bc946e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:34:08 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-e9aace58-ffc3-455e-9864-0a644d2ddea2 tempest-VolumesExtendTest-1210615344 None] Created volume successfully.
Jul 14 16:34:08 devstack sudo[99578]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-8a35b39e-1279-4fad-b4af-a0816df5cd50 tempest-ProjectReaderTests-153736182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9eea65e0-9b65-4bcb-942a-a1af17717f33 1073741824" returned: 0 in 0.472s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-8a35b39e-1279-4fad-b4af-a0816df5cd50 tempest-ProjectReaderTests-153736182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9eea65e0-9b65-4bcb-942a-a1af17717f33 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:08 devstack sudo[99584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9eea65e0-9b65-4bcb-942a-a1af17717f33
Jul 14 16:34:08 devstack sudo[99584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:09 devstack sudo[99584]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-8a35b39e-1279-4fad-b4af-a0816df5cd50 tempest-ProjectReaderTests-153736182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9eea65e0-9b65-4bcb-942a-a1af17717f33" returned: 0 in 0.262s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:09 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-8a35b39e-1279-4fad-b4af-a0816df5cd50 tempest-ProjectReaderTests-153736182 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:34:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-8a35b39e-1279-4fad-b4af-a0816df5cd50 tempest-ProjectReaderTests-153736182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:34:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-ec04e4ee-9f1a-4f43-8f02-f5f2f4608375 req-27f1cdb6-4083-4fb2-9aa1-185f0087b0ae tempest-TestServerVolumeAttachmentScenario-1040687344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 6.372s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:34:09 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8a35b39e-1279-4fad-b4af-a0816df5cd50 tempest-ProjectReaderTests-153736182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee36fd09-c8c6-4286-a12e-ac722aff33b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9eea65e0-9b65-4bcb-942a-a1af17717f33', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:34:09 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8a35b39e-1279-4fad-b4af-a0816df5cd50 tempest-ProjectReaderTests-153736182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03bf9325-6ef4-4907-96f4-d3499309003e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:34:09 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[39671741-8bcf-4749-8ba8-29ad5dae48b8]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:34:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-ec04e4ee-9f1a-4f43-8f02-f5f2f4608375 req-27f1cdb6-4083-4fb2-9aa1-185f0087b0ae tempest-TestServerVolumeAttachmentScenario-1040687344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4a247759-154f-4a91-9c77-93149a217448 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:09 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-8a35b39e-1279-4fad-b4af-a0816df5cd50 tempest-ProjectReaderTests-153736182 None] Volume volume-9eea65e0-9b65-4bcb-942a-a1af17717f33 (9eea65e0-9b65-4bcb-942a-a1af17717f33): created successfully
Jul 14 16:34:09 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8a35b39e-1279-4fad-b4af-a0816df5cd50 tempest-ProjectReaderTests-153736182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03bf9325-6ef4-4907-96f4-d3499309003e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:34:09 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8a35b39e-1279-4fad-b4af-a0816df5cd50 tempest-ProjectReaderTests-153736182 None] Flow 'volume_create_manager' (071772ce-98b7-494d-9633-4d8e370011ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:34:09 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-8a35b39e-1279-4fad-b4af-a0816df5cd50 tempest-ProjectReaderTests-153736182 None] Created volume successfully.
Jul 14 16:34:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2c10b036-23ed-4f8b-9dd7-8d4099e7b450 tempest-VolumesActionsTest-1397689694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:34:09 devstack sudo[99587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4a247759-154f-4a91-9c77-93149a217448
Jul 14 16:34:09 devstack sudo[99587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:09 devstack sudo[99587]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-ec04e4ee-9f1a-4f43-8f02-f5f2f4608375 req-27f1cdb6-4083-4fb2-9aa1-185f0087b0ae tempest-TestServerVolumeAttachmentScenario-1040687344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4a247759-154f-4a91-9c77-93149a217448" returned: 0 in 0.387s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-ec04e4ee-9f1a-4f43-8f02-f5f2f4608375 req-27f1cdb6-4083-4fb2-9aa1-185f0087b0ae tempest-TestServerVolumeAttachmentScenario-1040687344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.414s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:34:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2c10b036-23ed-4f8b-9dd7-8d4099e7b450 tempest-VolumesActionsTest-1397689694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.306s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:34:09 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f842f2c-f69e-4ed8-8cf4-dd3e441729fd]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:34:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2c10b036-23ed-4f8b-9dd7-8d4099e7b450 tempest-VolumesActionsTest-1397689694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-3c1af111-f7de-48b5-bb7e-f8e09a5ce399 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:09 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-ec04e4ee-9f1a-4f43-8f02-f5f2f4608375 req-27f1cdb6-4083-4fb2-9aa1-185f0087b0ae tempest-TestServerVolumeAttachmentScenario-1040687344 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052', 'name': 'volume-4a247759-154f-4a91-9c77-93149a217448', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c4ef5776-c3b1-4402-8db3-e189b6c65a08', 'enforce_multipath': True} {{(pid=87166) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 14 16:34:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-18b82a5f-94cf-4123-b8bc-d3852faa6ed3 tempest-VolumesExtendTest-1210615344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:34:09 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-ec04e4ee-9f1a-4f43-8f02-f5f2f4608375 req-27f1cdb6-4083-4fb2-9aa1-185f0087b0ae tempest-TestServerVolumeAttachmentScenario-1040687344 None] attachment_update completed successfully.
Jul 14 16:34:09 devstack sudo[99593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-3c1af111-f7de-48b5-bb7e-f8e09a5ce399
Jul 14 16:34:09 devstack sudo[99593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:09 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b3d71989-eb1e-41c8-9b46-e0be4fc55aac tempest-ProjectReaderTests-153736182 None] Acquiring lock "cinder-9eea65e0-9b65-4bcb-942a-a1af17717f33-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:34:09 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b3d71989-eb1e-41c8-9b46-e0be4fc55aac tempest-ProjectReaderTests-153736182 None] Lock "cinder-9eea65e0-9b65-4bcb-942a-a1af17717f33-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:34:09 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b3d71989-eb1e-41c8-9b46-e0be4fc55aac tempest-ProjectReaderTests-153736182 None] Acquiring lock "cinder-quobyte-9eea65e0-9b65-4bcb-942a-a1af17717f33" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:34:09 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b3d71989-eb1e-41c8-9b46-e0be4fc55aac tempest-ProjectReaderTests-153736182 None] Lock "cinder-quobyte-9eea65e0-9b65-4bcb-942a-a1af17717f33" acquired by "delete_volume" :: waited 0.023s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:34:09 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[b03bce9c-f8fb-4eb1-86cc-14585615c9a9]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:34:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b3d71989-eb1e-41c8-9b46-e0be4fc55aac tempest-ProjectReaderTests-153736182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9eea65e0-9b65-4bcb-942a-a1af17717f33 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:09 devstack sudo[99593]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2c10b036-23ed-4f8b-9dd7-8d4099e7b450 tempest-VolumesActionsTest-1397689694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-3c1af111-f7de-48b5-bb7e-f8e09a5ce399" returned: 0 in 0.484s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:09 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bcbc773-ec01-4b02-b6d8-84b167629ae3]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:34:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2c10b036-23ed-4f8b-9dd7-8d4099e7b450 tempest-VolumesActionsTest-1397689694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-3c1af111-f7de-48b5-bb7e-f8e09a5ce399 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:09 devstack sudo[99662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9eea65e0-9b65-4bcb-942a-a1af17717f33
Jul 14 16:34:09 devstack sudo[99662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:10 devstack sudo[99933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-3c1af111-f7de-48b5-bb7e-f8e09a5ce399
Jul 14 16:34:10 devstack sudo[99933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:10 devstack sudo[99662]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b3d71989-eb1e-41c8-9b46-e0be4fc55aac tempest-ProjectReaderTests-153736182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9eea65e0-9b65-4bcb-942a-a1af17717f33" returned: 0 in 0.471s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b3d71989-eb1e-41c8-9b46-e0be4fc55aac tempest-ProjectReaderTests-153736182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9eea65e0-9b65-4bcb-942a-a1af17717f33 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:10 devstack sudo[99989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9eea65e0-9b65-4bcb-942a-a1af17717f33
Jul 14 16:34:10 devstack sudo[99989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:10 devstack sudo[99933]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2c10b036-23ed-4f8b-9dd7-8d4099e7b450 tempest-VolumesActionsTest-1397689694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-3c1af111-f7de-48b5-bb7e-f8e09a5ce399" returned: 0 in 0.503s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2c10b036-23ed-4f8b-9dd7-8d4099e7b450 tempest-VolumesActionsTest-1397689694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-3c1af111-f7de-48b5-bb7e-f8e09a5ce399 /opt/stack/data/cinder/conversion/3c1af111-f7de-48b5-bb7e-f8e09a5ce399.temp_image.40156708-f64e-4cb2-85ad-c575e10c18e7b5xa6upm.img {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:10 devstack sudo[99994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-3c1af111-f7de-48b5-bb7e-f8e09a5ce399 /opt/stack/data/cinder/conversion/3c1af111-f7de-48b5-bb7e-f8e09a5ce399.temp_image.40156708-f64e-4cb2-85ad-c575e10c18e7b5xa6upm.img
Jul 14 16:34:10 devstack sudo[99994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:10 devstack sudo[99989]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b3d71989-eb1e-41c8-9b46-e0be4fc55aac tempest-ProjectReaderTests-153736182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9eea65e0-9b65-4bcb-942a-a1af17717f33" returned: 0 in 0.302s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:10 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b3d71989-eb1e-41c8-9b46-e0be4fc55aac tempest-ProjectReaderTests-153736182 None] Lock "cinder-quobyte-9eea65e0-9b65-4bcb-942a-a1af17717f33" released by "delete_volume" :: held 0.823s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:34:10 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-b3d71989-eb1e-41c8-9b46-e0be4fc55aac tempest-ProjectReaderTests-153736182 None] Created reservations ['b1208e11-6cd2-4cc6-8352-43fb397761d7', 'e5d274c0-d7b3-4892-a38a-762f0dca145e', 'dac671a3-6df8-411c-b45b-eee87380ed0b', 'a0326d74-2b79-41af-a218-81543664e2e7'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:34:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b3d71989-eb1e-41c8-9b46-e0be4fc55aac tempest-ProjectReaderTests-153736182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:34:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b3d71989-eb1e-41c8-9b46-e0be4fc55aac tempest-ProjectReaderTests-153736182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:34:10 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-b3d71989-eb1e-41c8-9b46-e0be4fc55aac tempest-ProjectReaderTests-153736182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:34:10 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-b3d71989-eb1e-41c8-9b46-e0be4fc55aac tempest-ProjectReaderTests-153736182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:34:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b3d71989-eb1e-41c8-9b46-e0be4fc55aac tempest-ProjectReaderTests-153736182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:34:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b3d71989-eb1e-41c8-9b46-e0be4fc55aac tempest-ProjectReaderTests-153736182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:10 devstack sudo[100003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:34:10 devstack sudo[100003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:11 devstack sudo[100003]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b3d71989-eb1e-41c8-9b46-e0be4fc55aac tempest-ProjectReaderTests-153736182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.650s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:11 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-b3d71989-eb1e-41c8-9b46-e0be4fc55aac tempest-ProjectReaderTests-153736182 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:34:11 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-b3d71989-eb1e-41c8-9b46-e0be4fc55aac tempest-ProjectReaderTests-153736182 None] Deleted volume successfully.
Jul 14 16:34:11 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b3d71989-eb1e-41c8-9b46-e0be4fc55aac tempest-ProjectReaderTests-153736182 None] Lock "cinder-9eea65e0-9b65-4bcb-942a-a1af17717f33-delete_volume" released by "delete_volume" :: held 1.804s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:34:12 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-a862b7a1-8ebd-48c3-bf84-97d710e65be0 tempest-ProjectReaderTests-153736182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:34:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a862b7a1-8ebd-48c3-bf84-97d710e65be0 tempest-ProjectReaderTests-153736182 None] Flow 'volume_create_manager' (66334d20-26ba-4b5d-8901-8240e518d15b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:34:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a862b7a1-8ebd-48c3-bf84-97d710e65be0 tempest-ProjectReaderTests-153736182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de0b6879-8512-4681-a1ca-aaca91ace6e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:34:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a862b7a1-8ebd-48c3-bf84-97d710e65be0 tempest-ProjectReaderTests-153736182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de0b6879-8512-4681-a1ca-aaca91ace6e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:34:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-723314897',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e24e9753-896f-44b4-8a4c-2df55e326ecc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e11ad755b044372830d0a7e456bf8c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:34:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:34:12Z,use_quota=True,user_id='1749f7fa929c4e69b69440c0082a037a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:34:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a862b7a1-8ebd-48c3-bf84-97d710e65be0 tempest-ProjectReaderTests-153736182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46bda9e8-a92f-4112-8560-56728925596f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:34:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a862b7a1-8ebd-48c3-bf84-97d710e65be0 tempest-ProjectReaderTests-153736182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46bda9e8-a92f-4112-8560-56728925596f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:34:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a862b7a1-8ebd-48c3-bf84-97d710e65be0 tempest-ProjectReaderTests-153736182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (855fa6a7-17e7-4e9c-b0e8-27ae129d1924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:34:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a862b7a1-8ebd-48c3-bf84-97d710e65be0 tempest-ProjectReaderTests-153736182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (855fa6a7-17e7-4e9c-b0e8-27ae129d1924) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e24e9753-896f-44b4-8a4c-2df55e326ecc', 'volume_name': 'volume-e24e9753-896f-44b4-8a4c-2df55e326ecc', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:34:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a862b7a1-8ebd-48c3-bf84-97d710e65be0 tempest-ProjectReaderTests-153736182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (236b38b0-e39f-4b2d-8244-49b75a1f0d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:34:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a862b7a1-8ebd-48c3-bf84-97d710e65be0 tempest-ProjectReaderTests-153736182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (236b38b0-e39f-4b2d-8244-49b75a1f0d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:34:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a862b7a1-8ebd-48c3-bf84-97d710e65be0 tempest-ProjectReaderTests-153736182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (919d87a0-e688-40c0-aff2-daadb7d609ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:34:12 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-a862b7a1-8ebd-48c3-bf84-97d710e65be0 tempest-ProjectReaderTests-153736182 None] Volume e24e9753-896f-44b4-8a4c-2df55e326ecc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e24e9753-896f-44b4-8a4c-2df55e326ecc', 'volume_size': 1}
Jul 14 16:34:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a862b7a1-8ebd-48c3-bf84-97d710e65be0 tempest-ProjectReaderTests-153736182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:34:15 devstack sudo[99994]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2c10b036-23ed-4f8b-9dd7-8d4099e7b450 tempest-VolumesActionsTest-1397689694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-3c1af111-f7de-48b5-bb7e-f8e09a5ce399 /opt/stack/data/cinder/conversion/3c1af111-f7de-48b5-bb7e-f8e09a5ce399.temp_image.40156708-f64e-4cb2-85ad-c575e10c18e7b5xa6upm.img" returned: 0 in 4.968s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:15 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b4704e-259a-469d-8a9d-49a19ca55c41]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:34:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2c10b036-23ed-4f8b-9dd7-8d4099e7b450 tempest-VolumesActionsTest-1397689694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-3c1af111-f7de-48b5-bb7e-f8e09a5ce399 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:15 devstack sudo[100017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-3c1af111-f7de-48b5-bb7e-f8e09a5ce399
Jul 14 16:34:15 devstack sudo[100017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:16 devstack sudo[100017]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2c10b036-23ed-4f8b-9dd7-8d4099e7b450 tempest-VolumesActionsTest-1397689694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-3c1af111-f7de-48b5-bb7e-f8e09a5ce399" returned: 0 in 0.589s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:16 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-2c10b036-23ed-4f8b-9dd7-8d4099e7b450 tempest-VolumesActionsTest-1397689694 None] Image conversion details: src /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-3c1af111-f7de-48b5-bb7e-f8e09a5ce399, size 1024.00 MB, duration 4.97 sec, destination /opt/stack/data/cinder/conversion/3c1af111-f7de-48b5-bb7e-f8e09a5ce399.temp_image.40156708-f64e-4cb2-85ad-c575e10c18e7b5xa6upm.img {{(pid=87166) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 14 16:34:16 devstack cinder-volume[87166]: INFO cinder.image.image_utils [None req-2c10b036-23ed-4f8b-9dd7-8d4099e7b450 tempest-VolumesActionsTest-1397689694 None] Converted 1024.00 MB image at 206.07 MB/s
Jul 14 16:34:16 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-2c10b036-23ed-4f8b-9dd7-8d4099e7b450 tempest-VolumesActionsTest-1397689694 None] 40156708-f64e-4cb2-85ad-c575e10c18e7 was raw, converting to qcow2 {{(pid=87166) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}}
Jul 14 16:34:16 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff76d39-0a65-4838-a091-26c64f73ed27]: (4, 'raw') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:34:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2c10b036-23ed-4f8b-9dd7-8d4099e7b450 tempest-VolumesActionsTest-1397689694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/3c1af111-f7de-48b5-bb7e-f8e09a5ce399.temp_image.40156708-f64e-4cb2-85ad-c575e10c18e7b5xa6upm.img {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:16 devstack sudo[100025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/3c1af111-f7de-48b5-bb7e-f8e09a5ce399.temp_image.40156708-f64e-4cb2-85ad-c575e10c18e7b5xa6upm.img
Jul 14 16:34:16 devstack sudo[100025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:16 devstack sudo[100025]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2c10b036-23ed-4f8b-9dd7-8d4099e7b450 tempest-VolumesActionsTest-1397689694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/3c1af111-f7de-48b5-bb7e-f8e09a5ce399.temp_image.40156708-f64e-4cb2-85ad-c575e10c18e7b5xa6upm.img" returned: 0 in 0.359s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2c10b036-23ed-4f8b-9dd7-8d4099e7b450 tempest-VolumesActionsTest-1397689694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/3c1af111-f7de-48b5-bb7e-f8e09a5ce399.temp_image.40156708-f64e-4cb2-85ad-c575e10c18e7b5xa6upm.img {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:16 devstack sudo[100030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/3c1af111-f7de-48b5-bb7e-f8e09a5ce399.temp_image.40156708-f64e-4cb2-85ad-c575e10c18e7b5xa6upm.img
Jul 14 16:34:16 devstack sudo[100030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-a16c5fad-a3db-43c8-bd34-a1c159e4e653 req-08be4d9a-25c0-450b-9d47-69275a1e48fd tempest-TestServerVolumeAttachmentScenario-1040687344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:34:16 devstack sudo[100030]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2c10b036-23ed-4f8b-9dd7-8d4099e7b450 tempest-VolumesActionsTest-1397689694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/3c1af111-f7de-48b5-bb7e-f8e09a5ce399.temp_image.40156708-f64e-4cb2-85ad-c575e10c18e7b5xa6upm.img" returned: 1 in 0.350s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2c10b036-23ed-4f8b-9dd7-8d4099e7b450 tempest-VolumesActionsTest-1397689694 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/3c1af111-f7de-48b5-bb7e-f8e09a5ce399.temp_image.40156708-f64e-4cb2-85ad-c575e10c18e7b5xa6upm.img' failed. Not Retrying. {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 16:34:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2c10b036-23ed-4f8b-9dd7-8d4099e7b450 tempest-VolumesActionsTest-1397689694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/3c1af111-f7de-48b5-bb7e-f8e09a5ce399.temp_image.40156708-f64e-4cb2-85ad-c575e10c18e7b5xa6upm.img /opt/stack/data/cinder/conversion/vol_upload_a143kvvm {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:16 devstack sudo[100043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/3c1af111-f7de-48b5-bb7e-f8e09a5ce399.temp_image.40156708-f64e-4cb2-85ad-c575e10c18e7b5xa6upm.img /opt/stack/data/cinder/conversion/vol_upload_a143kvvm
Jul 14 16:34:16 devstack sudo[100043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:17 devstack sudo[100043]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2c10b036-23ed-4f8b-9dd7-8d4099e7b450 tempest-VolumesActionsTest-1397689694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/3c1af111-f7de-48b5-bb7e-f8e09a5ce399.temp_image.40156708-f64e-4cb2-85ad-c575e10c18e7b5xa6upm.img /opt/stack/data/cinder/conversion/vol_upload_a143kvvm" returned: 0 in 0.286s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:17 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-2c10b036-23ed-4f8b-9dd7-8d4099e7b450 tempest-VolumesActionsTest-1397689694 None] Image conversion details: src /opt/stack/data/cinder/conversion/3c1af111-f7de-48b5-bb7e-f8e09a5ce399.temp_image.40156708-f64e-4cb2-85ad-c575e10c18e7b5xa6upm.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_a143kvvm {{(pid=87166) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 14 16:34:17 devstack cinder-volume[87166]: INFO cinder.image.image_utils [None req-2c10b036-23ed-4f8b-9dd7-8d4099e7b450 tempest-VolumesActionsTest-1397689694 None] Converted 1024.00 MB image at 1024.00 MB/s
Jul 14 16:34:17 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ccebd9-a21d-4a4d-b579-2b2dfc328d92]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:34:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2c10b036-23ed-4f8b-9dd7-8d4099e7b450 tempest-VolumesActionsTest-1397689694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_a143kvvm {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:17 devstack sudo[100048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_a143kvvm
Jul 14 16:34:17 devstack sudo[100048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:17 devstack sudo[100048]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2c10b036-23ed-4f8b-9dd7-8d4099e7b450 tempest-VolumesActionsTest-1397689694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_a143kvvm" returned: 0 in 0.325s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2c10b036-23ed-4f8b-9dd7-8d4099e7b450 tempest-VolumesActionsTest-1397689694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 9.271s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:34:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2c10b036-23ed-4f8b-9dd7-8d4099e7b450 tempest-VolumesActionsTest-1397689694 None] Uploaded volume to glance image-id: 40156708-f64e-4cb2-85ad-c575e10c18e7. {{(pid=87166) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Jul 14 16:34:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-18b82a5f-94cf-4123-b8bc-d3852faa6ed3 tempest-VolumesExtendTest-1210615344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.172s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:34:18 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-18b82a5f-94cf-4123-b8bc-d3852faa6ed3 tempest-VolumesExtendTest-1210615344 None] Creating offline snapshot 66557ef7-b287-4845-bb8a-879a95500387 of volume 6a92f957-5fb2-4713-88ed-fadc079b6225 {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 16:34:18 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-2c10b036-23ed-4f8b-9dd7-8d4099e7b450 tempest-VolumesActionsTest-1397689694 None] Copy volume to image completed successfully.
Jul 14 16:34:18 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e34f67f-1a45-47fd-8871-06c52cf38b32]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:34:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-18b82a5f-94cf-4123-b8bc-d3852faa6ed3 tempest-VolumesExtendTest-1210615344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6a92f957-5fb2-4713-88ed-fadc079b6225 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:18 devstack sudo[100053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6a92f957-5fb2-4713-88ed-fadc079b6225
Jul 14 16:34:18 devstack sudo[100053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:19 devstack sudo[100053]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-18b82a5f-94cf-4123-b8bc-d3852faa6ed3 tempest-VolumesExtendTest-1210615344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6a92f957-5fb2-4713-88ed-fadc079b6225" returned: 0 in 0.403s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-18b82a5f-94cf-4123-b8bc-d3852faa6ed3 tempest-VolumesExtendTest-1210615344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6a92f957-5fb2-4713-88ed-fadc079b6225,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6a92f957-5fb2-4713-88ed-fadc079b6225.66557ef7-b287-4845-bb8a-879a95500387 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:19 devstack sudo[100058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6a92f957-5fb2-4713-88ed-fadc079b6225,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6a92f957-5fb2-4713-88ed-fadc079b6225.66557ef7-b287-4845-bb8a-879a95500387 1G
Jul 14 16:34:19 devstack sudo[100058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:19 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a6f75996-27e0-4166-9a67-0df2b9ebad24 tempest-VolumesActionsTest-1397689694 None] Acquiring lock "cinder-3c1af111-f7de-48b5-bb7e-f8e09a5ce399-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:34:19 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a6f75996-27e0-4166-9a67-0df2b9ebad24 tempest-VolumesActionsTest-1397689694 None] Lock "cinder-3c1af111-f7de-48b5-bb7e-f8e09a5ce399-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:34:19 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a6f75996-27e0-4166-9a67-0df2b9ebad24 tempest-VolumesActionsTest-1397689694 None] Acquiring lock "cinder-quobyte-3c1af111-f7de-48b5-bb7e-f8e09a5ce399" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:34:19 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a6f75996-27e0-4166-9a67-0df2b9ebad24 tempest-VolumesActionsTest-1397689694 None] Lock "cinder-quobyte-3c1af111-f7de-48b5-bb7e-f8e09a5ce399" acquired by "delete_volume" :: waited 0.019s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:34:19 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd252989-a429-4997-ad1f-368f1e2ca9e8]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:34:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a6f75996-27e0-4166-9a67-0df2b9ebad24 tempest-VolumesActionsTest-1397689694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-3c1af111-f7de-48b5-bb7e-f8e09a5ce399 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:19 devstack sudo[100058]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-18b82a5f-94cf-4123-b8bc-d3852faa6ed3 tempest-VolumesExtendTest-1210615344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6a92f957-5fb2-4713-88ed-fadc079b6225,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6a92f957-5fb2-4713-88ed-fadc079b6225.66557ef7-b287-4845-bb8a-879a95500387 1G" returned: 0 in 0.472s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-18b82a5f-94cf-4123-b8bc-d3852faa6ed3 tempest-VolumesExtendTest-1210615344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a92f957-5fb2-4713-88ed-fadc079b6225 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6a92f957-5fb2-4713-88ed-fadc079b6225.66557ef7-b287-4845-bb8a-879a95500387 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:19 devstack sudo[100064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-3c1af111-f7de-48b5-bb7e-f8e09a5ce399
Jul 14 16:34:19 devstack sudo[100064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:19 devstack sudo[100066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a92f957-5fb2-4713-88ed-fadc079b6225 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6a92f957-5fb2-4713-88ed-fadc079b6225.66557ef7-b287-4845-bb8a-879a95500387
Jul 14 16:34:19 devstack sudo[100066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:19 devstack sudo[100064]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a6f75996-27e0-4166-9a67-0df2b9ebad24 tempest-VolumesActionsTest-1397689694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-3c1af111-f7de-48b5-bb7e-f8e09a5ce399" returned: 0 in 0.404s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a6f75996-27e0-4166-9a67-0df2b9ebad24 tempest-VolumesActionsTest-1397689694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-3c1af111-f7de-48b5-bb7e-f8e09a5ce399 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:19 devstack sudo[100066]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-18b82a5f-94cf-4123-b8bc-d3852faa6ed3 tempest-VolumesExtendTest-1210615344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a92f957-5fb2-4713-88ed-fadc079b6225 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6a92f957-5fb2-4713-88ed-fadc079b6225.66557ef7-b287-4845-bb8a-879a95500387" returned: 0 in 0.317s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:19 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-18b82a5f-94cf-4123-b8bc-d3852faa6ed3 tempest-VolumesExtendTest-1210615344 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6a92f957-5fb2-4713-88ed-fadc079b6225.66557ef7-b287-4845-bb8a-879a95500387 is being set with open permissions: ugo+rw
Jul 14 16:34:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-18b82a5f-94cf-4123-b8bc-d3852faa6ed3 tempest-VolumesExtendTest-1210615344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6a92f957-5fb2-4713-88ed-fadc079b6225.66557ef7-b287-4845-bb8a-879a95500387 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:19 devstack sudo[100076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-3c1af111-f7de-48b5-bb7e-f8e09a5ce399
Jul 14 16:34:19 devstack sudo[100076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:19 devstack sudo[100077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6a92f957-5fb2-4713-88ed-fadc079b6225.66557ef7-b287-4845-bb8a-879a95500387
Jul 14 16:34:19 devstack sudo[100077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:20 devstack sudo[100076]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a6f75996-27e0-4166-9a67-0df2b9ebad24 tempest-VolumesActionsTest-1397689694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-3c1af111-f7de-48b5-bb7e-f8e09a5ce399" returned: 0 in 0.262s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:20 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a6f75996-27e0-4166-9a67-0df2b9ebad24 tempest-VolumesActionsTest-1397689694 None] Lock "cinder-quobyte-3c1af111-f7de-48b5-bb7e-f8e09a5ce399" released by "delete_volume" :: held 0.703s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:34:20 devstack sudo[100077]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-18b82a5f-94cf-4123-b8bc-d3852faa6ed3 tempest-VolumesExtendTest-1210615344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6a92f957-5fb2-4713-88ed-fadc079b6225.66557ef7-b287-4845-bb8a-879a95500387" returned: 0 in 0.259s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-18b82a5f-94cf-4123-b8bc-d3852faa6ed3 tempest-VolumesExtendTest-1210615344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6a92f957-5fb2-4713-88ed-fadc079b6225.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:20 devstack sudo[100082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6a92f957-5fb2-4713-88ed-fadc079b6225.info
Jul 14 16:34:20 devstack sudo[100082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:20 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-a6f75996-27e0-4166-9a67-0df2b9ebad24 tempest-VolumesActionsTest-1397689694 None] Created reservations ['8fe1f609-0379-4c74-b9c7-98b22697fa02', '0b11ff3d-9cc5-4910-8bfa-847caafcd88b', '4efec28b-d7d5-4bc3-bd08-97875fb12c5e', 'a3c8a71a-f442-41ab-a3f4-b57a783f0a15'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:34:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a6f75996-27e0-4166-9a67-0df2b9ebad24 tempest-VolumesActionsTest-1397689694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:34:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a6f75996-27e0-4166-9a67-0df2b9ebad24 tempest-VolumesActionsTest-1397689694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:34:20 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a6f75996-27e0-4166-9a67-0df2b9ebad24 tempest-VolumesActionsTest-1397689694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:34:20 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a6f75996-27e0-4166-9a67-0df2b9ebad24 tempest-VolumesActionsTest-1397689694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:34:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a6f75996-27e0-4166-9a67-0df2b9ebad24 tempest-VolumesActionsTest-1397689694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:34:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a6f75996-27e0-4166-9a67-0df2b9ebad24 tempest-VolumesActionsTest-1397689694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:20 devstack sudo[100084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:34:20 devstack sudo[100084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:20 devstack sudo[100082]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-18b82a5f-94cf-4123-b8bc-d3852faa6ed3 tempest-VolumesExtendTest-1210615344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6a92f957-5fb2-4713-88ed-fadc079b6225.info" returned: 0 in 0.260s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:20 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-18b82a5f-94cf-4123-b8bc-d3852faa6ed3 tempest-VolumesExtendTest-1210615344 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6a92f957-5fb2-4713-88ed-fadc079b6225.info is being set with open permissions: ugo+rw
Jul 14 16:34:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-18b82a5f-94cf-4123-b8bc-d3852faa6ed3 tempest-VolumesExtendTest-1210615344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6a92f957-5fb2-4713-88ed-fadc079b6225.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:20 devstack sudo[100087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6a92f957-5fb2-4713-88ed-fadc079b6225.info
Jul 14 16:34:20 devstack sudo[100087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:20 devstack sudo[100084]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a6f75996-27e0-4166-9a67-0df2b9ebad24 tempest-VolumesActionsTest-1397689694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.264s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:20 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-a6f75996-27e0-4166-9a67-0df2b9ebad24 tempest-VolumesActionsTest-1397689694 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:34:20 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-a6f75996-27e0-4166-9a67-0df2b9ebad24 tempest-VolumesActionsTest-1397689694 None] Deleted volume successfully.
Jul 14 16:34:20 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a6f75996-27e0-4166-9a67-0df2b9ebad24 tempest-VolumesActionsTest-1397689694 None] Lock "cinder-3c1af111-f7de-48b5-bb7e-f8e09a5ce399-delete_volume" released by "delete_volume" :: held 1.208s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:34:20 devstack sudo[100087]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-18b82a5f-94cf-4123-b8bc-d3852faa6ed3 tempest-VolumesExtendTest-1210615344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6a92f957-5fb2-4713-88ed-fadc079b6225.info" returned: 0 in 0.272s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-18b82a5f-94cf-4123-b8bc-d3852faa6ed3 tempest-VolumesExtendTest-1210615344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.099s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:34:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a862b7a1-8ebd-48c3-bf84-97d710e65be0 tempest-ProjectReaderTests-153736182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.928s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:34:20 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a862b7a1-8ebd-48c3-bf84-97d710e65be0 tempest-ProjectReaderTests-153736182 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:34:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-723314897',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e24e9753-896f-44b4-8a4c-2df55e326ecc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e11ad755b044372830d0a7e456bf8c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:34:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:34:12Z,use_quota=True,user_id='1749f7fa929c4e69b69440c0082a037a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:34:20 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-a862b7a1-8ebd-48c3-bf84-97d710e65be0 tempest-ProjectReaderTests-153736182 None] Creating volume e24e9753-896f-44b4-8a4c-2df55e326ecc {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:34:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a862b7a1-8ebd-48c3-bf84-97d710e65be0 tempest-ProjectReaderTests-153736182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:34:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a862b7a1-8ebd-48c3-bf84-97d710e65be0 tempest-ProjectReaderTests-153736182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:34:20 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a862b7a1-8ebd-48c3-bf84-97d710e65be0 tempest-ProjectReaderTests-153736182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:34:20 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a862b7a1-8ebd-48c3-bf84-97d710e65be0 tempest-ProjectReaderTests-153736182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:34:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a862b7a1-8ebd-48c3-bf84-97d710e65be0 tempest-ProjectReaderTests-153736182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:34:20 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a862b7a1-8ebd-48c3-bf84-97d710e65be0 tempest-ProjectReaderTests-153736182 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:34:20 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-a862b7a1-8ebd-48c3-bf84-97d710e65be0 tempest-ProjectReaderTests-153736182 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:34:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a862b7a1-8ebd-48c3-bf84-97d710e65be0 tempest-ProjectReaderTests-153736182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e24e9753-896f-44b4-8a4c-2df55e326ecc 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:20 devstack sudo[100091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e24e9753-896f-44b4-8a4c-2df55e326ecc 1073741824
Jul 14 16:34:20 devstack sudo[100091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:20 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-18b82a5f-94cf-4123-b8bc-d3852faa6ed3 tempest-VolumesExtendTest-1210615344 None] Create snapshot completed successfully
Jul 14 16:34:21 devstack sudo[100091]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a862b7a1-8ebd-48c3-bf84-97d710e65be0 tempest-ProjectReaderTests-153736182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e24e9753-896f-44b4-8a4c-2df55e326ecc 1073741824" returned: 0 in 0.458s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a862b7a1-8ebd-48c3-bf84-97d710e65be0 tempest-ProjectReaderTests-153736182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e24e9753-896f-44b4-8a4c-2df55e326ecc {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:21 devstack sudo[100097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e24e9753-896f-44b4-8a4c-2df55e326ecc
Jul 14 16:34:21 devstack sudo[100097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:21 devstack sudo[100097]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a862b7a1-8ebd-48c3-bf84-97d710e65be0 tempest-ProjectReaderTests-153736182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e24e9753-896f-44b4-8a4c-2df55e326ecc" returned: 0 in 0.251s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:21 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a862b7a1-8ebd-48c3-bf84-97d710e65be0 tempest-ProjectReaderTests-153736182 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:34:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a862b7a1-8ebd-48c3-bf84-97d710e65be0 tempest-ProjectReaderTests-153736182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:34:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-a16c5fad-a3db-43c8-bd34-a1c159e4e653 req-08be4d9a-25c0-450b-9d47-69275a1e48fd tempest-TestServerVolumeAttachmentScenario-1040687344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.837s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:34:21 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a862b7a1-8ebd-48c3-bf84-97d710e65be0 tempest-ProjectReaderTests-153736182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (919d87a0-e688-40c0-aff2-daadb7d609ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e24e9753-896f-44b4-8a4c-2df55e326ecc', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:34:21 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a862b7a1-8ebd-48c3-bf84-97d710e65be0 tempest-ProjectReaderTests-153736182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1bd3c60-6880-4cd8-ae81-1e257e240977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:34:21 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da13e04-6e71-47f8-9e63-0a13058fe842]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:34:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-a16c5fad-a3db-43c8-bd34-a1c159e4e653 req-08be4d9a-25c0-450b-9d47-69275a1e48fd tempest-TestServerVolumeAttachmentScenario-1040687344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f2d2c24b-42cf-48ed-8f78-62572d105604 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:21 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-a862b7a1-8ebd-48c3-bf84-97d710e65be0 tempest-ProjectReaderTests-153736182 None] Volume volume-e24e9753-896f-44b4-8a4c-2df55e326ecc (e24e9753-896f-44b4-8a4c-2df55e326ecc): created successfully
Jul 14 16:34:21 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a862b7a1-8ebd-48c3-bf84-97d710e65be0 tempest-ProjectReaderTests-153736182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1bd3c60-6880-4cd8-ae81-1e257e240977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:34:21 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a862b7a1-8ebd-48c3-bf84-97d710e65be0 tempest-ProjectReaderTests-153736182 None] Flow 'volume_create_manager' (66334d20-26ba-4b5d-8901-8240e518d15b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:34:21 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-a862b7a1-8ebd-48c3-bf84-97d710e65be0 tempest-ProjectReaderTests-153736182 None] Created volume successfully.
Jul 14 16:34:21 devstack sudo[100100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f2d2c24b-42cf-48ed-8f78-62572d105604
Jul 14 16:34:21 devstack sudo[100100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:22 devstack sudo[100100]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-a16c5fad-a3db-43c8-bd34-a1c159e4e653 req-08be4d9a-25c0-450b-9d47-69275a1e48fd tempest-TestServerVolumeAttachmentScenario-1040687344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f2d2c24b-42cf-48ed-8f78-62572d105604" returned: 0 in 0.442s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-a16c5fad-a3db-43c8-bd34-a1c159e4e653 req-08be4d9a-25c0-450b-9d47-69275a1e48fd tempest-TestServerVolumeAttachmentScenario-1040687344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.478s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:34:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-a16c5fad-a3db-43c8-bd34-a1c159e4e653 req-08be4d9a-25c0-450b-9d47-69275a1e48fd tempest-TestServerVolumeAttachmentScenario-1040687344 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052', 'name': 'volume-f2d2c24b-42cf-48ed-8f78-62572d105604', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '134f267e-e866-4693-9faf-0821b9330f00', 'enforce_multipath': True} {{(pid=87166) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 14 16:34:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-028aa7f0-a92a-465e-9b1a-aeb21115d4f3 tempest-VolumesExtendTest-1210615344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:34:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-028aa7f0-a92a-465e-9b1a-aeb21115d4f3 tempest-VolumesExtendTest-1210615344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:34:22 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9db73a0-58ce-4112-802b-775685a75a99]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:34:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-028aa7f0-a92a-465e-9b1a-aeb21115d4f3 tempest-VolumesExtendTest-1210615344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6a92f957-5fb2-4713-88ed-fadc079b6225 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:22 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-a16c5fad-a3db-43c8-bd34-a1c159e4e653 req-08be4d9a-25c0-450b-9d47-69275a1e48fd tempest-TestServerVolumeAttachmentScenario-1040687344 None] attachment_update completed successfully.
Jul 14 16:34:22 devstack sudo[100106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6a92f957-5fb2-4713-88ed-fadc079b6225
Jul 14 16:34:22 devstack sudo[100106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6b62ce21-686a-4e92-a110-6207df0d0b7c tempest-ProjectReaderTests-153736182 None] Acquiring lock "cinder-e24e9753-896f-44b4-8a4c-2df55e326ecc-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:34:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6b62ce21-686a-4e92-a110-6207df0d0b7c tempest-ProjectReaderTests-153736182 None] Lock "cinder-e24e9753-896f-44b4-8a4c-2df55e326ecc-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:34:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6b62ce21-686a-4e92-a110-6207df0d0b7c tempest-ProjectReaderTests-153736182 None] Acquiring lock "cinder-quobyte-e24e9753-896f-44b4-8a4c-2df55e326ecc" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:34:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6b62ce21-686a-4e92-a110-6207df0d0b7c tempest-ProjectReaderTests-153736182 None] Lock "cinder-quobyte-e24e9753-896f-44b4-8a4c-2df55e326ecc" acquired by "delete_volume" :: waited 0.026s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:34:22 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf173ac-0937-419e-960b-1e7f7efb4da5]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:34:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6b62ce21-686a-4e92-a110-6207df0d0b7c tempest-ProjectReaderTests-153736182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e24e9753-896f-44b4-8a4c-2df55e326ecc {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:22 devstack sudo[100110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e24e9753-896f-44b4-8a4c-2df55e326ecc
Jul 14 16:34:22 devstack sudo[100110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:22 devstack sudo[100106]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-028aa7f0-a92a-465e-9b1a-aeb21115d4f3 tempest-VolumesExtendTest-1210615344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6a92f957-5fb2-4713-88ed-fadc079b6225" returned: 0 in 0.562s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-028aa7f0-a92a-465e-9b1a-aeb21115d4f3 tempest-VolumesExtendTest-1210615344 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6a92f957-5fb2-4713-88ed-fadc079b6225.66557ef7-b287-4845-bb8a-879a95500387 2G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-028aa7f0-a92a-465e-9b1a-aeb21115d4f3 tempest-VolumesExtendTest-1210615344 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6a92f957-5fb2-4713-88ed-fadc079b6225.66557ef7-b287-4845-bb8a-879a95500387 2G" returned: 0 in 0.237s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-028aa7f0-a92a-465e-9b1a-aeb21115d4f3 tempest-VolumesExtendTest-1210615344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.865s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:34:23 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-028aa7f0-a92a-465e-9b1a-aeb21115d4f3 tempest-VolumesExtendTest-1210615344 None] Extend volume completed successfully.
Jul 14 16:34:23 devstack sudo[100110]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6b62ce21-686a-4e92-a110-6207df0d0b7c tempest-ProjectReaderTests-153736182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e24e9753-896f-44b4-8a4c-2df55e326ecc" returned: 0 in 0.538s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6b62ce21-686a-4e92-a110-6207df0d0b7c tempest-ProjectReaderTests-153736182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e24e9753-896f-44b4-8a4c-2df55e326ecc {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:23 devstack sudo[100121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e24e9753-896f-44b4-8a4c-2df55e326ecc
Jul 14 16:34:23 devstack sudo[100121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:23 devstack sudo[100121]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6b62ce21-686a-4e92-a110-6207df0d0b7c tempest-ProjectReaderTests-153736182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e24e9753-896f-44b4-8a4c-2df55e326ecc" returned: 0 in 0.287s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:23 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6b62ce21-686a-4e92-a110-6207df0d0b7c tempest-ProjectReaderTests-153736182 None] Lock "cinder-quobyte-e24e9753-896f-44b4-8a4c-2df55e326ecc" released by "delete_volume" :: held 0.882s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:34:23 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7502f0bf-43c3-4d8f-924a-2ee2b89134f3 tempest-VolumesExtendTest-1210615344 None] Acquiring lock "cinder-66557ef7-b287-4845-bb8a-879a95500387-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:34:23 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-6b62ce21-686a-4e92-a110-6207df0d0b7c tempest-ProjectReaderTests-153736182 None] Created reservations ['46d0c613-0317-4f7d-89f3-974fe4394604', '8608c9d7-5698-4457-a0b0-cbd5e5822391', '6faa2de7-5ea0-44bb-a578-51047e841fbc', 'c549df25-821d-45b3-b1d7-a4187894f6d6'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:34:23 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7502f0bf-43c3-4d8f-924a-2ee2b89134f3 tempest-VolumesExtendTest-1210615344 None] Lock "cinder-66557ef7-b287-4845-bb8a-879a95500387-delete_snapshot" acquired by "delete_snapshot" :: waited 0.059s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:34:23 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7502f0bf-43c3-4d8f-924a-2ee2b89134f3 tempest-VolumesExtendTest-1210615344 None] Acquiring lock "cinder-quobyte-6a92f957-5fb2-4713-88ed-fadc079b6225" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:34:23 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7502f0bf-43c3-4d8f-924a-2ee2b89134f3 tempest-VolumesExtendTest-1210615344 None] Lock "cinder-quobyte-6a92f957-5fb2-4713-88ed-fadc079b6225" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:34:23 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7502f0bf-43c3-4d8f-924a-2ee2b89134f3 tempest-VolumesExtendTest-1210615344 None] Acquiring lock "cinder-quobyte-66557ef7-b287-4845-bb8a-879a95500387" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:34:23 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7502f0bf-43c3-4d8f-924a-2ee2b89134f3 tempest-VolumesExtendTest-1210615344 None] Lock "cinder-quobyte-66557ef7-b287-4845-bb8a-879a95500387" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:34:23 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-7502f0bf-43c3-4d8f-924a-2ee2b89134f3 tempest-VolumesExtendTest-1210615344 None] Deleting offline snapshot 66557ef7-b287-4845-bb8a-879a95500387 of volume 6a92f957-5fb2-4713-88ed-fadc079b6225 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 16:34:23 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-7502f0bf-43c3-4d8f-924a-2ee2b89134f3 tempest-VolumesExtendTest-1210615344 None] snapshot_file for this snap is: volume-6a92f957-5fb2-4713-88ed-fadc079b6225.66557ef7-b287-4845-bb8a-879a95500387 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 16:34:23 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[3614464b-c6bf-46b1-99af-e2e3813aeb13]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:34:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7502f0bf-43c3-4d8f-924a-2ee2b89134f3 tempest-VolumesExtendTest-1210615344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6a92f957-5fb2-4713-88ed-fadc079b6225.66557ef7-b287-4845-bb8a-879a95500387 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6b62ce21-686a-4e92-a110-6207df0d0b7c tempest-ProjectReaderTests-153736182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:34:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6b62ce21-686a-4e92-a110-6207df0d0b7c tempest-ProjectReaderTests-153736182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:34:23 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6b62ce21-686a-4e92-a110-6207df0d0b7c tempest-ProjectReaderTests-153736182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:34:23 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6b62ce21-686a-4e92-a110-6207df0d0b7c tempest-ProjectReaderTests-153736182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:34:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6b62ce21-686a-4e92-a110-6207df0d0b7c tempest-ProjectReaderTests-153736182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:34:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6b62ce21-686a-4e92-a110-6207df0d0b7c tempest-ProjectReaderTests-153736182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:23 devstack sudo[100125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:34:23 devstack sudo[100125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:23 devstack sudo[100124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6a92f957-5fb2-4713-88ed-fadc079b6225.66557ef7-b287-4845-bb8a-879a95500387
Jul 14 16:34:23 devstack sudo[100124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:23 devstack sudo[100125]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6b62ce21-686a-4e92-a110-6207df0d0b7c tempest-ProjectReaderTests-153736182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.319s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:24 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-6b62ce21-686a-4e92-a110-6207df0d0b7c tempest-ProjectReaderTests-153736182 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:34:24 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-6b62ce21-686a-4e92-a110-6207df0d0b7c tempest-ProjectReaderTests-153736182 None] Deleted volume successfully.
Jul 14 16:34:24 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6b62ce21-686a-4e92-a110-6207df0d0b7c tempest-ProjectReaderTests-153736182 None] Lock "cinder-e24e9753-896f-44b4-8a4c-2df55e326ecc-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:34:24 devstack sudo[100124]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7502f0bf-43c3-4d8f-924a-2ee2b89134f3 tempest-VolumesExtendTest-1210615344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6a92f957-5fb2-4713-88ed-fadc079b6225.66557ef7-b287-4845-bb8a-879a95500387" returned: 0 in 0.412s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:24 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-7502f0bf-43c3-4d8f-924a-2ee2b89134f3 tempest-VolumesExtendTest-1210615344 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a92f957-5fb2-4713-88ed-fadc079b6225(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 16:34:24 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[c72c06f4-2a41-474b-9b78-d7d91744471d]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:34:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7502f0bf-43c3-4d8f-924a-2ee2b89134f3 tempest-VolumesExtendTest-1210615344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6a92f957-5fb2-4713-88ed-fadc079b6225 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:24 devstack sudo[100132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6a92f957-5fb2-4713-88ed-fadc079b6225
Jul 14 16:34:24 devstack sudo[100132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:24 devstack sudo[100132]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7502f0bf-43c3-4d8f-924a-2ee2b89134f3 tempest-VolumesExtendTest-1210615344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6a92f957-5fb2-4713-88ed-fadc079b6225" returned: 0 in 0.468s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7502f0bf-43c3-4d8f-924a-2ee2b89134f3 tempest-VolumesExtendTest-1210615344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6a92f957-5fb2-4713-88ed-fadc079b6225.66557ef7-b287-4845-bb8a-879a95500387 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:24 devstack sudo[100138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6a92f957-5fb2-4713-88ed-fadc079b6225.66557ef7-b287-4845-bb8a-879a95500387
Jul 14 16:34:24 devstack sudo[100138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:25 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-d0d625e3-45d3-4d7d-9c07-576ff7428ff7 req-aca1d956-b47e-455b-8da1-3f19192648c2 tempest-TestServerVolumeAttachmentScenario-1040687344 None] Terminate volume connection completed successfully.
Jul 14 16:34:25 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-d0d625e3-45d3-4d7d-9c07-576ff7428ff7 req-aca1d956-b47e-455b-8da1-3f19192648c2 tempest-TestServerVolumeAttachmentScenario-1040687344 None] Deleting attachment 134f267e-e866-4693-9faf-0821b9330f00. {{(pid=87166) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 14 16:34:25 devstack sudo[100138]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7502f0bf-43c3-4d8f-924a-2ee2b89134f3 tempest-VolumesExtendTest-1210615344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6a92f957-5fb2-4713-88ed-fadc079b6225.66557ef7-b287-4845-bb8a-879a95500387" returned: 0 in 0.622s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7502f0bf-43c3-4d8f-924a-2ee2b89134f3 tempest-VolumesExtendTest-1210615344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6a92f957-5fb2-4713-88ed-fadc079b6225.66557ef7-b287-4845-bb8a-879a95500387 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:25 devstack sudo[100146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6a92f957-5fb2-4713-88ed-fadc079b6225.66557ef7-b287-4845-bb8a-879a95500387
Jul 14 16:34:25 devstack sudo[100146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:25 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ba4e95d-81b9-478d-8d87-aa7348f41835 tempest-ProjectReaderTests-153736182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:34:25 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6ba4e95d-81b9-478d-8d87-aa7348f41835 tempest-ProjectReaderTests-153736182 None] Flow 'volume_create_manager' (ab525b0e-fee4-4a5f-9743-bf635d890a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:34:25 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6ba4e95d-81b9-478d-8d87-aa7348f41835 tempest-ProjectReaderTests-153736182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1572d666-c846-46ee-be90-f563aa06b8d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:34:25 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6ba4e95d-81b9-478d-8d87-aa7348f41835 tempest-ProjectReaderTests-153736182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1572d666-c846-46ee-be90-f563aa06b8d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:34:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2085851597',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8396eb69-3fa4-424f-8b1c-03a5d67452ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e11ad755b044372830d0a7e456bf8c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:34:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:34:25Z,use_quota=True,user_id='1749f7fa929c4e69b69440c0082a037a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:34:25 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6ba4e95d-81b9-478d-8d87-aa7348f41835 tempest-ProjectReaderTests-153736182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c784493-a089-4c90-9a93-5661136ce811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:34:25 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6ba4e95d-81b9-478d-8d87-aa7348f41835 tempest-ProjectReaderTests-153736182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c784493-a089-4c90-9a93-5661136ce811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:34:25 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6ba4e95d-81b9-478d-8d87-aa7348f41835 tempest-ProjectReaderTests-153736182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fef43bd-6985-41e5-bab5-e3a5b0e73eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:34:25 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6ba4e95d-81b9-478d-8d87-aa7348f41835 tempest-ProjectReaderTests-153736182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fef43bd-6985-41e5-bab5-e3a5b0e73eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8396eb69-3fa4-424f-8b1c-03a5d67452ad', 'volume_name': 'volume-8396eb69-3fa4-424f-8b1c-03a5d67452ad', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:34:25 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6ba4e95d-81b9-478d-8d87-aa7348f41835 tempest-ProjectReaderTests-153736182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be17d155-4792-479f-b016-15e482b3be90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:34:25 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6ba4e95d-81b9-478d-8d87-aa7348f41835 tempest-ProjectReaderTests-153736182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be17d155-4792-479f-b016-15e482b3be90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:34:25 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6ba4e95d-81b9-478d-8d87-aa7348f41835 tempest-ProjectReaderTests-153736182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0daf588d-2e33-4f86-8cf0-77d4e91509e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:34:25 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-6ba4e95d-81b9-478d-8d87-aa7348f41835 tempest-ProjectReaderTests-153736182 None] Volume 8396eb69-3fa4-424f-8b1c-03a5d67452ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8396eb69-3fa4-424f-8b1c-03a5d67452ad', 'volume_size': 1}
Jul 14 16:34:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6ba4e95d-81b9-478d-8d87-aa7348f41835 tempest-ProjectReaderTests-153736182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:34:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6ba4e95d-81b9-478d-8d87-aa7348f41835 tempest-ProjectReaderTests-153736182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:34:25 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6ba4e95d-81b9-478d-8d87-aa7348f41835 tempest-ProjectReaderTests-153736182 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:34:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2085851597',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8396eb69-3fa4-424f-8b1c-03a5d67452ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e11ad755b044372830d0a7e456bf8c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:34:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:34:25Z,use_quota=True,user_id='1749f7fa929c4e69b69440c0082a037a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:34:25 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-6ba4e95d-81b9-478d-8d87-aa7348f41835 tempest-ProjectReaderTests-153736182 None] Creating volume 8396eb69-3fa4-424f-8b1c-03a5d67452ad {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:34:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6ba4e95d-81b9-478d-8d87-aa7348f41835 tempest-ProjectReaderTests-153736182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:34:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6ba4e95d-81b9-478d-8d87-aa7348f41835 tempest-ProjectReaderTests-153736182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:34:25 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6ba4e95d-81b9-478d-8d87-aa7348f41835 tempest-ProjectReaderTests-153736182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:34:25 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6ba4e95d-81b9-478d-8d87-aa7348f41835 tempest-ProjectReaderTests-153736182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:34:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6ba4e95d-81b9-478d-8d87-aa7348f41835 tempest-ProjectReaderTests-153736182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:34:25 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6ba4e95d-81b9-478d-8d87-aa7348f41835 tempest-ProjectReaderTests-153736182 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:34:25 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-6ba4e95d-81b9-478d-8d87-aa7348f41835 tempest-ProjectReaderTests-153736182 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:34:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6ba4e95d-81b9-478d-8d87-aa7348f41835 tempest-ProjectReaderTests-153736182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8396eb69-3fa4-424f-8b1c-03a5d67452ad 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:25 devstack sudo[100148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8396eb69-3fa4-424f-8b1c-03a5d67452ad 1073741824
Jul 14 16:34:25 devstack sudo[100148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:25 devstack sudo[100146]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7502f0bf-43c3-4d8f-924a-2ee2b89134f3 tempest-VolumesExtendTest-1210615344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6a92f957-5fb2-4713-88ed-fadc079b6225.66557ef7-b287-4845-bb8a-879a95500387" returned: 0 in 0.304s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:25 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7502f0bf-43c3-4d8f-924a-2ee2b89134f3 tempest-VolumesExtendTest-1210615344 None] Lock "cinder-quobyte-66557ef7-b287-4845-bb8a-879a95500387" released by "_delete_snapshot" :: held 1.942s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:34:25 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7502f0bf-43c3-4d8f-924a-2ee2b89134f3 tempest-VolumesExtendTest-1210615344 None] Lock "cinder-quobyte-6a92f957-5fb2-4713-88ed-fadc079b6225" released by "delete_snapshot" :: held 1.973s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:34:25 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-7502f0bf-43c3-4d8f-924a-2ee2b89134f3 tempest-VolumesExtendTest-1210615344 None] Created reservations ['5315fc55-f2c0-44ce-9358-feced7d70821', '3f7c0db9-e064-42d1-9af5-7e1f7c974aa0', 'd1916afe-a1fd-474e-ac13-022ba1109bba', 'dda7e8f1-e519-456c-ae15-7f4d2b8895ad'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:34:25 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-7502f0bf-43c3-4d8f-924a-2ee2b89134f3 tempest-VolumesExtendTest-1210615344 None] Delete snapshot completed successfully.
Jul 14 16:34:25 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7502f0bf-43c3-4d8f-924a-2ee2b89134f3 tempest-VolumesExtendTest-1210615344 None] Lock "cinder-66557ef7-b287-4845-bb8a-879a95500387-delete_snapshot" released by "delete_snapshot" :: held 2.135s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:34:25 devstack sudo[100148]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6ba4e95d-81b9-478d-8d87-aa7348f41835 tempest-ProjectReaderTests-153736182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8396eb69-3fa4-424f-8b1c-03a5d67452ad 1073741824" returned: 0 in 0.563s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6ba4e95d-81b9-478d-8d87-aa7348f41835 tempest-ProjectReaderTests-153736182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8396eb69-3fa4-424f-8b1c-03a5d67452ad {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:26 devstack sudo[100155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8396eb69-3fa4-424f-8b1c-03a5d67452ad
Jul 14 16:34:26 devstack sudo[100155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:26 devstack sudo[100155]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6ba4e95d-81b9-478d-8d87-aa7348f41835 tempest-ProjectReaderTests-153736182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8396eb69-3fa4-424f-8b1c-03a5d67452ad" returned: 0 in 0.295s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:26 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6ba4e95d-81b9-478d-8d87-aa7348f41835 tempest-ProjectReaderTests-153736182 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:34:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6ba4e95d-81b9-478d-8d87-aa7348f41835 tempest-ProjectReaderTests-153736182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:34:26 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6ba4e95d-81b9-478d-8d87-aa7348f41835 tempest-ProjectReaderTests-153736182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0daf588d-2e33-4f86-8cf0-77d4e91509e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8396eb69-3fa4-424f-8b1c-03a5d67452ad', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:34:26 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6ba4e95d-81b9-478d-8d87-aa7348f41835 tempest-ProjectReaderTests-153736182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e6a2a17-d015-44f8-80e3-f7aa57f0ba05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:34:26 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-6ba4e95d-81b9-478d-8d87-aa7348f41835 tempest-ProjectReaderTests-153736182 None] Volume volume-8396eb69-3fa4-424f-8b1c-03a5d67452ad (8396eb69-3fa4-424f-8b1c-03a5d67452ad): created successfully
Jul 14 16:34:26 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6ba4e95d-81b9-478d-8d87-aa7348f41835 tempest-ProjectReaderTests-153736182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e6a2a17-d015-44f8-80e3-f7aa57f0ba05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:34:26 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6ba4e95d-81b9-478d-8d87-aa7348f41835 tempest-ProjectReaderTests-153736182 None] Flow 'volume_create_manager' (ab525b0e-fee4-4a5f-9743-bf635d890a5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:34:26 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-6ba4e95d-81b9-478d-8d87-aa7348f41835 tempest-ProjectReaderTests-153736182 None] Created volume successfully.
Jul 14 16:34:26 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-c505a07f-7e09-41b0-b610-1d581c068391 req-2f2163aa-e16b-46d2-b39b-2456701740a1 tempest-TestServerVolumeAttachmentScenario-1040687344 None] Terminate volume connection completed successfully.
Jul 14 16:34:26 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-c505a07f-7e09-41b0-b610-1d581c068391 req-2f2163aa-e16b-46d2-b39b-2456701740a1 tempest-TestServerVolumeAttachmentScenario-1040687344 None] Deleting attachment c4ef5776-c3b1-4402-8db3-e189b6c65a08. {{(pid=87166) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 14 16:34:26 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-da645579-5ddd-455b-9292-fab96064cc60 tempest-VolumesExtendTest-1210615344 None] Acquiring lock "cinder-6a92f957-5fb2-4713-88ed-fadc079b6225-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:34:26 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-da645579-5ddd-455b-9292-fab96064cc60 tempest-VolumesExtendTest-1210615344 None] Lock "cinder-6a92f957-5fb2-4713-88ed-fadc079b6225-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:34:26 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-da645579-5ddd-455b-9292-fab96064cc60 tempest-VolumesExtendTest-1210615344 None] Acquiring lock "cinder-quobyte-6a92f957-5fb2-4713-88ed-fadc079b6225" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:34:26 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-da645579-5ddd-455b-9292-fab96064cc60 tempest-VolumesExtendTest-1210615344 None] Lock "cinder-quobyte-6a92f957-5fb2-4713-88ed-fadc079b6225" acquired by "delete_volume" :: waited 0.020s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:34:26 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c9a992-341f-498e-bc34-533e0cfe3b43]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:34:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-da645579-5ddd-455b-9292-fab96064cc60 tempest-VolumesExtendTest-1210615344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6a92f957-5fb2-4713-88ed-fadc079b6225 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:27 devstack sudo[100185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6a92f957-5fb2-4713-88ed-fadc079b6225
Jul 14 16:34:27 devstack sudo[100185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:27 devstack sudo[100185]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-da645579-5ddd-455b-9292-fab96064cc60 tempest-VolumesExtendTest-1210615344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6a92f957-5fb2-4713-88ed-fadc079b6225" returned: 0 in 0.439s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-da645579-5ddd-455b-9292-fab96064cc60 tempest-VolumesExtendTest-1210615344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6a92f957-5fb2-4713-88ed-fadc079b6225 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:27 devstack sudo[100190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6a92f957-5fb2-4713-88ed-fadc079b6225
Jul 14 16:34:27 devstack sudo[100190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:27 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0615df9a-beb2-4be2-a5b7-8df5e292fb60 tempest-ProjectReaderTests-153736182 None] Acquiring lock "cinder-8396eb69-3fa4-424f-8b1c-03a5d67452ad-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:34:27 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0615df9a-beb2-4be2-a5b7-8df5e292fb60 tempest-ProjectReaderTests-153736182 None] Lock "cinder-8396eb69-3fa4-424f-8b1c-03a5d67452ad-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:34:27 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0615df9a-beb2-4be2-a5b7-8df5e292fb60 tempest-ProjectReaderTests-153736182 None] Acquiring lock "cinder-quobyte-8396eb69-3fa4-424f-8b1c-03a5d67452ad" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:34:27 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0615df9a-beb2-4be2-a5b7-8df5e292fb60 tempest-ProjectReaderTests-153736182 None] Lock "cinder-quobyte-8396eb69-3fa4-424f-8b1c-03a5d67452ad" acquired by "delete_volume" :: waited 0.019s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:34:27 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[8961da36-c7db-4067-a1e7-bbe5deeffc6b]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:34:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0615df9a-beb2-4be2-a5b7-8df5e292fb60 tempest-ProjectReaderTests-153736182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8396eb69-3fa4-424f-8b1c-03a5d67452ad {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:27 devstack sudo[100190]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-da645579-5ddd-455b-9292-fab96064cc60 tempest-VolumesExtendTest-1210615344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6a92f957-5fb2-4713-88ed-fadc079b6225" returned: 0 in 0.365s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:27 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-da645579-5ddd-455b-9292-fab96064cc60 tempest-VolumesExtendTest-1210615344 None] Lock "cinder-quobyte-6a92f957-5fb2-4713-88ed-fadc079b6225" released by "delete_volume" :: held 0.884s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:34:27 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-da645579-5ddd-455b-9292-fab96064cc60 tempest-VolumesExtendTest-1210615344 None] Created reservations ['10fd0156-b56a-4ddc-ab6f-98730f47189e', 'f7572ddb-df08-4b7c-be1e-f3c7a31402b0', '6b47aa19-9f17-40e9-b296-da949a95c0a2', 'b3b095f6-04ae-4bc0-9789-45f54b2c0e29'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:34:27 devstack sudo[100193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8396eb69-3fa4-424f-8b1c-03a5d67452ad
Jul 14 16:34:27 devstack sudo[100193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:27 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-168d4b14-10ae-4a91-b306-255ef02f7133 tempest-VolumesSnapshotNegativeTestJSON-292537649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:34:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-168d4b14-10ae-4a91-b306-255ef02f7133 tempest-VolumesSnapshotNegativeTestJSON-292537649 None] Flow 'volume_create_manager' (624da309-bda4-4811-9c32-1f8aa1d8e034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:34:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-168d4b14-10ae-4a91-b306-255ef02f7133 tempest-VolumesSnapshotNegativeTestJSON-292537649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63c314e5-eab4-48de-9508-99f7af136ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:34:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-168d4b14-10ae-4a91-b306-255ef02f7133 tempest-VolumesSnapshotNegativeTestJSON-292537649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63c314e5-eab4-48de-9508-99f7af136ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:34:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-376298186',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79545fa6-c631-4a7e-a60c-8ce6bd4b64f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e83e6d2ffc3d4053a2a36e71cffb5fa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:34:28Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:34:28Z,use_quota=True,user_id='8f3bb12120ea488198c60ed3244fd7a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:34:28 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-168d4b14-10ae-4a91-b306-255ef02f7133 tempest-VolumesSnapshotNegativeTestJSON-292537649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9733927f-07d9-4c86-b184-4ef690b34f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:34:28 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-168d4b14-10ae-4a91-b306-255ef02f7133 tempest-VolumesSnapshotNegativeTestJSON-292537649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9733927f-07d9-4c86-b184-4ef690b34f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:34:28 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-168d4b14-10ae-4a91-b306-255ef02f7133 tempest-VolumesSnapshotNegativeTestJSON-292537649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccb77f18-bd8f-4f7e-a1ac-94ea9c050ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:34:28 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-168d4b14-10ae-4a91-b306-255ef02f7133 tempest-VolumesSnapshotNegativeTestJSON-292537649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccb77f18-bd8f-4f7e-a1ac-94ea9c050ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79545fa6-c631-4a7e-a60c-8ce6bd4b64f5', 'volume_name': 'volume-79545fa6-c631-4a7e-a60c-8ce6bd4b64f5', 'volume_size': 2}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:34:28 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-168d4b14-10ae-4a91-b306-255ef02f7133 tempest-VolumesSnapshotNegativeTestJSON-292537649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d31f60d-5c57-4cf1-a51d-bc1e57648436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:34:28 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-168d4b14-10ae-4a91-b306-255ef02f7133 tempest-VolumesSnapshotNegativeTestJSON-292537649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d31f60d-5c57-4cf1-a51d-bc1e57648436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:34:28 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-168d4b14-10ae-4a91-b306-255ef02f7133 tempest-VolumesSnapshotNegativeTestJSON-292537649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a95d5b25-d687-4b48-9780-70b28988cf8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:34:28 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-168d4b14-10ae-4a91-b306-255ef02f7133 tempest-VolumesSnapshotNegativeTestJSON-292537649 None] Volume 79545fa6-c631-4a7e-a60c-8ce6bd4b64f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79545fa6-c631-4a7e-a60c-8ce6bd4b64f5', 'volume_size': 2}
Jul 14 16:34:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-168d4b14-10ae-4a91-b306-255ef02f7133 tempest-VolumesSnapshotNegativeTestJSON-292537649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:34:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-168d4b14-10ae-4a91-b306-255ef02f7133 tempest-VolumesSnapshotNegativeTestJSON-292537649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:34:28 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-168d4b14-10ae-4a91-b306-255ef02f7133 tempest-VolumesSnapshotNegativeTestJSON-292537649 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:34:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-376298186',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79545fa6-c631-4a7e-a60c-8ce6bd4b64f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e83e6d2ffc3d4053a2a36e71cffb5fa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:34:28Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:34:28Z,use_quota=True,user_id='8f3bb12120ea488198c60ed3244fd7a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:34:28 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-168d4b14-10ae-4a91-b306-255ef02f7133 tempest-VolumesSnapshotNegativeTestJSON-292537649 None] Creating volume 79545fa6-c631-4a7e-a60c-8ce6bd4b64f5 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:34:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-168d4b14-10ae-4a91-b306-255ef02f7133 tempest-VolumesSnapshotNegativeTestJSON-292537649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:34:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-168d4b14-10ae-4a91-b306-255ef02f7133 tempest-VolumesSnapshotNegativeTestJSON-292537649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:34:28 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-168d4b14-10ae-4a91-b306-255ef02f7133 tempest-VolumesSnapshotNegativeTestJSON-292537649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:34:28 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-168d4b14-10ae-4a91-b306-255ef02f7133 tempest-VolumesSnapshotNegativeTestJSON-292537649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:34:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-168d4b14-10ae-4a91-b306-255ef02f7133 tempest-VolumesSnapshotNegativeTestJSON-292537649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:34:28 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-168d4b14-10ae-4a91-b306-255ef02f7133 tempest-VolumesSnapshotNegativeTestJSON-292537649 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:34:28 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-168d4b14-10ae-4a91-b306-255ef02f7133 tempest-VolumesSnapshotNegativeTestJSON-292537649 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:34:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-168d4b14-10ae-4a91-b306-255ef02f7133 tempest-VolumesSnapshotNegativeTestJSON-292537649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-79545fa6-c631-4a7e-a60c-8ce6bd4b64f5 2147483648 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:28 devstack sudo[100195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-79545fa6-c631-4a7e-a60c-8ce6bd4b64f5 2147483648
Jul 14 16:34:28 devstack sudo[100195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-da645579-5ddd-455b-9292-fab96064cc60 tempest-VolumesExtendTest-1210615344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:34:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-da645579-5ddd-455b-9292-fab96064cc60 tempest-VolumesExtendTest-1210615344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:34:28 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-da645579-5ddd-455b-9292-fab96064cc60 tempest-VolumesExtendTest-1210615344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:34:28 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-da645579-5ddd-455b-9292-fab96064cc60 tempest-VolumesExtendTest-1210615344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:34:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-da645579-5ddd-455b-9292-fab96064cc60 tempest-VolumesExtendTest-1210615344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:34:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-da645579-5ddd-455b-9292-fab96064cc60 tempest-VolumesExtendTest-1210615344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:28 devstack sudo[100197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:34:28 devstack sudo[100197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0615df9a-beb2-4be2-a5b7-8df5e292fb60 tempest-ProjectReaderTests-153736182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8396eb69-3fa4-424f-8b1c-03a5d67452ad" returned: 0 in 0.602s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0615df9a-beb2-4be2-a5b7-8df5e292fb60 tempest-ProjectReaderTests-153736182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8396eb69-3fa4-424f-8b1c-03a5d67452ad {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:28 devstack sudo[100193]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:28 devstack sudo[100212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8396eb69-3fa4-424f-8b1c-03a5d67452ad
Jul 14 16:34:28 devstack sudo[100212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:28 devstack sudo[100197]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-da645579-5ddd-455b-9292-fab96064cc60 tempest-VolumesExtendTest-1210615344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.469s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:28 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-da645579-5ddd-455b-9292-fab96064cc60 tempest-VolumesExtendTest-1210615344 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:34:28 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-da645579-5ddd-455b-9292-fab96064cc60 tempest-VolumesExtendTest-1210615344 None] Deleted volume successfully.
Jul 14 16:34:28 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-da645579-5ddd-455b-9292-fab96064cc60 tempest-VolumesExtendTest-1210615344 None] Lock "cinder-6a92f957-5fb2-4713-88ed-fadc079b6225-delete_volume" released by "delete_volume" :: held 1.810s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:34:28 devstack sudo[100212]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0615df9a-beb2-4be2-a5b7-8df5e292fb60 tempest-ProjectReaderTests-153736182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8396eb69-3fa4-424f-8b1c-03a5d67452ad" returned: 0 in 0.446s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:28 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0615df9a-beb2-4be2-a5b7-8df5e292fb60 tempest-ProjectReaderTests-153736182 None] Lock "cinder-quobyte-8396eb69-3fa4-424f-8b1c-03a5d67452ad" released by "delete_volume" :: held 1.108s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:34:28 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-0615df9a-beb2-4be2-a5b7-8df5e292fb60 tempest-ProjectReaderTests-153736182 None] Created reservations ['72c5dd3c-ed38-48c3-8b08-feb376297cac', 'ac708f31-8b3b-4318-baa2-cb0bf54df889', '4ef33e6f-1aac-419e-967e-ec5f559d7aa1', 'd36bfd37-b77a-4819-9869-f1b120fce8d0'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:34:28 devstack sudo[100195]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-168d4b14-10ae-4a91-b306-255ef02f7133 tempest-VolumesSnapshotNegativeTestJSON-292537649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-79545fa6-c631-4a7e-a60c-8ce6bd4b64f5 2147483648" returned: 0 in 0.911s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0615df9a-beb2-4be2-a5b7-8df5e292fb60 tempest-ProjectReaderTests-153736182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:34:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0615df9a-beb2-4be2-a5b7-8df5e292fb60 tempest-ProjectReaderTests-153736182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:34:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0615df9a-beb2-4be2-a5b7-8df5e292fb60 tempest-ProjectReaderTests-153736182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:34:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0615df9a-beb2-4be2-a5b7-8df5e292fb60 tempest-ProjectReaderTests-153736182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:34:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0615df9a-beb2-4be2-a5b7-8df5e292fb60 tempest-ProjectReaderTests-153736182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:34:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0615df9a-beb2-4be2-a5b7-8df5e292fb60 tempest-ProjectReaderTests-153736182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-168d4b14-10ae-4a91-b306-255ef02f7133 tempest-VolumesSnapshotNegativeTestJSON-292537649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-79545fa6-c631-4a7e-a60c-8ce6bd4b64f5 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:29 devstack sudo[100231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:34:29 devstack sudo[100231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:29 devstack sudo[100232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-79545fa6-c631-4a7e-a60c-8ce6bd4b64f5
Jul 14 16:34:29 devstack sudo[100232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:29 devstack sudo[100232]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-168d4b14-10ae-4a91-b306-255ef02f7133 tempest-VolumesSnapshotNegativeTestJSON-292537649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-79545fa6-c631-4a7e-a60c-8ce6bd4b64f5" returned: 0 in 0.323s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-168d4b14-10ae-4a91-b306-255ef02f7133 tempest-VolumesSnapshotNegativeTestJSON-292537649 None] <== create_volume: return (1315ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:34:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-168d4b14-10ae-4a91-b306-255ef02f7133 tempest-VolumesSnapshotNegativeTestJSON-292537649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.317s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:34:29 devstack sudo[100231]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0615df9a-beb2-4be2-a5b7-8df5e292fb60 tempest-ProjectReaderTests-153736182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.365s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:29 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-0615df9a-beb2-4be2-a5b7-8df5e292fb60 tempest-ProjectReaderTests-153736182 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:34:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-168d4b14-10ae-4a91-b306-255ef02f7133 tempest-VolumesSnapshotNegativeTestJSON-292537649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a95d5b25-d687-4b48-9780-70b28988cf8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79545fa6-c631-4a7e-a60c-8ce6bd4b64f5', 'volume_size': 2}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:34:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-168d4b14-10ae-4a91-b306-255ef02f7133 tempest-VolumesSnapshotNegativeTestJSON-292537649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2889a056-e7f8-492a-886e-1a0ad7a7fc87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:34:29 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-0615df9a-beb2-4be2-a5b7-8df5e292fb60 tempest-ProjectReaderTests-153736182 None] Deleted volume successfully.
Jul 14 16:34:29 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-168d4b14-10ae-4a91-b306-255ef02f7133 tempest-VolumesSnapshotNegativeTestJSON-292537649 None] Volume volume-79545fa6-c631-4a7e-a60c-8ce6bd4b64f5 (79545fa6-c631-4a7e-a60c-8ce6bd4b64f5): created successfully
Jul 14 16:34:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-168d4b14-10ae-4a91-b306-255ef02f7133 tempest-VolumesSnapshotNegativeTestJSON-292537649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2889a056-e7f8-492a-886e-1a0ad7a7fc87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:34:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-168d4b14-10ae-4a91-b306-255ef02f7133 tempest-VolumesSnapshotNegativeTestJSON-292537649 None] Flow 'volume_create_manager' (624da309-bda4-4811-9c32-1f8aa1d8e034) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:34:29 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0615df9a-beb2-4be2-a5b7-8df5e292fb60 tempest-ProjectReaderTests-153736182 None] Lock "cinder-8396eb69-3fa4-424f-8b1c-03a5d67452ad-delete_volume" released by "delete_volume" :: held 1.843s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:34:29 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-168d4b14-10ae-4a91-b306-255ef02f7133 tempest-VolumesSnapshotNegativeTestJSON-292537649 None] Created volume successfully.
Jul 14 16:34:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-689916a3-7ae0-4ca2-87ef-b933fd25899c tempest-VolumesSnapshotNegativeTestJSON-292537649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:34:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-689916a3-7ae0-4ca2-87ef-b933fd25899c tempest-VolumesSnapshotNegativeTestJSON-292537649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:34:30 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-689916a3-7ae0-4ca2-87ef-b933fd25899c tempest-VolumesSnapshotNegativeTestJSON-292537649 None] Creating offline snapshot 50df331e-c79e-4445-af2d-cbdefb75ac6c of volume 79545fa6-c631-4a7e-a60c-8ce6bd4b64f5 {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 16:34:30 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[6556b15e-c33b-44f8-b8c0-85cd3bf44535]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:34:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-689916a3-7ae0-4ca2-87ef-b933fd25899c tempest-VolumesSnapshotNegativeTestJSON-292537649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-79545fa6-c631-4a7e-a60c-8ce6bd4b64f5 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:30 devstack sudo[100241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-79545fa6-c631-4a7e-a60c-8ce6bd4b64f5
Jul 14 16:34:30 devstack sudo[100241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:30 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-65f5acb0-3e00-416d-b1fb-f6e6bc047a26 tempest-ProjectReaderTests-153736182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:34:30 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-65f5acb0-3e00-416d-b1fb-f6e6bc047a26 tempest-ProjectReaderTests-153736182 None] Flow 'volume_create_manager' (53ca3e58-28a3-45ba-80f0-b463187e4228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:34:30 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-65f5acb0-3e00-416d-b1fb-f6e6bc047a26 tempest-ProjectReaderTests-153736182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f16d01e-50db-4b3d-ac2e-2b10edf846be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:34:30 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-65f5acb0-3e00-416d-b1fb-f6e6bc047a26 tempest-ProjectReaderTests-153736182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f16d01e-50db-4b3d-ac2e-2b10edf846be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:34:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-846694622',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd4e0087-b20f-4783-b4fd-ac3d19392b6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e11ad755b044372830d0a7e456bf8c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:34:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:34:31Z,use_quota=True,user_id='1749f7fa929c4e69b69440c0082a037a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:34:30 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-65f5acb0-3e00-416d-b1fb-f6e6bc047a26 tempest-ProjectReaderTests-153736182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (680d2e36-600d-4834-8e4f-24983d03aa7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:34:30 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-65f5acb0-3e00-416d-b1fb-f6e6bc047a26 tempest-ProjectReaderTests-153736182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (680d2e36-600d-4834-8e4f-24983d03aa7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:34:30 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-65f5acb0-3e00-416d-b1fb-f6e6bc047a26 tempest-ProjectReaderTests-153736182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f93ecca-f30c-4265-bc63-0d2843ad93f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:34:30 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-65f5acb0-3e00-416d-b1fb-f6e6bc047a26 tempest-ProjectReaderTests-153736182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f93ecca-f30c-4265-bc63-0d2843ad93f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd4e0087-b20f-4783-b4fd-ac3d19392b6f', 'volume_name': 'volume-cd4e0087-b20f-4783-b4fd-ac3d19392b6f', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:34:30 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-65f5acb0-3e00-416d-b1fb-f6e6bc047a26 tempest-ProjectReaderTests-153736182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47b747bf-e4a1-4da3-b3fa-6764dad5f829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:34:30 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-65f5acb0-3e00-416d-b1fb-f6e6bc047a26 tempest-ProjectReaderTests-153736182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47b747bf-e4a1-4da3-b3fa-6764dad5f829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:34:30 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-65f5acb0-3e00-416d-b1fb-f6e6bc047a26 tempest-ProjectReaderTests-153736182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a78d1370-65f6-4d9a-8638-2e660a7c039b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:34:30 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-65f5acb0-3e00-416d-b1fb-f6e6bc047a26 tempest-ProjectReaderTests-153736182 None] Volume cd4e0087-b20f-4783-b4fd-ac3d19392b6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd4e0087-b20f-4783-b4fd-ac3d19392b6f', 'volume_size': 1}
Jul 14 16:34:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-65f5acb0-3e00-416d-b1fb-f6e6bc047a26 tempest-ProjectReaderTests-153736182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:34:30 devstack sudo[100241]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-689916a3-7ae0-4ca2-87ef-b933fd25899c tempest-VolumesSnapshotNegativeTestJSON-292537649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-79545fa6-c631-4a7e-a60c-8ce6bd4b64f5" returned: 0 in 0.513s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-689916a3-7ae0-4ca2-87ef-b933fd25899c tempest-VolumesSnapshotNegativeTestJSON-292537649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-79545fa6-c631-4a7e-a60c-8ce6bd4b64f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-79545fa6-c631-4a7e-a60c-8ce6bd4b64f5.50df331e-c79e-4445-af2d-cbdefb75ac6c 2G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:30 devstack sudo[100246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-79545fa6-c631-4a7e-a60c-8ce6bd4b64f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-79545fa6-c631-4a7e-a60c-8ce6bd4b64f5.50df331e-c79e-4445-af2d-cbdefb75ac6c 2G
Jul 14 16:34:30 devstack sudo[100246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:31 devstack sudo[100246]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-689916a3-7ae0-4ca2-87ef-b933fd25899c tempest-VolumesSnapshotNegativeTestJSON-292537649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-79545fa6-c631-4a7e-a60c-8ce6bd4b64f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-79545fa6-c631-4a7e-a60c-8ce6bd4b64f5.50df331e-c79e-4445-af2d-cbdefb75ac6c 2G" returned: 0 in 0.439s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-689916a3-7ae0-4ca2-87ef-b933fd25899c tempest-VolumesSnapshotNegativeTestJSON-292537649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79545fa6-c631-4a7e-a60c-8ce6bd4b64f5 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-79545fa6-c631-4a7e-a60c-8ce6bd4b64f5.50df331e-c79e-4445-af2d-cbdefb75ac6c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:31 devstack sudo[100252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79545fa6-c631-4a7e-a60c-8ce6bd4b64f5 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-79545fa6-c631-4a7e-a60c-8ce6bd4b64f5.50df331e-c79e-4445-af2d-cbdefb75ac6c
Jul 14 16:34:31 devstack sudo[100252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:31 devstack sudo[100252]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-689916a3-7ae0-4ca2-87ef-b933fd25899c tempest-VolumesSnapshotNegativeTestJSON-292537649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79545fa6-c631-4a7e-a60c-8ce6bd4b64f5 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-79545fa6-c631-4a7e-a60c-8ce6bd4b64f5.50df331e-c79e-4445-af2d-cbdefb75ac6c" returned: 0 in 0.296s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:31 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-689916a3-7ae0-4ca2-87ef-b933fd25899c tempest-VolumesSnapshotNegativeTestJSON-292537649 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-79545fa6-c631-4a7e-a60c-8ce6bd4b64f5.50df331e-c79e-4445-af2d-cbdefb75ac6c is being set with open permissions: ugo+rw
Jul 14 16:34:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-689916a3-7ae0-4ca2-87ef-b933fd25899c tempest-VolumesSnapshotNegativeTestJSON-292537649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-79545fa6-c631-4a7e-a60c-8ce6bd4b64f5.50df331e-c79e-4445-af2d-cbdefb75ac6c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:31 devstack sudo[100257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-79545fa6-c631-4a7e-a60c-8ce6bd4b64f5.50df331e-c79e-4445-af2d-cbdefb75ac6c
Jul 14 16:34:31 devstack sudo[100257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:31 devstack sudo[100257]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-689916a3-7ae0-4ca2-87ef-b933fd25899c tempest-VolumesSnapshotNegativeTestJSON-292537649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-79545fa6-c631-4a7e-a60c-8ce6bd4b64f5.50df331e-c79e-4445-af2d-cbdefb75ac6c" returned: 0 in 0.276s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-689916a3-7ae0-4ca2-87ef-b933fd25899c tempest-VolumesSnapshotNegativeTestJSON-292537649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-79545fa6-c631-4a7e-a60c-8ce6bd4b64f5.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:31 devstack sudo[100260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-79545fa6-c631-4a7e-a60c-8ce6bd4b64f5.info
Jul 14 16:34:31 devstack sudo[100260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:32 devstack sudo[100260]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-689916a3-7ae0-4ca2-87ef-b933fd25899c tempest-VolumesSnapshotNegativeTestJSON-292537649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-79545fa6-c631-4a7e-a60c-8ce6bd4b64f5.info" returned: 0 in 0.272s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:32 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-689916a3-7ae0-4ca2-87ef-b933fd25899c tempest-VolumesSnapshotNegativeTestJSON-292537649 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-79545fa6-c631-4a7e-a60c-8ce6bd4b64f5.info is being set with open permissions: ugo+rw
Jul 14 16:34:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-689916a3-7ae0-4ca2-87ef-b933fd25899c tempest-VolumesSnapshotNegativeTestJSON-292537649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-79545fa6-c631-4a7e-a60c-8ce6bd4b64f5.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:32 devstack sudo[100263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-79545fa6-c631-4a7e-a60c-8ce6bd4b64f5.info
Jul 14 16:34:32 devstack sudo[100263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:32 devstack sudo[100263]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-689916a3-7ae0-4ca2-87ef-b933fd25899c tempest-VolumesSnapshotNegativeTestJSON-292537649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-79545fa6-c631-4a7e-a60c-8ce6bd4b64f5.info" returned: 0 in 0.381s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-689916a3-7ae0-4ca2-87ef-b933fd25899c tempest-VolumesSnapshotNegativeTestJSON-292537649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.311s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:34:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-65f5acb0-3e00-416d-b1fb-f6e6bc047a26 tempest-ProjectReaderTests-153736182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.867s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:34:32 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-65f5acb0-3e00-416d-b1fb-f6e6bc047a26 tempest-ProjectReaderTests-153736182 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:34:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-846694622',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd4e0087-b20f-4783-b4fd-ac3d19392b6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e11ad755b044372830d0a7e456bf8c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:34:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:34:31Z,use_quota=True,user_id='1749f7fa929c4e69b69440c0082a037a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:34:32 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-65f5acb0-3e00-416d-b1fb-f6e6bc047a26 tempest-ProjectReaderTests-153736182 None] Creating volume cd4e0087-b20f-4783-b4fd-ac3d19392b6f {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:34:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-65f5acb0-3e00-416d-b1fb-f6e6bc047a26 tempest-ProjectReaderTests-153736182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:34:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-65f5acb0-3e00-416d-b1fb-f6e6bc047a26 tempest-ProjectReaderTests-153736182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:34:32 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-65f5acb0-3e00-416d-b1fb-f6e6bc047a26 tempest-ProjectReaderTests-153736182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:34:32 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-65f5acb0-3e00-416d-b1fb-f6e6bc047a26 tempest-ProjectReaderTests-153736182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:34:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-65f5acb0-3e00-416d-b1fb-f6e6bc047a26 tempest-ProjectReaderTests-153736182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:34:32 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-65f5acb0-3e00-416d-b1fb-f6e6bc047a26 tempest-ProjectReaderTests-153736182 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:34:32 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-65f5acb0-3e00-416d-b1fb-f6e6bc047a26 tempest-ProjectReaderTests-153736182 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:34:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-65f5acb0-3e00-416d-b1fb-f6e6bc047a26 tempest-ProjectReaderTests-153736182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cd4e0087-b20f-4783-b4fd-ac3d19392b6f 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:32 devstack sudo[100266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cd4e0087-b20f-4783-b4fd-ac3d19392b6f 1073741824
Jul 14 16:34:32 devstack sudo[100266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:32 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-689916a3-7ae0-4ca2-87ef-b933fd25899c tempest-VolumesSnapshotNegativeTestJSON-292537649 None] Create snapshot completed successfully
Jul 14 16:34:32 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-003b6787-b2a1-435c-998a-f79d98dc20d2 tempest-VolumesGetTest-670933563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:34:32 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-003b6787-b2a1-435c-998a-f79d98dc20d2 tempest-VolumesGetTest-670933563 None] Flow 'volume_create_manager' (164c9d47-adc2-4194-b1f3-7cd8b2e78c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:34:32 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-003b6787-b2a1-435c-998a-f79d98dc20d2 tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51b8f01f-c88c-453c-b9c2-7ee093bdcd2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:34:32 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-003b6787-b2a1-435c-998a-f79d98dc20d2 tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51b8f01f-c88c-453c-b9c2-7ee093bdcd2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:34:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1652809794',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeaa9ddf-7a4d-4e64-856f-3d934ec1678a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8c3355673ee24c43976f8dc0f9c36446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:34:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:34:33Z,use_quota=True,user_id='aa32643715c74d909a5b4725f5caada8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:34:32 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-003b6787-b2a1-435c-998a-f79d98dc20d2 tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10511738-170e-4a4e-9d1a-6d25b108ccc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:34:32 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-003b6787-b2a1-435c-998a-f79d98dc20d2 tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10511738-170e-4a4e-9d1a-6d25b108ccc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:34:32 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-003b6787-b2a1-435c-998a-f79d98dc20d2 tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4514b453-2952-40fc-9dcc-b8211926e203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:34:32 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-003b6787-b2a1-435c-998a-f79d98dc20d2 tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4514b453-2952-40fc-9dcc-b8211926e203) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aeaa9ddf-7a4d-4e64-856f-3d934ec1678a', 'volume_name': 'volume-aeaa9ddf-7a4d-4e64-856f-3d934ec1678a', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:34:32 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-003b6787-b2a1-435c-998a-f79d98dc20d2 tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2866e64f-d0dd-4385-b37d-6fc31420f1c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:34:32 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-003b6787-b2a1-435c-998a-f79d98dc20d2 tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2866e64f-d0dd-4385-b37d-6fc31420f1c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:34:32 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-003b6787-b2a1-435c-998a-f79d98dc20d2 tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6db4e17e-df32-4c41-a098-2e7043b9ecd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:34:32 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-003b6787-b2a1-435c-998a-f79d98dc20d2 tempest-VolumesGetTest-670933563 None] Volume aeaa9ddf-7a4d-4e64-856f-3d934ec1678a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aeaa9ddf-7a4d-4e64-856f-3d934ec1678a', 'volume_size': 1}
Jul 14 16:34:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-003b6787-b2a1-435c-998a-f79d98dc20d2 tempest-VolumesGetTest-670933563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:34:32 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-24ab9332-c93c-415f-951c-08b2f821f156 tempest-TestServerVolumeAttachmentScenario-1040687344 None] Acquiring lock "cinder-f2d2c24b-42cf-48ed-8f78-62572d105604-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:34:32 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-24ab9332-c93c-415f-951c-08b2f821f156 tempest-TestServerVolumeAttachmentScenario-1040687344 None] Lock "cinder-f2d2c24b-42cf-48ed-8f78-62572d105604-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:34:33 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-24ab9332-c93c-415f-951c-08b2f821f156 tempest-TestServerVolumeAttachmentScenario-1040687344 None] Acquiring lock "cinder-quobyte-f2d2c24b-42cf-48ed-8f78-62572d105604" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:34:33 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-24ab9332-c93c-415f-951c-08b2f821f156 tempest-TestServerVolumeAttachmentScenario-1040687344 None] Lock "cinder-quobyte-f2d2c24b-42cf-48ed-8f78-62572d105604" acquired by "delete_volume" :: waited 0.020s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:34:33 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdaaa6e6-c590-4b6a-81f3-1f77ab673db9]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:34:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-24ab9332-c93c-415f-951c-08b2f821f156 tempest-TestServerVolumeAttachmentScenario-1040687344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f2d2c24b-42cf-48ed-8f78-62572d105604 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:33 devstack sudo[100266]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-65f5acb0-3e00-416d-b1fb-f6e6bc047a26 tempest-ProjectReaderTests-153736182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cd4e0087-b20f-4783-b4fd-ac3d19392b6f 1073741824" returned: 0 in 0.500s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-65f5acb0-3e00-416d-b1fb-f6e6bc047a26 tempest-ProjectReaderTests-153736182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cd4e0087-b20f-4783-b4fd-ac3d19392b6f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:33 devstack sudo[100273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cd4e0087-b20f-4783-b4fd-ac3d19392b6f
Jul 14 16:34:33 devstack sudo[100273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:33 devstack sudo[100272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f2d2c24b-42cf-48ed-8f78-62572d105604
Jul 14 16:34:33 devstack sudo[100272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:33 devstack sudo[100273]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-65f5acb0-3e00-416d-b1fb-f6e6bc047a26 tempest-ProjectReaderTests-153736182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cd4e0087-b20f-4783-b4fd-ac3d19392b6f" returned: 0 in 0.257s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:33 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-65f5acb0-3e00-416d-b1fb-f6e6bc047a26 tempest-ProjectReaderTests-153736182 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:34:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-65f5acb0-3e00-416d-b1fb-f6e6bc047a26 tempest-ProjectReaderTests-153736182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:34:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-003b6787-b2a1-435c-998a-f79d98dc20d2 tempest-VolumesGetTest-670933563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.646s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:34:33 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-003b6787-b2a1-435c-998a-f79d98dc20d2 tempest-VolumesGetTest-670933563 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:34:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1652809794',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeaa9ddf-7a4d-4e64-856f-3d934ec1678a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8c3355673ee24c43976f8dc0f9c36446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:34:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:34:33Z,use_quota=True,user_id='aa32643715c74d909a5b4725f5caada8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:34:33 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-003b6787-b2a1-435c-998a-f79d98dc20d2 tempest-VolumesGetTest-670933563 None] Creating volume aeaa9ddf-7a4d-4e64-856f-3d934ec1678a {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:34:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-003b6787-b2a1-435c-998a-f79d98dc20d2 tempest-VolumesGetTest-670933563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:34:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-003b6787-b2a1-435c-998a-f79d98dc20d2 tempest-VolumesGetTest-670933563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:34:33 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-003b6787-b2a1-435c-998a-f79d98dc20d2 tempest-VolumesGetTest-670933563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:34:33 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-003b6787-b2a1-435c-998a-f79d98dc20d2 tempest-VolumesGetTest-670933563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:34:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-003b6787-b2a1-435c-998a-f79d98dc20d2 tempest-VolumesGetTest-670933563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:34:33 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-003b6787-b2a1-435c-998a-f79d98dc20d2 tempest-VolumesGetTest-670933563 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:34:33 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-003b6787-b2a1-435c-998a-f79d98dc20d2 tempest-VolumesGetTest-670933563 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:34:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-003b6787-b2a1-435c-998a-f79d98dc20d2 tempest-VolumesGetTest-670933563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-aeaa9ddf-7a4d-4e64-856f-3d934ec1678a 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:33 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-65f5acb0-3e00-416d-b1fb-f6e6bc047a26 tempest-ProjectReaderTests-153736182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a78d1370-65f6-4d9a-8638-2e660a7c039b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd4e0087-b20f-4783-b4fd-ac3d19392b6f', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:34:33 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-65f5acb0-3e00-416d-b1fb-f6e6bc047a26 tempest-ProjectReaderTests-153736182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac834076-16bf-4bbc-8f06-68aa7f0a7590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:34:33 devstack sudo[100280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-aeaa9ddf-7a4d-4e64-856f-3d934ec1678a 1073741824
Jul 14 16:34:33 devstack sudo[100280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:33 devstack sudo[100272]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-24ab9332-c93c-415f-951c-08b2f821f156 tempest-TestServerVolumeAttachmentScenario-1040687344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f2d2c24b-42cf-48ed-8f78-62572d105604" returned: 0 in 0.400s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-24ab9332-c93c-415f-951c-08b2f821f156 tempest-TestServerVolumeAttachmentScenario-1040687344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f2d2c24b-42cf-48ed-8f78-62572d105604 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:33 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-65f5acb0-3e00-416d-b1fb-f6e6bc047a26 tempest-ProjectReaderTests-153736182 None] Volume volume-cd4e0087-b20f-4783-b4fd-ac3d19392b6f (cd4e0087-b20f-4783-b4fd-ac3d19392b6f): created successfully
Jul 14 16:34:33 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-65f5acb0-3e00-416d-b1fb-f6e6bc047a26 tempest-ProjectReaderTests-153736182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac834076-16bf-4bbc-8f06-68aa7f0a7590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:34:33 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-65f5acb0-3e00-416d-b1fb-f6e6bc047a26 tempest-ProjectReaderTests-153736182 None] Flow 'volume_create_manager' (53ca3e58-28a3-45ba-80f0-b463187e4228) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:34:33 devstack sudo[100282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f2d2c24b-42cf-48ed-8f78-62572d105604
Jul 14 16:34:33 devstack sudo[100282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:33 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-65f5acb0-3e00-416d-b1fb-f6e6bc047a26 tempest-ProjectReaderTests-153736182 None] Created volume successfully.
Jul 14 16:34:33 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-30532e1d-02ea-450c-962b-7e3a94fcdfa3 tempest-VolumesSnapshotNegativeTestJSON-292537649 None] Acquiring lock "cinder-50df331e-c79e-4445-af2d-cbdefb75ac6c-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:34:33 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-30532e1d-02ea-450c-962b-7e3a94fcdfa3 tempest-VolumesSnapshotNegativeTestJSON-292537649 None] Lock "cinder-50df331e-c79e-4445-af2d-cbdefb75ac6c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:34:33 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-30532e1d-02ea-450c-962b-7e3a94fcdfa3 tempest-VolumesSnapshotNegativeTestJSON-292537649 None] Acquiring lock "cinder-quobyte-79545fa6-c631-4a7e-a60c-8ce6bd4b64f5" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:34:33 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-30532e1d-02ea-450c-962b-7e3a94fcdfa3 tempest-VolumesSnapshotNegativeTestJSON-292537649 None] Lock "cinder-quobyte-79545fa6-c631-4a7e-a60c-8ce6bd4b64f5" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:34:33 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-30532e1d-02ea-450c-962b-7e3a94fcdfa3 tempest-VolumesSnapshotNegativeTestJSON-292537649 None] Acquiring lock "cinder-quobyte-50df331e-c79e-4445-af2d-cbdefb75ac6c" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:34:33 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-30532e1d-02ea-450c-962b-7e3a94fcdfa3 tempest-VolumesSnapshotNegativeTestJSON-292537649 None] Lock "cinder-quobyte-50df331e-c79e-4445-af2d-cbdefb75ac6c" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:34:33 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-30532e1d-02ea-450c-962b-7e3a94fcdfa3 tempest-VolumesSnapshotNegativeTestJSON-292537649 None] Deleting offline snapshot 50df331e-c79e-4445-af2d-cbdefb75ac6c of volume 79545fa6-c631-4a7e-a60c-8ce6bd4b64f5 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 16:34:33 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-30532e1d-02ea-450c-962b-7e3a94fcdfa3 tempest-VolumesSnapshotNegativeTestJSON-292537649 None] snapshot_file for this snap is: volume-79545fa6-c631-4a7e-a60c-8ce6bd4b64f5.50df331e-c79e-4445-af2d-cbdefb75ac6c {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 16:34:33 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e00129-a410-4b13-b296-d0e0de0051a5]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:34:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-30532e1d-02ea-450c-962b-7e3a94fcdfa3 tempest-VolumesSnapshotNegativeTestJSON-292537649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-79545fa6-c631-4a7e-a60c-8ce6bd4b64f5.50df331e-c79e-4445-af2d-cbdefb75ac6c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:33 devstack sudo[100284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-79545fa6-c631-4a7e-a60c-8ce6bd4b64f5.50df331e-c79e-4445-af2d-cbdefb75ac6c
Jul 14 16:34:33 devstack sudo[100284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:33 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6bafcf1b-8111-43d2-937b-3e3cfc897cf2 tempest-ProjectReaderTests-153736182 None] Acquiring lock "cinder-cd4e0087-b20f-4783-b4fd-ac3d19392b6f-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:34:33 devstack sudo[100282]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-24ab9332-c93c-415f-951c-08b2f821f156 tempest-TestServerVolumeAttachmentScenario-1040687344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f2d2c24b-42cf-48ed-8f78-62572d105604" returned: 0 in 0.340s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:33 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6bafcf1b-8111-43d2-937b-3e3cfc897cf2 tempest-ProjectReaderTests-153736182 None] Lock "cinder-cd4e0087-b20f-4783-b4fd-ac3d19392b6f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:34:33 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-24ab9332-c93c-415f-951c-08b2f821f156 tempest-TestServerVolumeAttachmentScenario-1040687344 None] Lock "cinder-quobyte-f2d2c24b-42cf-48ed-8f78-62572d105604" released by "delete_volume" :: held 0.787s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:34:33 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6bafcf1b-8111-43d2-937b-3e3cfc897cf2 tempest-ProjectReaderTests-153736182 None] Acquiring lock "cinder-quobyte-cd4e0087-b20f-4783-b4fd-ac3d19392b6f" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:34:33 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6bafcf1b-8111-43d2-937b-3e3cfc897cf2 tempest-ProjectReaderTests-153736182 None] Lock "cinder-quobyte-cd4e0087-b20f-4783-b4fd-ac3d19392b6f" acquired by "delete_volume" :: waited 0.019s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:34:33 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[16508743-3539-4780-a70f-e8b9eeac0708]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:34:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6bafcf1b-8111-43d2-937b-3e3cfc897cf2 tempest-ProjectReaderTests-153736182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cd4e0087-b20f-4783-b4fd-ac3d19392b6f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:33 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-24ab9332-c93c-415f-951c-08b2f821f156 tempest-TestServerVolumeAttachmentScenario-1040687344 None] Created reservations ['88382b9e-f209-4bf8-a417-dae7585c9073', '952d5f27-0ed2-401a-83a2-693062a3e65b', '42626cec-469e-449f-8ac7-0a9a76a4eb53', 'd71c7929-77a0-44c3-af8b-c4b2c0357c6f'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:34:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-24ab9332-c93c-415f-951c-08b2f821f156 tempest-TestServerVolumeAttachmentScenario-1040687344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:34:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-24ab9332-c93c-415f-951c-08b2f821f156 tempest-TestServerVolumeAttachmentScenario-1040687344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:34:34 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-24ab9332-c93c-415f-951c-08b2f821f156 tempest-TestServerVolumeAttachmentScenario-1040687344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:34:34 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-24ab9332-c93c-415f-951c-08b2f821f156 tempest-TestServerVolumeAttachmentScenario-1040687344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:34:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-24ab9332-c93c-415f-951c-08b2f821f156 tempest-TestServerVolumeAttachmentScenario-1040687344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:34:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-24ab9332-c93c-415f-951c-08b2f821f156 tempest-TestServerVolumeAttachmentScenario-1040687344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:34 devstack sudo[100292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cd4e0087-b20f-4783-b4fd-ac3d19392b6f
Jul 14 16:34:34 devstack sudo[100292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:34 devstack sudo[100295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:34:34 devstack sudo[100295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:34 devstack sudo[100280]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-003b6787-b2a1-435c-998a-f79d98dc20d2 tempest-VolumesGetTest-670933563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-aeaa9ddf-7a4d-4e64-856f-3d934ec1678a 1073741824" returned: 0 in 0.662s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-003b6787-b2a1-435c-998a-f79d98dc20d2 tempest-VolumesGetTest-670933563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-aeaa9ddf-7a4d-4e64-856f-3d934ec1678a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:34 devstack sudo[100300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-aeaa9ddf-7a4d-4e64-856f-3d934ec1678a
Jul 14 16:34:34 devstack sudo[100300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:34 devstack sudo[100284]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-30532e1d-02ea-450c-962b-7e3a94fcdfa3 tempest-VolumesSnapshotNegativeTestJSON-292537649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-79545fa6-c631-4a7e-a60c-8ce6bd4b64f5.50df331e-c79e-4445-af2d-cbdefb75ac6c" returned: 0 in 0.534s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:34 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-30532e1d-02ea-450c-962b-7e3a94fcdfa3 tempest-VolumesSnapshotNegativeTestJSON-292537649 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79545fa6-c631-4a7e-a60c-8ce6bd4b64f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 16:34:34 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d353fc62-c16f-4e3d-9d0b-7c6af3e2aeab tempest-TestServerVolumeAttachmentScenario-1040687344 None] Acquiring lock "cinder-4a247759-154f-4a91-9c77-93149a217448-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:34:34 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[166e84c5-0a0f-4a5c-9e3d-8f5608e034ee]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:34:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-30532e1d-02ea-450c-962b-7e3a94fcdfa3 tempest-VolumesSnapshotNegativeTestJSON-292537649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-79545fa6-c631-4a7e-a60c-8ce6bd4b64f5 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:34 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d353fc62-c16f-4e3d-9d0b-7c6af3e2aeab tempest-TestServerVolumeAttachmentScenario-1040687344 None] Lock "cinder-4a247759-154f-4a91-9c77-93149a217448-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:34:34 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d353fc62-c16f-4e3d-9d0b-7c6af3e2aeab tempest-TestServerVolumeAttachmentScenario-1040687344 None] Acquiring lock "cinder-quobyte-4a247759-154f-4a91-9c77-93149a217448" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:34:34 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d353fc62-c16f-4e3d-9d0b-7c6af3e2aeab tempest-TestServerVolumeAttachmentScenario-1040687344 None] Lock "cinder-quobyte-4a247759-154f-4a91-9c77-93149a217448" acquired by "delete_volume" :: waited 0.022s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:34:34 devstack sudo[100292]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:34 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcfa98a1-a452-44d5-be48-46af3d437867]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:34:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d353fc62-c16f-4e3d-9d0b-7c6af3e2aeab tempest-TestServerVolumeAttachmentScenario-1040687344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4a247759-154f-4a91-9c77-93149a217448 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6bafcf1b-8111-43d2-937b-3e3cfc897cf2 tempest-ProjectReaderTests-153736182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cd4e0087-b20f-4783-b4fd-ac3d19392b6f" returned: 0 in 0.491s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6bafcf1b-8111-43d2-937b-3e3cfc897cf2 tempest-ProjectReaderTests-153736182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cd4e0087-b20f-4783-b4fd-ac3d19392b6f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:34 devstack sudo[100302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-79545fa6-c631-4a7e-a60c-8ce6bd4b64f5
Jul 14 16:34:34 devstack sudo[100302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:34 devstack sudo[100295]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-24ab9332-c93c-415f-951c-08b2f821f156 tempest-TestServerVolumeAttachmentScenario-1040687344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.395s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:34 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-24ab9332-c93c-415f-951c-08b2f821f156 tempest-TestServerVolumeAttachmentScenario-1040687344 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:34:34 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-24ab9332-c93c-415f-951c-08b2f821f156 tempest-TestServerVolumeAttachmentScenario-1040687344 None] Deleted volume successfully.
Jul 14 16:34:34 devstack sudo[100310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cd4e0087-b20f-4783-b4fd-ac3d19392b6f
Jul 14 16:34:34 devstack sudo[100310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:34 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-24ab9332-c93c-415f-951c-08b2f821f156 tempest-TestServerVolumeAttachmentScenario-1040687344 None] Lock "cinder-f2d2c24b-42cf-48ed-8f78-62572d105604-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:34:34 devstack sudo[100300]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-003b6787-b2a1-435c-998a-f79d98dc20d2 tempest-VolumesGetTest-670933563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-aeaa9ddf-7a4d-4e64-856f-3d934ec1678a" returned: 0 in 0.365s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:34 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-003b6787-b2a1-435c-998a-f79d98dc20d2 tempest-VolumesGetTest-670933563 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:34:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-003b6787-b2a1-435c-998a-f79d98dc20d2 tempest-VolumesGetTest-670933563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:34:34 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-003b6787-b2a1-435c-998a-f79d98dc20d2 tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6db4e17e-df32-4c41-a098-2e7043b9ecd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aeaa9ddf-7a4d-4e64-856f-3d934ec1678a', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:34:34 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-003b6787-b2a1-435c-998a-f79d98dc20d2 tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ef2c23c-f90d-45b1-935f-7350900cdccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:34:34 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-003b6787-b2a1-435c-998a-f79d98dc20d2 tempest-VolumesGetTest-670933563 None] Volume volume-aeaa9ddf-7a4d-4e64-856f-3d934ec1678a (aeaa9ddf-7a4d-4e64-856f-3d934ec1678a): created successfully
Jul 14 16:34:34 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-003b6787-b2a1-435c-998a-f79d98dc20d2 tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ef2c23c-f90d-45b1-935f-7350900cdccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:34:34 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-003b6787-b2a1-435c-998a-f79d98dc20d2 tempest-VolumesGetTest-670933563 None] Flow 'volume_create_manager' (164c9d47-adc2-4194-b1f3-7cd8b2e78c67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:34:34 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-003b6787-b2a1-435c-998a-f79d98dc20d2 tempest-VolumesGetTest-670933563 None] Created volume successfully.
Jul 14 16:34:34 devstack sudo[100308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4a247759-154f-4a91-9c77-93149a217448
Jul 14 16:34:34 devstack sudo[100308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:34 devstack sudo[100310]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:34 devstack sudo[100302]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6bafcf1b-8111-43d2-937b-3e3cfc897cf2 tempest-ProjectReaderTests-153736182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cd4e0087-b20f-4783-b4fd-ac3d19392b6f" returned: 0 in 0.303s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-30532e1d-02ea-450c-962b-7e3a94fcdfa3 tempest-VolumesSnapshotNegativeTestJSON-292537649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-79545fa6-c631-4a7e-a60c-8ce6bd4b64f5" returned: 0 in 0.495s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-30532e1d-02ea-450c-962b-7e3a94fcdfa3 tempest-VolumesSnapshotNegativeTestJSON-292537649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-79545fa6-c631-4a7e-a60c-8ce6bd4b64f5.50df331e-c79e-4445-af2d-cbdefb75ac6c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:34 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6bafcf1b-8111-43d2-937b-3e3cfc897cf2 tempest-ProjectReaderTests-153736182 None] Lock "cinder-quobyte-cd4e0087-b20f-4783-b4fd-ac3d19392b6f" released by "delete_volume" :: held 0.860s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:34:34 devstack sudo[100317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-79545fa6-c631-4a7e-a60c-8ce6bd4b64f5.50df331e-c79e-4445-af2d-cbdefb75ac6c
Jul 14 16:34:34 devstack sudo[100317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:34 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-6bafcf1b-8111-43d2-937b-3e3cfc897cf2 tempest-ProjectReaderTests-153736182 None] Created reservations ['50b32c3e-6b34-437c-8be7-138033316ff7', '60572c3c-0f6a-4109-b565-aa667b09b5a4', 'b38ebe53-5887-46d1-a755-414ed7406154', 'e7ed9129-35da-4592-93de-4548dd29ce4b'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:34:34 devstack sudo[100308]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d353fc62-c16f-4e3d-9d0b-7c6af3e2aeab tempest-TestServerVolumeAttachmentScenario-1040687344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4a247759-154f-4a91-9c77-93149a217448" returned: 0 in 0.505s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d353fc62-c16f-4e3d-9d0b-7c6af3e2aeab tempest-TestServerVolumeAttachmentScenario-1040687344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4a247759-154f-4a91-9c77-93149a217448 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:34 devstack sudo[100322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4a247759-154f-4a91-9c77-93149a217448
Jul 14 16:34:34 devstack sudo[100322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6bafcf1b-8111-43d2-937b-3e3cfc897cf2 tempest-ProjectReaderTests-153736182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:34:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6bafcf1b-8111-43d2-937b-3e3cfc897cf2 tempest-ProjectReaderTests-153736182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:34:34 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6bafcf1b-8111-43d2-937b-3e3cfc897cf2 tempest-ProjectReaderTests-153736182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:34:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6bafcf1b-8111-43d2-937b-3e3cfc897cf2 tempest-ProjectReaderTests-153736182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:34:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6bafcf1b-8111-43d2-937b-3e3cfc897cf2 tempest-ProjectReaderTests-153736182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:34:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6bafcf1b-8111-43d2-937b-3e3cfc897cf2 tempest-ProjectReaderTests-153736182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:35 devstack sudo[100325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:34:35 devstack sudo[100325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:35 devstack sudo[100317]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-30532e1d-02ea-450c-962b-7e3a94fcdfa3 tempest-VolumesSnapshotNegativeTestJSON-292537649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-79545fa6-c631-4a7e-a60c-8ce6bd4b64f5.50df331e-c79e-4445-af2d-cbdefb75ac6c" returned: 0 in 0.470s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-30532e1d-02ea-450c-962b-7e3a94fcdfa3 tempest-VolumesSnapshotNegativeTestJSON-292537649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-79545fa6-c631-4a7e-a60c-8ce6bd4b64f5.50df331e-c79e-4445-af2d-cbdefb75ac6c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:35 devstack sudo[100331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-79545fa6-c631-4a7e-a60c-8ce6bd4b64f5.50df331e-c79e-4445-af2d-cbdefb75ac6c
Jul 14 16:34:35 devstack sudo[100331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:35 devstack sudo[100322]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d353fc62-c16f-4e3d-9d0b-7c6af3e2aeab tempest-TestServerVolumeAttachmentScenario-1040687344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4a247759-154f-4a91-9c77-93149a217448" returned: 0 in 0.372s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:35 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d353fc62-c16f-4e3d-9d0b-7c6af3e2aeab tempest-TestServerVolumeAttachmentScenario-1040687344 None] Lock "cinder-quobyte-4a247759-154f-4a91-9c77-93149a217448" released by "delete_volume" :: held 0.929s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:34:35 devstack sudo[100325]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6bafcf1b-8111-43d2-937b-3e3cfc897cf2 tempest-ProjectReaderTests-153736182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.299s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:35 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-6bafcf1b-8111-43d2-937b-3e3cfc897cf2 tempest-ProjectReaderTests-153736182 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:34:35 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-6bafcf1b-8111-43d2-937b-3e3cfc897cf2 tempest-ProjectReaderTests-153736182 None] Deleted volume successfully.
Jul 14 16:34:35 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6bafcf1b-8111-43d2-937b-3e3cfc897cf2 tempest-ProjectReaderTests-153736182 None] Lock "cinder-cd4e0087-b20f-4783-b4fd-ac3d19392b6f-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:34:35 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-d353fc62-c16f-4e3d-9d0b-7c6af3e2aeab tempest-TestServerVolumeAttachmentScenario-1040687344 None] Created reservations ['ba28d39d-c8f2-43d1-8141-d7d928ef0433', 'cbfa65e9-886a-454c-8cf6-480f50abefe6', 'f93a39f8-49fa-4fe9-b9fa-e4d204b761bf', 'a166d9ec-834d-496c-ace3-b60ccfb97a18'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:34:35 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 16:34:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:34:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:34:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:34:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:34:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:34:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:35 devstack sudo[100335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:34:35 devstack sudo[100335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:35 devstack sudo[100331]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-30532e1d-02ea-450c-962b-7e3a94fcdfa3 tempest-VolumesSnapshotNegativeTestJSON-292537649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-79545fa6-c631-4a7e-a60c-8ce6bd4b64f5.50df331e-c79e-4445-af2d-cbdefb75ac6c" returned: 0 in 0.285s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d353fc62-c16f-4e3d-9d0b-7c6af3e2aeab tempest-TestServerVolumeAttachmentScenario-1040687344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:34:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d353fc62-c16f-4e3d-9d0b-7c6af3e2aeab tempest-TestServerVolumeAttachmentScenario-1040687344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:34:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d353fc62-c16f-4e3d-9d0b-7c6af3e2aeab tempest-TestServerVolumeAttachmentScenario-1040687344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:34:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d353fc62-c16f-4e3d-9d0b-7c6af3e2aeab tempest-TestServerVolumeAttachmentScenario-1040687344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:34:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d353fc62-c16f-4e3d-9d0b-7c6af3e2aeab tempest-TestServerVolumeAttachmentScenario-1040687344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:34:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d353fc62-c16f-4e3d-9d0b-7c6af3e2aeab tempest-TestServerVolumeAttachmentScenario-1040687344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:35 devstack sudo[100337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:34:35 devstack sudo[100337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:35 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-30532e1d-02ea-450c-962b-7e3a94fcdfa3 tempest-VolumesSnapshotNegativeTestJSON-292537649 None] Lock "cinder-quobyte-50df331e-c79e-4445-af2d-cbdefb75ac6c" released by "_delete_snapshot" :: held 1.959s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:34:35 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-30532e1d-02ea-450c-962b-7e3a94fcdfa3 tempest-VolumesSnapshotNegativeTestJSON-292537649 None] Lock "cinder-quobyte-79545fa6-c631-4a7e-a60c-8ce6bd4b64f5" released by "delete_snapshot" :: held 1.984s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:34:35 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-30532e1d-02ea-450c-962b-7e3a94fcdfa3 tempest-VolumesSnapshotNegativeTestJSON-292537649 None] Created reservations ['f6575e7f-ad38-442a-bdc6-53c241dcaa2a', '2a0a5c88-0f13-4d5e-b508-8f14c5b261d0', '10092140-3a3f-4437-b3e7-e41b5a47b15d', '6fde4aa3-35ae-4abf-9d14-78dfc2bb8259'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:34:35 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-0878ebe2-1af4-4eab-ba39-5c00565e17f1 tempest-VolumesGetTest-670933563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:34:35 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0878ebe2-1af4-4eab-ba39-5c00565e17f1 tempest-VolumesGetTest-670933563 None] Flow 'volume_create_manager' (e76502d1-3a7d-4ca0-bbd6-08f1acf9a5bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:34:35 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0878ebe2-1af4-4eab-ba39-5c00565e17f1 tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4da6ac33-8272-4dfa-9779-fa27b0e700fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:34:35 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-30532e1d-02ea-450c-962b-7e3a94fcdfa3 tempest-VolumesSnapshotNegativeTestJSON-292537649 None] Delete snapshot completed successfully.
Jul 14 16:34:35 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0878ebe2-1af4-4eab-ba39-5c00565e17f1 tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4da6ac33-8272-4dfa-9779-fa27b0e700fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:34:35Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1835603989',display_name='tempest-VolumesGetTest-Volume-753957181',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc887077-7dd8-4762-8bae-73457238ab65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c3355673ee24c43976f8dc0f9c36446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:34:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:34:36Z,use_quota=True,user_id='aa32643715c74d909a5b4725f5caada8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:34:35 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0878ebe2-1af4-4eab-ba39-5c00565e17f1 tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41707296-ca89-4ee4-80bc-a31c0712db67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:34:35 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0878ebe2-1af4-4eab-ba39-5c00565e17f1 tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41707296-ca89-4ee4-80bc-a31c0712db67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:34:35 devstack sudo[100335]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:35 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0878ebe2-1af4-4eab-ba39-5c00565e17f1 tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (790ee058-03e9-4255-81bf-8af7e4f532e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:34:35 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0878ebe2-1af4-4eab-ba39-5c00565e17f1 tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (790ee058-03e9-4255-81bf-8af7e4f532e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc887077-7dd8-4762-8bae-73457238ab65', 'volume_name': 'volume-dc887077-7dd8-4762-8bae-73457238ab65', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:34:35 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0878ebe2-1af4-4eab-ba39-5c00565e17f1 tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fe91e4d-5a37-46f2-a435-f7afd6f908f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:34:35 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0878ebe2-1af4-4eab-ba39-5c00565e17f1 tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fe91e4d-5a37-46f2-a435-f7afd6f908f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:34:35 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0878ebe2-1af4-4eab-ba39-5c00565e17f1 tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34fb57f9-13d7-4ad6-a3c3-cc5306a26ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:34:35 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-0878ebe2-1af4-4eab-ba39-5c00565e17f1 tempest-VolumesGetTest-670933563 None] Volume dc887077-7dd8-4762-8bae-73457238ab65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc887077-7dd8-4762-8bae-73457238ab65', 'volume_size': 1}
Jul 14 16:34:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0878ebe2-1af4-4eab-ba39-5c00565e17f1 tempest-VolumesGetTest-670933563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:34:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0878ebe2-1af4-4eab-ba39-5c00565e17f1 tempest-VolumesGetTest-670933563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:34:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0878ebe2-1af4-4eab-ba39-5c00565e17f1 tempest-VolumesGetTest-670933563 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:34:35Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1835603989',display_name='tempest-VolumesGetTest-Volume-753957181',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc887077-7dd8-4762-8bae-73457238ab65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c3355673ee24c43976f8dc0f9c36446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:34:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:34:36Z,use_quota=True,user_id='aa32643715c74d909a5b4725f5caada8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:34:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-0878ebe2-1af4-4eab-ba39-5c00565e17f1 tempest-VolumesGetTest-670933563 None] Creating volume dc887077-7dd8-4762-8bae-73457238ab65 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:34:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0878ebe2-1af4-4eab-ba39-5c00565e17f1 tempest-VolumesGetTest-670933563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:34:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0878ebe2-1af4-4eab-ba39-5c00565e17f1 tempest-VolumesGetTest-670933563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:34:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0878ebe2-1af4-4eab-ba39-5c00565e17f1 tempest-VolumesGetTest-670933563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:34:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0878ebe2-1af4-4eab-ba39-5c00565e17f1 tempest-VolumesGetTest-670933563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:34:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0878ebe2-1af4-4eab-ba39-5c00565e17f1 tempest-VolumesGetTest-670933563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:34:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0878ebe2-1af4-4eab-ba39-5c00565e17f1 tempest-VolumesGetTest-670933563 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:34:35 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-0878ebe2-1af4-4eab-ba39-5c00565e17f1 tempest-VolumesGetTest-670933563 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:34:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0878ebe2-1af4-4eab-ba39-5c00565e17f1 tempest-VolumesGetTest-670933563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-dc887077-7dd8-4762-8bae-73457238ab65 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:35 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-30532e1d-02ea-450c-962b-7e3a94fcdfa3 tempest-VolumesSnapshotNegativeTestJSON-292537649 None] Lock "cinder-50df331e-c79e-4445-af2d-cbdefb75ac6c-delete_snapshot" released by "delete_snapshot" :: held 2.301s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:34:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.450s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:35 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:34:35 devstack sudo[100337]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d353fc62-c16f-4e3d-9d0b-7c6af3e2aeab tempest-TestServerVolumeAttachmentScenario-1040687344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.373s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:35 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-d353fc62-c16f-4e3d-9d0b-7c6af3e2aeab tempest-TestServerVolumeAttachmentScenario-1040687344 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:34:35 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Running periodic task VolumeManager._thread_info {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 16:34:35 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] thread count: 28 {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 14 16:34:35 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] thread info: [<_MainThread(MainThread, started 128606490927232)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128606415432960)>, <Thread(Thread-3 (stat_writer), started daemon 128606378859328)>, <Thread(Rabbit-heartbeat, started daemon 128606379646144)>, <Thread(Thread-5 (_runner), started daemon 128606377685824)>, <Thread(Thread-7 (_runner), started daemon 128606377701888)>, <Thread(fd_logger, started daemon 128606377091392)>, <Thread(privsep_reader, started daemon 128606375782080)>, <Thread(tpool_thread_0, started daemon 128606365607616)>, <Thread(tpool_thread_1, started daemon 128606357214912)>, <Thread(tpool_thread_2, started daemon 128606348822208)>, <Thread(tpool_thread_3, started daemon 128606340413120)>, <Thread(tpool_thread_4, started daemon 128606332004032)>, <Thread(tpool_thread_5, started daemon 128606323594944)>, <Thread(tpool_thread_6, started daemon 128606315185856)>, <Thread(tpool_thread_7, started daemon 128606306776768)>, <Thread(tpool_thread_8, started daemon 128606298367680)>, <Thread(tpool_thread_9, started daemon 128606289958592)>, <Thread(tpool_thread_10, started daemon 128606281549504)>, <Thread(tpool_thread_11, started daemon 128606273140416)>, <Thread(tpool_thread_12, started daemon 128606264731328)>, <Thread(tpool_thread_13, started daemon 128606256322240)>, <Thread(tpool_thread_14, started daemon 128606247913152)>, <Thread(tpool_thread_15, started daemon 128606239504064)>, <Thread(tpool_thread_16, started daemon 128606231094976)>, <Thread(tpool_thread_17, started daemon 128606222685888)>, <Thread(tpool_thread_18, started daemon 128606214276800)>, <Thread(tpool_thread_19, started daemon 128606205867712)>] {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 14 16:34:35 devstack sudo[100341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-dc887077-7dd8-4762-8bae-73457238ab65 1073741824
Jul 14 16:34:35 devstack sudo[100341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:35 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-9390ec0c-edfb-4106-945a-16f5cb72da8c tempest-VolumesSnapshotNegativeTestJSON-292537649 None] Acquiring lock "cinder-79545fa6-c631-4a7e-a60c-8ce6bd4b64f5-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:34:35 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-d353fc62-c16f-4e3d-9d0b-7c6af3e2aeab tempest-TestServerVolumeAttachmentScenario-1040687344 None] Deleted volume successfully.
Jul 14 16:34:35 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-9390ec0c-edfb-4106-945a-16f5cb72da8c tempest-VolumesSnapshotNegativeTestJSON-292537649 None] Lock "cinder-79545fa6-c631-4a7e-a60c-8ce6bd4b64f5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:34:35 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d353fc62-c16f-4e3d-9d0b-7c6af3e2aeab tempest-TestServerVolumeAttachmentScenario-1040687344 None] Lock "cinder-4a247759-154f-4a91-9c77-93149a217448-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:34:35 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-9390ec0c-edfb-4106-945a-16f5cb72da8c tempest-VolumesSnapshotNegativeTestJSON-292537649 None] Acquiring lock "cinder-quobyte-79545fa6-c631-4a7e-a60c-8ce6bd4b64f5" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:34:35 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-9390ec0c-edfb-4106-945a-16f5cb72da8c tempest-VolumesSnapshotNegativeTestJSON-292537649 None] Lock "cinder-quobyte-79545fa6-c631-4a7e-a60c-8ce6bd4b64f5" acquired by "delete_volume" :: waited 0.020s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:34:36 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[8040d3dc-44aa-44d7-b543-908cc22e588f]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:34:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9390ec0c-edfb-4106-945a-16f5cb72da8c tempest-VolumesSnapshotNegativeTestJSON-292537649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-79545fa6-c631-4a7e-a60c-8ce6bd4b64f5 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:36 devstack sudo[100343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-79545fa6-c631-4a7e-a60c-8ce6bd4b64f5
Jul 14 16:34:36 devstack sudo[100343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:36 devstack sudo[100341]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0878ebe2-1af4-4eab-ba39-5c00565e17f1 tempest-VolumesGetTest-670933563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-dc887077-7dd8-4762-8bae-73457238ab65 1073741824" returned: 0 in 0.504s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0878ebe2-1af4-4eab-ba39-5c00565e17f1 tempest-VolumesGetTest-670933563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-dc887077-7dd8-4762-8bae-73457238ab65 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:36 devstack sudo[100354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-dc887077-7dd8-4762-8bae-73457238ab65
Jul 14 16:34:36 devstack sudo[100354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:36 devstack sudo[100343]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9390ec0c-edfb-4106-945a-16f5cb72da8c tempest-VolumesSnapshotNegativeTestJSON-292537649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-79545fa6-c631-4a7e-a60c-8ce6bd4b64f5" returned: 0 in 0.430s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9390ec0c-edfb-4106-945a-16f5cb72da8c tempest-VolumesSnapshotNegativeTestJSON-292537649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-79545fa6-c631-4a7e-a60c-8ce6bd4b64f5 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:36 devstack sudo[100356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-79545fa6-c631-4a7e-a60c-8ce6bd4b64f5
Jul 14 16:34:36 devstack sudo[100356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:36 devstack sudo[100354]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0878ebe2-1af4-4eab-ba39-5c00565e17f1 tempest-VolumesGetTest-670933563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-dc887077-7dd8-4762-8bae-73457238ab65" returned: 0 in 0.335s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:36 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0878ebe2-1af4-4eab-ba39-5c00565e17f1 tempest-VolumesGetTest-670933563 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:34:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0878ebe2-1af4-4eab-ba39-5c00565e17f1 tempest-VolumesGetTest-670933563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:34:36 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0878ebe2-1af4-4eab-ba39-5c00565e17f1 tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34fb57f9-13d7-4ad6-a3c3-cc5306a26ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc887077-7dd8-4762-8bae-73457238ab65', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:34:36 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0878ebe2-1af4-4eab-ba39-5c00565e17f1 tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ea2c997-035f-4c5d-970f-f19b70511338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:34:36 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-0878ebe2-1af4-4eab-ba39-5c00565e17f1 tempest-VolumesGetTest-670933563 None] Volume volume-dc887077-7dd8-4762-8bae-73457238ab65 (dc887077-7dd8-4762-8bae-73457238ab65): created successfully
Jul 14 16:34:36 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0878ebe2-1af4-4eab-ba39-5c00565e17f1 tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ea2c997-035f-4c5d-970f-f19b70511338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:34:36 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0878ebe2-1af4-4eab-ba39-5c00565e17f1 tempest-VolumesGetTest-670933563 None] Flow 'volume_create_manager' (e76502d1-3a7d-4ca0-bbd6-08f1acf9a5bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:34:36 devstack sudo[100356]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9390ec0c-edfb-4106-945a-16f5cb72da8c tempest-VolumesSnapshotNegativeTestJSON-292537649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-79545fa6-c631-4a7e-a60c-8ce6bd4b64f5" returned: 0 in 0.366s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:36 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-0878ebe2-1af4-4eab-ba39-5c00565e17f1 tempest-VolumesGetTest-670933563 None] Created volume successfully.
Jul 14 16:34:36 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-9390ec0c-edfb-4106-945a-16f5cb72da8c tempest-VolumesSnapshotNegativeTestJSON-292537649 None] Lock "cinder-quobyte-79545fa6-c631-4a7e-a60c-8ce6bd4b64f5" released by "delete_volume" :: held 0.882s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:34:36 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-9390ec0c-edfb-4106-945a-16f5cb72da8c tempest-VolumesSnapshotNegativeTestJSON-292537649 None] Created reservations ['79bb2cc4-d70e-4c51-89c2-4616acc10b57', '54ed2886-3afa-4ea6-aea5-2deed2fe853c', '2db68034-c904-4ff5-a713-ce00483aad2b', '5578a465-f2e7-4a99-a7e7-d3ee8838170d'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:34:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9390ec0c-edfb-4106-945a-16f5cb72da8c tempest-VolumesSnapshotNegativeTestJSON-292537649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:34:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9390ec0c-edfb-4106-945a-16f5cb72da8c tempest-VolumesSnapshotNegativeTestJSON-292537649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:34:36 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-9390ec0c-edfb-4106-945a-16f5cb72da8c tempest-VolumesSnapshotNegativeTestJSON-292537649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:34:37 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-9390ec0c-edfb-4106-945a-16f5cb72da8c tempest-VolumesSnapshotNegativeTestJSON-292537649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:34:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9390ec0c-edfb-4106-945a-16f5cb72da8c tempest-VolumesSnapshotNegativeTestJSON-292537649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:34:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9390ec0c-edfb-4106-945a-16f5cb72da8c tempest-VolumesSnapshotNegativeTestJSON-292537649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:37 devstack sudo[100360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:34:37 devstack sudo[100360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:37 devstack sudo[100360]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9390ec0c-edfb-4106-945a-16f5cb72da8c tempest-VolumesSnapshotNegativeTestJSON-292537649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.331s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:37 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-9390ec0c-edfb-4106-945a-16f5cb72da8c tempest-VolumesSnapshotNegativeTestJSON-292537649 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:34:37 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-9390ec0c-edfb-4106-945a-16f5cb72da8c tempest-VolumesSnapshotNegativeTestJSON-292537649 None] Deleted volume successfully.
Jul 14 16:34:37 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-9390ec0c-edfb-4106-945a-16f5cb72da8c tempest-VolumesSnapshotNegativeTestJSON-292537649 None] Lock "cinder-79545fa6-c631-4a7e-a60c-8ce6bd4b64f5-delete_volume" released by "delete_volume" :: held 1.471s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:34:38 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-40582bd7-5c3e-4f86-9b95-9d9f7d2147ed tempest-VolumesGetTest-670933563 None] Acquiring lock "cinder-dc887077-7dd8-4762-8bae-73457238ab65-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:34:38 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-40582bd7-5c3e-4f86-9b95-9d9f7d2147ed tempest-VolumesGetTest-670933563 None] Lock "cinder-dc887077-7dd8-4762-8bae-73457238ab65-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:34:38 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-40582bd7-5c3e-4f86-9b95-9d9f7d2147ed tempest-VolumesGetTest-670933563 None] Acquiring lock "cinder-quobyte-dc887077-7dd8-4762-8bae-73457238ab65" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:34:38 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-40582bd7-5c3e-4f86-9b95-9d9f7d2147ed tempest-VolumesGetTest-670933563 None] Lock "cinder-quobyte-dc887077-7dd8-4762-8bae-73457238ab65" acquired by "delete_volume" :: waited 0.022s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:34:38 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e283819-3f56-4215-9cf7-21dd63981257]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:34:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-40582bd7-5c3e-4f86-9b95-9d9f7d2147ed tempest-VolumesGetTest-670933563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-dc887077-7dd8-4762-8bae-73457238ab65 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:38 devstack sudo[100364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-dc887077-7dd8-4762-8bae-73457238ab65
Jul 14 16:34:38 devstack sudo[100364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:38 devstack sudo[100364]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-40582bd7-5c3e-4f86-9b95-9d9f7d2147ed tempest-VolumesGetTest-670933563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-dc887077-7dd8-4762-8bae-73457238ab65" returned: 0 in 0.505s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-40582bd7-5c3e-4f86-9b95-9d9f7d2147ed tempest-VolumesGetTest-670933563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-dc887077-7dd8-4762-8bae-73457238ab65 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:38 devstack sudo[100370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-dc887077-7dd8-4762-8bae-73457238ab65
Jul 14 16:34:38 devstack sudo[100370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:39 devstack sudo[100370]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-40582bd7-5c3e-4f86-9b95-9d9f7d2147ed tempest-VolumesGetTest-670933563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-dc887077-7dd8-4762-8bae-73457238ab65" returned: 0 in 0.307s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:39 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-40582bd7-5c3e-4f86-9b95-9d9f7d2147ed tempest-VolumesGetTest-670933563 None] Lock "cinder-quobyte-dc887077-7dd8-4762-8bae-73457238ab65" released by "delete_volume" :: held 0.883s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:34:39 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:SELECT=125,cinder:INSERT=48,cinder:UPDATE=156,cinder:DELETE=15 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 16:34:39 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:UPDATE=173,cinder:SELECT=128,cinder:INSERT=30,cinder:DELETE=10 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 16:34:39 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-40582bd7-5c3e-4f86-9b95-9d9f7d2147ed tempest-VolumesGetTest-670933563 None] Created reservations ['b86cddd4-949c-4c61-9e84-8e89b3c092b5', '91e8816c-1097-49a4-a663-260fe77718c8', '5f4057e7-276c-41d0-96ef-0e69c4963a48', '67472193-0e3f-4449-820c-72b0b6f83227'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:34:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-40582bd7-5c3e-4f86-9b95-9d9f7d2147ed tempest-VolumesGetTest-670933563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:34:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-40582bd7-5c3e-4f86-9b95-9d9f7d2147ed tempest-VolumesGetTest-670933563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:34:39 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-40582bd7-5c3e-4f86-9b95-9d9f7d2147ed tempest-VolumesGetTest-670933563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:34:39 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-40582bd7-5c3e-4f86-9b95-9d9f7d2147ed tempest-VolumesGetTest-670933563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:34:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-40582bd7-5c3e-4f86-9b95-9d9f7d2147ed tempest-VolumesGetTest-670933563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:34:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-40582bd7-5c3e-4f86-9b95-9d9f7d2147ed tempest-VolumesGetTest-670933563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:39 devstack sudo[100374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:34:39 devstack sudo[100374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:39 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-04ee1578-c95f-4fb3-9ed3-52e78ccea179 tempest-VolumesGetTest-670933563 None] Acquiring lock "cinder-aeaa9ddf-7a4d-4e64-856f-3d934ec1678a-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:34:39 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-04ee1578-c95f-4fb3-9ed3-52e78ccea179 tempest-VolumesGetTest-670933563 None] Lock "cinder-aeaa9ddf-7a4d-4e64-856f-3d934ec1678a-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:34:39 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-04ee1578-c95f-4fb3-9ed3-52e78ccea179 tempest-VolumesGetTest-670933563 None] Acquiring lock "cinder-quobyte-aeaa9ddf-7a4d-4e64-856f-3d934ec1678a" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:34:39 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-04ee1578-c95f-4fb3-9ed3-52e78ccea179 tempest-VolumesGetTest-670933563 None] Lock "cinder-quobyte-aeaa9ddf-7a4d-4e64-856f-3d934ec1678a" acquired by "delete_volume" :: waited 0.028s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:34:39 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a25463c-c656-407d-9c99-791fd4e2e5f6]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:34:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-04ee1578-c95f-4fb3-9ed3-52e78ccea179 tempest-VolumesGetTest-670933563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-aeaa9ddf-7a4d-4e64-856f-3d934ec1678a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:39 devstack sudo[100374]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-40582bd7-5c3e-4f86-9b95-9d9f7d2147ed tempest-VolumesGetTest-670933563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.375s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:39 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-40582bd7-5c3e-4f86-9b95-9d9f7d2147ed tempest-VolumesGetTest-670933563 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:34:39 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-40582bd7-5c3e-4f86-9b95-9d9f7d2147ed tempest-VolumesGetTest-670933563 None] Deleted volume successfully.
Jul 14 16:34:39 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-40582bd7-5c3e-4f86-9b95-9d9f7d2147ed tempest-VolumesGetTest-670933563 None] Lock "cinder-dc887077-7dd8-4762-8bae-73457238ab65-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:34:39 devstack sudo[100377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-aeaa9ddf-7a4d-4e64-856f-3d934ec1678a
Jul 14 16:34:39 devstack sudo[100377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:40 devstack sudo[100377]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-04ee1578-c95f-4fb3-9ed3-52e78ccea179 tempest-VolumesGetTest-670933563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-aeaa9ddf-7a4d-4e64-856f-3d934ec1678a" returned: 0 in 0.460s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-04ee1578-c95f-4fb3-9ed3-52e78ccea179 tempest-VolumesGetTest-670933563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-aeaa9ddf-7a4d-4e64-856f-3d934ec1678a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:40 devstack sudo[100382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-aeaa9ddf-7a4d-4e64-856f-3d934ec1678a
Jul 14 16:34:40 devstack sudo[100382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:40 devstack sudo[100382]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-04ee1578-c95f-4fb3-9ed3-52e78ccea179 tempest-VolumesGetTest-670933563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-aeaa9ddf-7a4d-4e64-856f-3d934ec1678a" returned: 0 in 0.321s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:40 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-04ee1578-c95f-4fb3-9ed3-52e78ccea179 tempest-VolumesGetTest-670933563 None] Lock "cinder-quobyte-aeaa9ddf-7a4d-4e64-856f-3d934ec1678a" released by "delete_volume" :: held 0.837s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:34:40 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-04ee1578-c95f-4fb3-9ed3-52e78ccea179 tempest-VolumesGetTest-670933563 None] Created reservations ['44c58a0f-4f1a-4197-acbe-784ef9300d7a', 'cb561a6a-f125-41da-af76-ad7f29188317', 'c9dcf5c9-4161-4084-b9a8-e4041899fa72', '7ee76cfb-b85f-48dd-9f16-e73b31744d90'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:34:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-04ee1578-c95f-4fb3-9ed3-52e78ccea179 tempest-VolumesGetTest-670933563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:34:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-04ee1578-c95f-4fb3-9ed3-52e78ccea179 tempest-VolumesGetTest-670933563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:34:40 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-04ee1578-c95f-4fb3-9ed3-52e78ccea179 tempest-VolumesGetTest-670933563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:34:40 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-04ee1578-c95f-4fb3-9ed3-52e78ccea179 tempest-VolumesGetTest-670933563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:34:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-04ee1578-c95f-4fb3-9ed3-52e78ccea179 tempest-VolumesGetTest-670933563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:34:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-04ee1578-c95f-4fb3-9ed3-52e78ccea179 tempest-VolumesGetTest-670933563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:40 devstack sudo[100385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:34:40 devstack sudo[100385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:40 devstack sudo[100385]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-04ee1578-c95f-4fb3-9ed3-52e78ccea179 tempest-VolumesGetTest-670933563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.292s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:40 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-04ee1578-c95f-4fb3-9ed3-52e78ccea179 tempest-VolumesGetTest-670933563 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:34:40 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-04ee1578-c95f-4fb3-9ed3-52e78ccea179 tempest-VolumesGetTest-670933563 None] Deleted volume successfully.
Jul 14 16:34:40 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-04ee1578-c95f-4fb3-9ed3-52e78ccea179 tempest-VolumesGetTest-670933563 None] Lock "cinder-aeaa9ddf-7a4d-4e64-856f-3d934ec1678a-delete_volume" released by "delete_volume" :: held 1.437s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:34:41 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-41354bd9-8390-4302-9e4f-0e7fa8273291 tempest-VolumesGetTest-670933563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:34:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-41354bd9-8390-4302-9e4f-0e7fa8273291 tempest-VolumesGetTest-670933563 None] Flow 'volume_create_manager' (f2dbb299-25d3-4707-9b53-59d288c9e1c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:34:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-41354bd9-8390-4302-9e4f-0e7fa8273291 tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65416859-f767-4866-95f7-b06922362fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:34:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-41354bd9-8390-4302-9e4f-0e7fa8273291 tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65416859-f767-4866-95f7-b06922362fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:34:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-573436998',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b3f468a-d344-4104-bfc9-d28fdee424fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c3355673ee24c43976f8dc0f9c36446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:34:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:34:41Z,use_quota=True,user_id='aa32643715c74d909a5b4725f5caada8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:34:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-41354bd9-8390-4302-9e4f-0e7fa8273291 tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2569f7f-d92d-4e90-a874-7bc08f7ea26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:34:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-41354bd9-8390-4302-9e4f-0e7fa8273291 tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2569f7f-d92d-4e90-a874-7bc08f7ea26c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:34:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-41354bd9-8390-4302-9e4f-0e7fa8273291 tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f3c6fbd-0bc9-44a4-8430-4c9af3fab3fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:34:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-41354bd9-8390-4302-9e4f-0e7fa8273291 tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f3c6fbd-0bc9-44a4-8430-4c9af3fab3fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b3f468a-d344-4104-bfc9-d28fdee424fd', 'volume_name': 'volume-9b3f468a-d344-4104-bfc9-d28fdee424fd', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:34:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-41354bd9-8390-4302-9e4f-0e7fa8273291 tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (096c5c01-e2e0-46d5-9f65-aedca3b0f6a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:34:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-41354bd9-8390-4302-9e4f-0e7fa8273291 tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (096c5c01-e2e0-46d5-9f65-aedca3b0f6a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:34:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-41354bd9-8390-4302-9e4f-0e7fa8273291 tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (486d2a7c-dbce-4a44-a11d-6de7f9300e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:34:41 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-41354bd9-8390-4302-9e4f-0e7fa8273291 tempest-VolumesGetTest-670933563 None] Volume 9b3f468a-d344-4104-bfc9-d28fdee424fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b3f468a-d344-4104-bfc9-d28fdee424fd', 'volume_size': 1}
Jul 14 16:34:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-41354bd9-8390-4302-9e4f-0e7fa8273291 tempest-VolumesGetTest-670933563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:34:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-41354bd9-8390-4302-9e4f-0e7fa8273291 tempest-VolumesGetTest-670933563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:34:41 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-41354bd9-8390-4302-9e4f-0e7fa8273291 tempest-VolumesGetTest-670933563 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:34:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-573436998',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b3f468a-d344-4104-bfc9-d28fdee424fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c3355673ee24c43976f8dc0f9c36446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:34:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:34:41Z,use_quota=True,user_id='aa32643715c74d909a5b4725f5caada8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:34:41 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-41354bd9-8390-4302-9e4f-0e7fa8273291 tempest-VolumesGetTest-670933563 None] Creating volume 9b3f468a-d344-4104-bfc9-d28fdee424fd {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:34:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-41354bd9-8390-4302-9e4f-0e7fa8273291 tempest-VolumesGetTest-670933563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:34:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-41354bd9-8390-4302-9e4f-0e7fa8273291 tempest-VolumesGetTest-670933563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:34:41 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-41354bd9-8390-4302-9e4f-0e7fa8273291 tempest-VolumesGetTest-670933563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:34:41 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-41354bd9-8390-4302-9e4f-0e7fa8273291 tempest-VolumesGetTest-670933563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:34:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-41354bd9-8390-4302-9e4f-0e7fa8273291 tempest-VolumesGetTest-670933563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:34:41 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-41354bd9-8390-4302-9e4f-0e7fa8273291 tempest-VolumesGetTest-670933563 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:34:41 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-41354bd9-8390-4302-9e4f-0e7fa8273291 tempest-VolumesGetTest-670933563 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:34:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-41354bd9-8390-4302-9e4f-0e7fa8273291 tempest-VolumesGetTest-670933563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9b3f468a-d344-4104-bfc9-d28fdee424fd 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:41 devstack sudo[100389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9b3f468a-d344-4104-bfc9-d28fdee424fd 1073741824
Jul 14 16:34:41 devstack sudo[100389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:42 devstack sudo[100389]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-41354bd9-8390-4302-9e4f-0e7fa8273291 tempest-VolumesGetTest-670933563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9b3f468a-d344-4104-bfc9-d28fdee424fd 1073741824" returned: 0 in 0.589s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-41354bd9-8390-4302-9e4f-0e7fa8273291 tempest-VolumesGetTest-670933563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9b3f468a-d344-4104-bfc9-d28fdee424fd {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:42 devstack sudo[100395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9b3f468a-d344-4104-bfc9-d28fdee424fd
Jul 14 16:34:42 devstack sudo[100395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:42 devstack sudo[100395]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-41354bd9-8390-4302-9e4f-0e7fa8273291 tempest-VolumesGetTest-670933563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9b3f468a-d344-4104-bfc9-d28fdee424fd" returned: 0 in 0.312s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:42 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-41354bd9-8390-4302-9e4f-0e7fa8273291 tempest-VolumesGetTest-670933563 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:34:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-41354bd9-8390-4302-9e4f-0e7fa8273291 tempest-VolumesGetTest-670933563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:34:42 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-41354bd9-8390-4302-9e4f-0e7fa8273291 tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (486d2a7c-dbce-4a44-a11d-6de7f9300e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b3f468a-d344-4104-bfc9-d28fdee424fd', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:34:42 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-41354bd9-8390-4302-9e4f-0e7fa8273291 tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (380759f6-ab8b-423a-8913-46be891a664f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:34:42 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-41354bd9-8390-4302-9e4f-0e7fa8273291 tempest-VolumesGetTest-670933563 None] Volume volume-9b3f468a-d344-4104-bfc9-d28fdee424fd (9b3f468a-d344-4104-bfc9-d28fdee424fd): created successfully
Jul 14 16:34:42 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-41354bd9-8390-4302-9e4f-0e7fa8273291 tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (380759f6-ab8b-423a-8913-46be891a664f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:34:42 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-41354bd9-8390-4302-9e4f-0e7fa8273291 tempest-VolumesGetTest-670933563 None] Flow 'volume_create_manager' (f2dbb299-25d3-4707-9b53-59d288c9e1c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:34:42 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-41354bd9-8390-4302-9e4f-0e7fa8273291 tempest-VolumesGetTest-670933563 None] Created volume successfully.
Jul 14 16:34:43 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab9eb0ec-9caa-4b37-a7c7-c7f852579be6 tempest-VolumesGetTest-670933563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:34:44 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ab9eb0ec-9caa-4b37-a7c7-c7f852579be6 tempest-VolumesGetTest-670933563 None] Flow 'volume_create_manager' (525dad15-7a1a-497d-b7e8-c5e5255f3544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:34:44 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ab9eb0ec-9caa-4b37-a7c7-c7f852579be6 tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1afcbe3c-258c-4ac3-bf69-88fb0be2cce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:34:44 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ab9eb0ec-9caa-4b37-a7c7-c7f852579be6 tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1afcbe3c-258c-4ac3-bf69-88fb0be2cce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:34:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-823665263',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2cad5f1-0a61-49a1-a7d8-413c1baac58b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8c3355673ee24c43976f8dc0f9c36446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:34:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=9b3f468a-d344-4104-bfc9-d28fdee424fd,status='creating',terminated_at=None,updated_at=2026-07-14T14:34:44Z,use_quota=True,user_id='aa32643715c74d909a5b4725f5caada8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:34:44 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ab9eb0ec-9caa-4b37-a7c7-c7f852579be6 tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc4bcccf-6f66-4030-91da-f95dad20a872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:34:44 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ab9eb0ec-9caa-4b37-a7c7-c7f852579be6 tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc4bcccf-6f66-4030-91da-f95dad20a872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:34:44 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ab9eb0ec-9caa-4b37-a7c7-c7f852579be6 tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fd2f862-40f9-4cb2-8dae-a76ead8efb1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:34:44 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ab9eb0ec-9caa-4b37-a7c7-c7f852579be6 tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fd2f862-40f9-4cb2-8dae-a76ead8efb1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'c2cad5f1-0a61-49a1-a7d8-413c1baac58b', 'volume_name': 'volume-c2cad5f1-0a61-49a1-a7d8-413c1baac58b', 'volume_size': 1, 'source_volid': '9b3f468a-d344-4104-bfc9-d28fdee424fd', 'source_volstatus': 'available'}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:34:44 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ab9eb0ec-9caa-4b37-a7c7-c7f852579be6 tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36285aa4-6f78-4a51-9e12-4343adce44e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:34:44 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ab9eb0ec-9caa-4b37-a7c7-c7f852579be6 tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36285aa4-6f78-4a51-9e12-4343adce44e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:34:44 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ab9eb0ec-9caa-4b37-a7c7-c7f852579be6 tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50579e20-697a-45f5-9b7f-a92b553f6c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:34:44 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-ab9eb0ec-9caa-4b37-a7c7-c7f852579be6 tempest-VolumesGetTest-670933563 None] Volume c2cad5f1-0a61-49a1-a7d8-413c1baac58b: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-c2cad5f1-0a61-49a1-a7d8-413c1baac58b', 'volume_size': 1, 'source_volid': '9b3f468a-d344-4104-bfc9-d28fdee424fd', 'source_volstatus': 'available'}
Jul 14 16:34:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ab9eb0ec-9caa-4b37-a7c7-c7f852579be6 tempest-VolumesGetTest-670933563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:34:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ab9eb0ec-9caa-4b37-a7c7-c7f852579be6 tempest-VolumesGetTest-670933563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:34:44 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-ab9eb0ec-9caa-4b37-a7c7-c7f852579be6 tempest-VolumesGetTest-670933563 None] Cloning volume 9b3f468a-d344-4104-bfc9-d28fdee424fd to volume c2cad5f1-0a61-49a1-a7d8-413c1baac58b
Jul 14 16:34:44 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-ab9eb0ec-9caa-4b37-a7c7-c7f852579be6 tempest-VolumesGetTest-670933563 None] Creating offline snapshot 643939fa-2e76-40b3-bd5b-ae552b0db39e of volume 9b3f468a-d344-4104-bfc9-d28fdee424fd {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 16:34:44 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[db2fa131-4897-47b5-a8f8-759ac9baa785]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:34:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ab9eb0ec-9caa-4b37-a7c7-c7f852579be6 tempest-VolumesGetTest-670933563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9b3f468a-d344-4104-bfc9-d28fdee424fd {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:44 devstack sudo[100399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9b3f468a-d344-4104-bfc9-d28fdee424fd
Jul 14 16:34:44 devstack sudo[100399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:44 devstack sudo[100399]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ab9eb0ec-9caa-4b37-a7c7-c7f852579be6 tempest-VolumesGetTest-670933563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9b3f468a-d344-4104-bfc9-d28fdee424fd" returned: 0 in 0.395s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ab9eb0ec-9caa-4b37-a7c7-c7f852579be6 tempest-VolumesGetTest-670933563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9b3f468a-d344-4104-bfc9-d28fdee424fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9b3f468a-d344-4104-bfc9-d28fdee424fd.643939fa-2e76-40b3-bd5b-ae552b0db39e 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:44 devstack sudo[100404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9b3f468a-d344-4104-bfc9-d28fdee424fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9b3f468a-d344-4104-bfc9-d28fdee424fd.643939fa-2e76-40b3-bd5b-ae552b0db39e 1G
Jul 14 16:34:44 devstack sudo[100404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:45 devstack sudo[100404]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ab9eb0ec-9caa-4b37-a7c7-c7f852579be6 tempest-VolumesGetTest-670933563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9b3f468a-d344-4104-bfc9-d28fdee424fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9b3f468a-d344-4104-bfc9-d28fdee424fd.643939fa-2e76-40b3-bd5b-ae552b0db39e 1G" returned: 0 in 0.502s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ab9eb0ec-9caa-4b37-a7c7-c7f852579be6 tempest-VolumesGetTest-670933563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b3f468a-d344-4104-bfc9-d28fdee424fd -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9b3f468a-d344-4104-bfc9-d28fdee424fd.643939fa-2e76-40b3-bd5b-ae552b0db39e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:45 devstack sudo[100409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b3f468a-d344-4104-bfc9-d28fdee424fd -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9b3f468a-d344-4104-bfc9-d28fdee424fd.643939fa-2e76-40b3-bd5b-ae552b0db39e
Jul 14 16:34:45 devstack sudo[100409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:45 devstack sudo[100409]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ab9eb0ec-9caa-4b37-a7c7-c7f852579be6 tempest-VolumesGetTest-670933563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b3f468a-d344-4104-bfc9-d28fdee424fd -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9b3f468a-d344-4104-bfc9-d28fdee424fd.643939fa-2e76-40b3-bd5b-ae552b0db39e" returned: 0 in 0.372s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:45 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-ab9eb0ec-9caa-4b37-a7c7-c7f852579be6 tempest-VolumesGetTest-670933563 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9b3f468a-d344-4104-bfc9-d28fdee424fd.643939fa-2e76-40b3-bd5b-ae552b0db39e is being set with open permissions: ugo+rw
Jul 14 16:34:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ab9eb0ec-9caa-4b37-a7c7-c7f852579be6 tempest-VolumesGetTest-670933563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9b3f468a-d344-4104-bfc9-d28fdee424fd.643939fa-2e76-40b3-bd5b-ae552b0db39e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:45 devstack sudo[100414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9b3f468a-d344-4104-bfc9-d28fdee424fd.643939fa-2e76-40b3-bd5b-ae552b0db39e
Jul 14 16:34:45 devstack sudo[100414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:45 devstack sudo[100414]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ab9eb0ec-9caa-4b37-a7c7-c7f852579be6 tempest-VolumesGetTest-670933563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9b3f468a-d344-4104-bfc9-d28fdee424fd.643939fa-2e76-40b3-bd5b-ae552b0db39e" returned: 0 in 0.414s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ab9eb0ec-9caa-4b37-a7c7-c7f852579be6 tempest-VolumesGetTest-670933563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9b3f468a-d344-4104-bfc9-d28fdee424fd.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:45 devstack sudo[100417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9b3f468a-d344-4104-bfc9-d28fdee424fd.info
Jul 14 16:34:45 devstack sudo[100417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:46 devstack sudo[100417]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ab9eb0ec-9caa-4b37-a7c7-c7f852579be6 tempest-VolumesGetTest-670933563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9b3f468a-d344-4104-bfc9-d28fdee424fd.info" returned: 0 in 0.297s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:46 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-ab9eb0ec-9caa-4b37-a7c7-c7f852579be6 tempest-VolumesGetTest-670933563 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9b3f468a-d344-4104-bfc9-d28fdee424fd.info is being set with open permissions: ugo+rw
Jul 14 16:34:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ab9eb0ec-9caa-4b37-a7c7-c7f852579be6 tempest-VolumesGetTest-670933563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9b3f468a-d344-4104-bfc9-d28fdee424fd.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:46 devstack sudo[100420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9b3f468a-d344-4104-bfc9-d28fdee424fd.info
Jul 14 16:34:46 devstack sudo[100420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:46 devstack sudo[100420]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ab9eb0ec-9caa-4b37-a7c7-c7f852579be6 tempest-VolumesGetTest-670933563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9b3f468a-d344-4104-bfc9-d28fdee424fd.info" returned: 0 in 0.335s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:46 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ab9eb0ec-9caa-4b37-a7c7-c7f852579be6 tempest-VolumesGetTest-670933563 None] Acquiring lock "cinder-quobyte-c2cad5f1-0a61-49a1-a7d8-413c1baac58b" by "_copy_volume_from_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:34:46 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ab9eb0ec-9caa-4b37-a7c7-c7f852579be6 tempest-VolumesGetTest-670933563 None] Lock "cinder-quobyte-c2cad5f1-0a61-49a1-a7d8-413c1baac58b" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:34:46 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ab9eb0ec-9caa-4b37-a7c7-c7f852579be6 tempest-VolumesGetTest-670933563 None] snapshot: 643939fa-2e76-40b3-bd5b-ae552b0db39e, volume: c2cad5f1-0a61-49a1-a7d8-413c1baac58b,  {{(pid=87166) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 14 16:34:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ab9eb0ec-9caa-4b37-a7c7-c7f852579be6 tempest-VolumesGetTest-670933563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:34:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ab9eb0ec-9caa-4b37-a7c7-c7f852579be6 tempest-VolumesGetTest-670933563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:34:46 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ab9eb0ec-9caa-4b37-a7c7-c7f852579be6 tempest-VolumesGetTest-670933563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:34:46 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ab9eb0ec-9caa-4b37-a7c7-c7f852579be6 tempest-VolumesGetTest-670933563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:34:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ab9eb0ec-9caa-4b37-a7c7-c7f852579be6 tempest-VolumesGetTest-670933563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:34:46 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[a589e264-d697-4852-829a-8d9438210d22]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:34:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ab9eb0ec-9caa-4b37-a7c7-c7f852579be6 tempest-VolumesGetTest-670933563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9b3f468a-d344-4104-bfc9-d28fdee424fd.643939fa-2e76-40b3-bd5b-ae552b0db39e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:46 devstack sudo[100424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9b3f468a-d344-4104-bfc9-d28fdee424fd.643939fa-2e76-40b3-bd5b-ae552b0db39e
Jul 14 16:34:46 devstack sudo[100424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:47 devstack sudo[100424]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ab9eb0ec-9caa-4b37-a7c7-c7f852579be6 tempest-VolumesGetTest-670933563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9b3f468a-d344-4104-bfc9-d28fdee424fd.643939fa-2e76-40b3-bd5b-ae552b0db39e" returned: 0 in 0.476s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:47 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-ab9eb0ec-9caa-4b37-a7c7-c7f852579be6 tempest-VolumesGetTest-670933563 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b3f468a-d344-4104-bfc9-d28fdee424fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 16:34:47 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ab9eb0ec-9caa-4b37-a7c7-c7f852579be6 tempest-VolumesGetTest-670933563 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9b3f468a-d344-4104-bfc9-d28fdee424fd {{(pid=87166) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 14 16:34:47 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ab9eb0ec-9caa-4b37-a7c7-c7f852579be6 tempest-VolumesGetTest-670933563 None] Creating direct copy from snapshot {{(pid=87166) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 14 16:34:47 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0cd4cc-fe7e-4ba1-a646-a0254639d12f]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:34:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ab9eb0ec-9caa-4b37-a7c7-c7f852579be6 tempest-VolumesGetTest-670933563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9b3f468a-d344-4104-bfc9-d28fdee424fd {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:47 devstack sudo[100429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9b3f468a-d344-4104-bfc9-d28fdee424fd
Jul 14 16:34:47 devstack sudo[100429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:47 devstack sudo[100429]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ab9eb0ec-9caa-4b37-a7c7-c7f852579be6 tempest-VolumesGetTest-670933563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9b3f468a-d344-4104-bfc9-d28fdee424fd" returned: 0 in 0.483s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:47 devstack cinder-volume[87166]: DEBUG cinder.utils [None req-ab9eb0ec-9caa-4b37-a7c7-c7f852579be6 tempest-VolumesGetTest-670933563 None] Path /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c2cad5f1-0a61-49a1-a7d8-413c1baac58b not found in is_blk_device check {{(pid=87166) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 14 16:34:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ab9eb0ec-9caa-4b37-a7c7-c7f852579be6 tempest-VolumesGetTest-670933563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9b3f468a-d344-4104-bfc9-d28fdee424fd /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c2cad5f1-0a61-49a1-a7d8-413c1baac58b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:47 devstack sudo[100435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9b3f468a-d344-4104-bfc9-d28fdee424fd /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c2cad5f1-0a61-49a1-a7d8-413c1baac58b
Jul 14 16:34:47 devstack sudo[100435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:53 devstack sudo[100435]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ab9eb0ec-9caa-4b37-a7c7-c7f852579be6 tempest-VolumesGetTest-670933563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9b3f468a-d344-4104-bfc9-d28fdee424fd /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c2cad5f1-0a61-49a1-a7d8-413c1baac58b" returned: 0 in 5.600s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:53 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[e57e8960-d2ce-4366-9048-b9d2b68ac4cf]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:34:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ab9eb0ec-9caa-4b37-a7c7-c7f852579be6 tempest-VolumesGetTest-670933563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9b3f468a-d344-4104-bfc9-d28fdee424fd {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:53 devstack sudo[100449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9b3f468a-d344-4104-bfc9-d28fdee424fd
Jul 14 16:34:53 devstack sudo[100449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:53 devstack sudo[100449]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ab9eb0ec-9caa-4b37-a7c7-c7f852579be6 tempest-VolumesGetTest-670933563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9b3f468a-d344-4104-bfc9-d28fdee424fd" returned: 0 in 0.615s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:53 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-ab9eb0ec-9caa-4b37-a7c7-c7f852579be6 tempest-VolumesGetTest-670933563 None] Image conversion details: src /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9b3f468a-d344-4104-bfc9-d28fdee424fd, size 1024.00 MB, duration 5.60 sec, destination /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c2cad5f1-0a61-49a1-a7d8-413c1baac58b {{(pid=87166) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 14 16:34:53 devstack cinder-volume[87166]: INFO cinder.image.image_utils [None req-ab9eb0ec-9caa-4b37-a7c7-c7f852579be6 tempest-VolumesGetTest-670933563 None] Converted 1024.00 MB image at 182.81 MB/s
Jul 14 16:34:53 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-ab9eb0ec-9caa-4b37-a7c7-c7f852579be6 tempest-VolumesGetTest-670933563 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c2cad5f1-0a61-49a1-a7d8-413c1baac58b is being set with open permissions: ugo+rw
Jul 14 16:34:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ab9eb0ec-9caa-4b37-a7c7-c7f852579be6 tempest-VolumesGetTest-670933563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c2cad5f1-0a61-49a1-a7d8-413c1baac58b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:53 devstack sudo[100455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c2cad5f1-0a61-49a1-a7d8-413c1baac58b
Jul 14 16:34:53 devstack sudo[100455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:54 devstack sudo[100455]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ab9eb0ec-9caa-4b37-a7c7-c7f852579be6 tempest-VolumesGetTest-670933563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c2cad5f1-0a61-49a1-a7d8-413c1baac58b" returned: 0 in 0.356s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:54 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ab9eb0ec-9caa-4b37-a7c7-c7f852579be6 tempest-VolumesGetTest-670933563 None] Lock "cinder-quobyte-c2cad5f1-0a61-49a1-a7d8-413c1baac58b" released by "_copy_volume_from_snapshot" :: held 7.649s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:34:54 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ab9eb0ec-9caa-4b37-a7c7-c7f852579be6 tempest-VolumesGetTest-670933563 None] Acquiring lock "cinder-quobyte-643939fa-2e76-40b3-bd5b-ae552b0db39e" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:34:54 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ab9eb0ec-9caa-4b37-a7c7-c7f852579be6 tempest-VolumesGetTest-670933563 None] Lock "cinder-quobyte-643939fa-2e76-40b3-bd5b-ae552b0db39e" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:34:54 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-ab9eb0ec-9caa-4b37-a7c7-c7f852579be6 tempest-VolumesGetTest-670933563 None] Deleting offline snapshot 643939fa-2e76-40b3-bd5b-ae552b0db39e of volume 9b3f468a-d344-4104-bfc9-d28fdee424fd {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 16:34:54 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-ab9eb0ec-9caa-4b37-a7c7-c7f852579be6 tempest-VolumesGetTest-670933563 None] snapshot_file for this snap is: volume-9b3f468a-d344-4104-bfc9-d28fdee424fd.643939fa-2e76-40b3-bd5b-ae552b0db39e {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 16:34:54 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[7832dfb4-d386-4be8-8d0a-d93e09a7a248]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:34:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ab9eb0ec-9caa-4b37-a7c7-c7f852579be6 tempest-VolumesGetTest-670933563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9b3f468a-d344-4104-bfc9-d28fdee424fd.643939fa-2e76-40b3-bd5b-ae552b0db39e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:54 devstack sudo[100458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9b3f468a-d344-4104-bfc9-d28fdee424fd.643939fa-2e76-40b3-bd5b-ae552b0db39e
Jul 14 16:34:54 devstack sudo[100458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:54 devstack sudo[100458]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ab9eb0ec-9caa-4b37-a7c7-c7f852579be6 tempest-VolumesGetTest-670933563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9b3f468a-d344-4104-bfc9-d28fdee424fd.643939fa-2e76-40b3-bd5b-ae552b0db39e" returned: 0 in 0.446s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:54 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-ab9eb0ec-9caa-4b37-a7c7-c7f852579be6 tempest-VolumesGetTest-670933563 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b3f468a-d344-4104-bfc9-d28fdee424fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 16:34:54 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a86a45b-2eaa-4c2c-9f91-e4d649d561f8]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:34:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ab9eb0ec-9caa-4b37-a7c7-c7f852579be6 tempest-VolumesGetTest-670933563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9b3f468a-d344-4104-bfc9-d28fdee424fd {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:54 devstack sudo[100463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9b3f468a-d344-4104-bfc9-d28fdee424fd
Jul 14 16:34:54 devstack sudo[100463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:55 devstack sudo[100463]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ab9eb0ec-9caa-4b37-a7c7-c7f852579be6 tempest-VolumesGetTest-670933563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9b3f468a-d344-4104-bfc9-d28fdee424fd" returned: 0 in 0.457s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ab9eb0ec-9caa-4b37-a7c7-c7f852579be6 tempest-VolumesGetTest-670933563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9b3f468a-d344-4104-bfc9-d28fdee424fd.643939fa-2e76-40b3-bd5b-ae552b0db39e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:55 devstack sudo[100468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9b3f468a-d344-4104-bfc9-d28fdee424fd.643939fa-2e76-40b3-bd5b-ae552b0db39e
Jul 14 16:34:55 devstack sudo[100468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:55 devstack sudo[100468]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ab9eb0ec-9caa-4b37-a7c7-c7f852579be6 tempest-VolumesGetTest-670933563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9b3f468a-d344-4104-bfc9-d28fdee424fd.643939fa-2e76-40b3-bd5b-ae552b0db39e" returned: 0 in 0.386s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ab9eb0ec-9caa-4b37-a7c7-c7f852579be6 tempest-VolumesGetTest-670933563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9b3f468a-d344-4104-bfc9-d28fdee424fd.643939fa-2e76-40b3-bd5b-ae552b0db39e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:55 devstack sudo[100473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9b3f468a-d344-4104-bfc9-d28fdee424fd.643939fa-2e76-40b3-bd5b-ae552b0db39e
Jul 14 16:34:55 devstack sudo[100473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:55 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:SELECT=17,cinder:INSERT=9,cinder:UPDATE=20,cinder:DELETE=3 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 16:34:55 devstack sudo[100473]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ab9eb0ec-9caa-4b37-a7c7-c7f852579be6 tempest-VolumesGetTest-670933563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9b3f468a-d344-4104-bfc9-d28fdee424fd.643939fa-2e76-40b3-bd5b-ae552b0db39e" returned: 0 in 0.256s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:55 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ab9eb0ec-9caa-4b37-a7c7-c7f852579be6 tempest-VolumesGetTest-670933563 None] Lock "cinder-quobyte-643939fa-2e76-40b3-bd5b-ae552b0db39e" released by "_delete_snapshot" :: held 1.675s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:34:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ab9eb0ec-9caa-4b37-a7c7-c7f852579be6 tempest-VolumesGetTest-670933563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.882s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:34:56 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ab9eb0ec-9caa-4b37-a7c7-c7f852579be6 tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50579e20-697a-45f5-9b7f-a92b553f6c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2cad5f1-0a61-49a1-a7d8-413c1baac58b', 'volume_size': 1, 'source_volid': '9b3f468a-d344-4104-bfc9-d28fdee424fd', 'source_volstatus': 'available'}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:34:56 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ab9eb0ec-9caa-4b37-a7c7-c7f852579be6 tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d74eb3a1-0a00-423a-8dcb-644a08f2630f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:34:56 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-ab9eb0ec-9caa-4b37-a7c7-c7f852579be6 tempest-VolumesGetTest-670933563 None] Volume volume-c2cad5f1-0a61-49a1-a7d8-413c1baac58b (c2cad5f1-0a61-49a1-a7d8-413c1baac58b): created successfully
Jul 14 16:34:56 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ab9eb0ec-9caa-4b37-a7c7-c7f852579be6 tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d74eb3a1-0a00-423a-8dcb-644a08f2630f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:34:56 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ab9eb0ec-9caa-4b37-a7c7-c7f852579be6 tempest-VolumesGetTest-670933563 None] Flow 'volume_create_manager' (525dad15-7a1a-497d-b7e8-c5e5255f3544) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:34:56 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-ab9eb0ec-9caa-4b37-a7c7-c7f852579be6 tempest-VolumesGetTest-670933563 None] Created volume successfully.
Jul 14 16:34:57 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-0de482b5-aa84-4cb4-89fd-eb7cf72afe93 tempest-VolumesGetTest-670933563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:34:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0de482b5-aa84-4cb4-89fd-eb7cf72afe93 tempest-VolumesGetTest-670933563 None] Flow 'volume_create_manager' (756259f2-2717-4f04-b108-46ba7a603063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:34:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0de482b5-aa84-4cb4-89fd-eb7cf72afe93 tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (513fe9b4-319b-423a-8c65-bf8450755c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:34:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0de482b5-aa84-4cb4-89fd-eb7cf72afe93 tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (513fe9b4-319b-423a-8c65-bf8450755c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:34:57Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1727391149',display_name='tempest-VolumesGetTest-Volume-731316092',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ab8adb6-7ccd-4027-b8d1-26879b9ffa42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c3355673ee24c43976f8dc0f9c36446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:34:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:34:57Z,use_quota=True,user_id='aa32643715c74d909a5b4725f5caada8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:34:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0de482b5-aa84-4cb4-89fd-eb7cf72afe93 tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd6e8d4b-a0e2-433d-8f94-faad212fc1a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:34:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0de482b5-aa84-4cb4-89fd-eb7cf72afe93 tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd6e8d4b-a0e2-433d-8f94-faad212fc1a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:34:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0de482b5-aa84-4cb4-89fd-eb7cf72afe93 tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e57f84d-58a5-4609-8af8-88e5e38ff826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:34:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0de482b5-aa84-4cb4-89fd-eb7cf72afe93 tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e57f84d-58a5-4609-8af8-88e5e38ff826) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ab8adb6-7ccd-4027-b8d1-26879b9ffa42', 'volume_name': 'volume-1ab8adb6-7ccd-4027-b8d1-26879b9ffa42', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:34:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0de482b5-aa84-4cb4-89fd-eb7cf72afe93 tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0d531b7-f070-4bd2-82fb-16f7441c9820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:34:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0de482b5-aa84-4cb4-89fd-eb7cf72afe93 tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0d531b7-f070-4bd2-82fb-16f7441c9820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:34:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0de482b5-aa84-4cb4-89fd-eb7cf72afe93 tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c1552b6-490f-4400-aeee-d4fd747ffaad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:34:57 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-0de482b5-aa84-4cb4-89fd-eb7cf72afe93 tempest-VolumesGetTest-670933563 None] Volume 1ab8adb6-7ccd-4027-b8d1-26879b9ffa42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ab8adb6-7ccd-4027-b8d1-26879b9ffa42', 'volume_size': 1}
Jul 14 16:34:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0de482b5-aa84-4cb4-89fd-eb7cf72afe93 tempest-VolumesGetTest-670933563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:34:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0de482b5-aa84-4cb4-89fd-eb7cf72afe93 tempest-VolumesGetTest-670933563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:34:57 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0de482b5-aa84-4cb4-89fd-eb7cf72afe93 tempest-VolumesGetTest-670933563 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:34:57Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1727391149',display_name='tempest-VolumesGetTest-Volume-731316092',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ab8adb6-7ccd-4027-b8d1-26879b9ffa42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c3355673ee24c43976f8dc0f9c36446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:34:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:34:57Z,use_quota=True,user_id='aa32643715c74d909a5b4725f5caada8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:34:57 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-0de482b5-aa84-4cb4-89fd-eb7cf72afe93 tempest-VolumesGetTest-670933563 None] Creating volume 1ab8adb6-7ccd-4027-b8d1-26879b9ffa42 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:34:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0de482b5-aa84-4cb4-89fd-eb7cf72afe93 tempest-VolumesGetTest-670933563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:34:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0de482b5-aa84-4cb4-89fd-eb7cf72afe93 tempest-VolumesGetTest-670933563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:34:57 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0de482b5-aa84-4cb4-89fd-eb7cf72afe93 tempest-VolumesGetTest-670933563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:34:57 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0de482b5-aa84-4cb4-89fd-eb7cf72afe93 tempest-VolumesGetTest-670933563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:34:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0de482b5-aa84-4cb4-89fd-eb7cf72afe93 tempest-VolumesGetTest-670933563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:34:57 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0de482b5-aa84-4cb4-89fd-eb7cf72afe93 tempest-VolumesGetTest-670933563 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:34:57 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-0de482b5-aa84-4cb4-89fd-eb7cf72afe93 tempest-VolumesGetTest-670933563 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:34:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0de482b5-aa84-4cb4-89fd-eb7cf72afe93 tempest-VolumesGetTest-670933563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ab8adb6-7ccd-4027-b8d1-26879b9ffa42 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:57 devstack sudo[100476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ab8adb6-7ccd-4027-b8d1-26879b9ffa42 1073741824
Jul 14 16:34:57 devstack sudo[100476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:57 devstack sudo[100476]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0de482b5-aa84-4cb4-89fd-eb7cf72afe93 tempest-VolumesGetTest-670933563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ab8adb6-7ccd-4027-b8d1-26879b9ffa42 1073741824" returned: 0 in 0.487s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0de482b5-aa84-4cb4-89fd-eb7cf72afe93 tempest-VolumesGetTest-670933563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ab8adb6-7ccd-4027-b8d1-26879b9ffa42 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:57 devstack sudo[100482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ab8adb6-7ccd-4027-b8d1-26879b9ffa42
Jul 14 16:34:57 devstack sudo[100482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:34:58 devstack sudo[100482]: pam_unix(sudo:session): session closed for user root
Jul 14 16:34:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0de482b5-aa84-4cb4-89fd-eb7cf72afe93 tempest-VolumesGetTest-670933563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ab8adb6-7ccd-4027-b8d1-26879b9ffa42" returned: 0 in 0.327s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:34:58 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0de482b5-aa84-4cb4-89fd-eb7cf72afe93 tempest-VolumesGetTest-670933563 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:34:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0de482b5-aa84-4cb4-89fd-eb7cf72afe93 tempest-VolumesGetTest-670933563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:34:58 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0de482b5-aa84-4cb4-89fd-eb7cf72afe93 tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c1552b6-490f-4400-aeee-d4fd747ffaad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ab8adb6-7ccd-4027-b8d1-26879b9ffa42', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:34:58 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0de482b5-aa84-4cb4-89fd-eb7cf72afe93 tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48ea7882-e6ba-455e-ab31-2dc878b70cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:34:58 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-0de482b5-aa84-4cb4-89fd-eb7cf72afe93 tempest-VolumesGetTest-670933563 None] Volume volume-1ab8adb6-7ccd-4027-b8d1-26879b9ffa42 (1ab8adb6-7ccd-4027-b8d1-26879b9ffa42): created successfully
Jul 14 16:34:58 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0de482b5-aa84-4cb4-89fd-eb7cf72afe93 tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48ea7882-e6ba-455e-ab31-2dc878b70cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:34:58 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0de482b5-aa84-4cb4-89fd-eb7cf72afe93 tempest-VolumesGetTest-670933563 None] Flow 'volume_create_manager' (756259f2-2717-4f04-b108-46ba7a603063) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:34:58 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-0de482b5-aa84-4cb4-89fd-eb7cf72afe93 tempest-VolumesGetTest-670933563 None] Created volume successfully.
Jul 14 16:34:59 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-85dd0773-270b-4114-8839-dce1be7e14e9 tempest-VolumesGetTest-670933563 None] Acquiring lock "cinder-1ab8adb6-7ccd-4027-b8d1-26879b9ffa42-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:34:59 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-85dd0773-270b-4114-8839-dce1be7e14e9 tempest-VolumesGetTest-670933563 None] Lock "cinder-1ab8adb6-7ccd-4027-b8d1-26879b9ffa42-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:34:59 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-85dd0773-270b-4114-8839-dce1be7e14e9 tempest-VolumesGetTest-670933563 None] Acquiring lock "cinder-quobyte-1ab8adb6-7ccd-4027-b8d1-26879b9ffa42" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:34:59 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-85dd0773-270b-4114-8839-dce1be7e14e9 tempest-VolumesGetTest-670933563 None] Lock "cinder-quobyte-1ab8adb6-7ccd-4027-b8d1-26879b9ffa42" acquired by "delete_volume" :: waited 0.018s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:34:59 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d747ce0-d2db-42b2-8fe6-26c5c806ed4f]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:34:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-85dd0773-270b-4114-8839-dce1be7e14e9 tempest-VolumesGetTest-670933563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ab8adb6-7ccd-4027-b8d1-26879b9ffa42 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:34:59 devstack sudo[100486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ab8adb6-7ccd-4027-b8d1-26879b9ffa42
Jul 14 16:34:59 devstack sudo[100486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:35:00 devstack sudo[100486]: pam_unix(sudo:session): session closed for user root
Jul 14 16:35:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-85dd0773-270b-4114-8839-dce1be7e14e9 tempest-VolumesGetTest-670933563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ab8adb6-7ccd-4027-b8d1-26879b9ffa42" returned: 0 in 0.443s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:35:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-85dd0773-270b-4114-8839-dce1be7e14e9 tempest-VolumesGetTest-670933563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ab8adb6-7ccd-4027-b8d1-26879b9ffa42 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:35:00 devstack sudo[100491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ab8adb6-7ccd-4027-b8d1-26879b9ffa42
Jul 14 16:35:00 devstack sudo[100491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:35:00 devstack sudo[100491]: pam_unix(sudo:session): session closed for user root
Jul 14 16:35:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-85dd0773-270b-4114-8839-dce1be7e14e9 tempest-VolumesGetTest-670933563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-1ab8adb6-7ccd-4027-b8d1-26879b9ffa42" returned: 0 in 0.271s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:35:00 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-85dd0773-270b-4114-8839-dce1be7e14e9 tempest-VolumesGetTest-670933563 None] Lock "cinder-quobyte-1ab8adb6-7ccd-4027-b8d1-26879b9ffa42" released by "delete_volume" :: held 0.766s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:35:00 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-85dd0773-270b-4114-8839-dce1be7e14e9 tempest-VolumesGetTest-670933563 None] Created reservations ['90c1e65a-d115-4735-8929-ff1aba789e2e', '392d2420-88b6-4716-9e88-f8be4ff8ba79', 'e4debb32-c3de-4d5d-bd54-da9117bbb207', 'f3082b18-1ae5-456e-a349-e214d21b90cb'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:35:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-85dd0773-270b-4114-8839-dce1be7e14e9 tempest-VolumesGetTest-670933563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:35:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-85dd0773-270b-4114-8839-dce1be7e14e9 tempest-VolumesGetTest-670933563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:35:00 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-85dd0773-270b-4114-8839-dce1be7e14e9 tempest-VolumesGetTest-670933563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:35:00 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-85dd0773-270b-4114-8839-dce1be7e14e9 tempest-VolumesGetTest-670933563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:35:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-85dd0773-270b-4114-8839-dce1be7e14e9 tempest-VolumesGetTest-670933563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:35:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-85dd0773-270b-4114-8839-dce1be7e14e9 tempest-VolumesGetTest-670933563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:35:00 devstack sudo[100494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:35:00 devstack sudo[100494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:35:00 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-109a700d-5524-459b-bd8e-0adbc3d10b4d tempest-VolumesGetTest-670933563 None] Acquiring lock "cinder-c2cad5f1-0a61-49a1-a7d8-413c1baac58b-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:35:00 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-109a700d-5524-459b-bd8e-0adbc3d10b4d tempest-VolumesGetTest-670933563 None] Lock "cinder-c2cad5f1-0a61-49a1-a7d8-413c1baac58b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:35:00 devstack sudo[100494]: pam_unix(sudo:session): session closed for user root
Jul 14 16:35:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-85dd0773-270b-4114-8839-dce1be7e14e9 tempest-VolumesGetTest-670933563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.397s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:35:00 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-85dd0773-270b-4114-8839-dce1be7e14e9 tempest-VolumesGetTest-670933563 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:35:00 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-109a700d-5524-459b-bd8e-0adbc3d10b4d tempest-VolumesGetTest-670933563 None] Acquiring lock "cinder-quobyte-c2cad5f1-0a61-49a1-a7d8-413c1baac58b" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:35:00 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-85dd0773-270b-4114-8839-dce1be7e14e9 tempest-VolumesGetTest-670933563 None] Deleted volume successfully.
Jul 14 16:35:00 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-109a700d-5524-459b-bd8e-0adbc3d10b4d tempest-VolumesGetTest-670933563 None] Lock "cinder-quobyte-c2cad5f1-0a61-49a1-a7d8-413c1baac58b" acquired by "delete_volume" :: waited 0.029s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:35:00 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-85dd0773-270b-4114-8839-dce1be7e14e9 tempest-VolumesGetTest-670933563 None] Lock "cinder-1ab8adb6-7ccd-4027-b8d1-26879b9ffa42-delete_volume" released by "delete_volume" :: held 1.458s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:35:00 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ce2fe6-96d1-44db-81f8-5f20856a169f]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:35:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-109a700d-5524-459b-bd8e-0adbc3d10b4d tempest-VolumesGetTest-670933563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c2cad5f1-0a61-49a1-a7d8-413c1baac58b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:35:01 devstack sudo[100497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c2cad5f1-0a61-49a1-a7d8-413c1baac58b
Jul 14 16:35:01 devstack sudo[100497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:35:01 devstack sudo[100497]: pam_unix(sudo:session): session closed for user root
Jul 14 16:35:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-109a700d-5524-459b-bd8e-0adbc3d10b4d tempest-VolumesGetTest-670933563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c2cad5f1-0a61-49a1-a7d8-413c1baac58b" returned: 0 in 0.525s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:35:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-109a700d-5524-459b-bd8e-0adbc3d10b4d tempest-VolumesGetTest-670933563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c2cad5f1-0a61-49a1-a7d8-413c1baac58b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:35:01 devstack sudo[100504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c2cad5f1-0a61-49a1-a7d8-413c1baac58b
Jul 14 16:35:01 devstack sudo[100504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:35:01 devstack sudo[100504]: pam_unix(sudo:session): session closed for user root
Jul 14 16:35:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-109a700d-5524-459b-bd8e-0adbc3d10b4d tempest-VolumesGetTest-670933563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c2cad5f1-0a61-49a1-a7d8-413c1baac58b" returned: 0 in 0.355s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:35:01 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-109a700d-5524-459b-bd8e-0adbc3d10b4d tempest-VolumesGetTest-670933563 None] Lock "cinder-quobyte-c2cad5f1-0a61-49a1-a7d8-413c1baac58b" released by "delete_volume" :: held 0.968s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:35:01 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-109a700d-5524-459b-bd8e-0adbc3d10b4d tempest-VolumesGetTest-670933563 None] Created reservations ['a5cf5f23-fb35-4252-8725-e334828655c3', 'da2aa91b-7664-4caf-be5b-c3cfcbfe49b6', '37706ec9-aea3-4abf-94e3-092e506741d1', '44fc1471-98b9-4085-9d5a-a8c20d525639'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:35:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-109a700d-5524-459b-bd8e-0adbc3d10b4d tempest-VolumesGetTest-670933563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:35:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-109a700d-5524-459b-bd8e-0adbc3d10b4d tempest-VolumesGetTest-670933563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:35:02 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-109a700d-5524-459b-bd8e-0adbc3d10b4d tempest-VolumesGetTest-670933563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:35:02 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-109a700d-5524-459b-bd8e-0adbc3d10b4d tempest-VolumesGetTest-670933563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:35:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-109a700d-5524-459b-bd8e-0adbc3d10b4d tempest-VolumesGetTest-670933563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:35:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-109a700d-5524-459b-bd8e-0adbc3d10b4d tempest-VolumesGetTest-670933563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:35:02 devstack sudo[100510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:35:02 devstack sudo[100510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:35:02 devstack sudo[100510]: pam_unix(sudo:session): session closed for user root
Jul 14 16:35:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-109a700d-5524-459b-bd8e-0adbc3d10b4d tempest-VolumesGetTest-670933563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.289s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:35:02 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-109a700d-5524-459b-bd8e-0adbc3d10b4d tempest-VolumesGetTest-670933563 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:35:02 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-109a700d-5524-459b-bd8e-0adbc3d10b4d tempest-VolumesGetTest-670933563 None] Deleted volume successfully.
Jul 14 16:35:02 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-109a700d-5524-459b-bd8e-0adbc3d10b4d tempest-VolumesGetTest-670933563 None] Lock "cinder-c2cad5f1-0a61-49a1-a7d8-413c1baac58b-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:35:03 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a4204ad3-463a-4830-b8ba-74e91a73fcf8 tempest-VolumesGetTest-670933563 None] Acquiring lock "cinder-9b3f468a-d344-4104-bfc9-d28fdee424fd-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:35:03 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a4204ad3-463a-4830-b8ba-74e91a73fcf8 tempest-VolumesGetTest-670933563 None] Lock "cinder-9b3f468a-d344-4104-bfc9-d28fdee424fd-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:35:03 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a4204ad3-463a-4830-b8ba-74e91a73fcf8 tempest-VolumesGetTest-670933563 None] Acquiring lock "cinder-quobyte-9b3f468a-d344-4104-bfc9-d28fdee424fd" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:35:03 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a4204ad3-463a-4830-b8ba-74e91a73fcf8 tempest-VolumesGetTest-670933563 None] Lock "cinder-quobyte-9b3f468a-d344-4104-bfc9-d28fdee424fd" acquired by "delete_volume" :: waited 0.019s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:35:03 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3b4b3a-3227-4784-b18c-9f852d46d46f]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:35:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a4204ad3-463a-4830-b8ba-74e91a73fcf8 tempest-VolumesGetTest-670933563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9b3f468a-d344-4104-bfc9-d28fdee424fd {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:35:03 devstack sudo[100513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9b3f468a-d344-4104-bfc9-d28fdee424fd
Jul 14 16:35:03 devstack sudo[100513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:35:03 devstack sudo[100513]: pam_unix(sudo:session): session closed for user root
Jul 14 16:35:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a4204ad3-463a-4830-b8ba-74e91a73fcf8 tempest-VolumesGetTest-670933563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9b3f468a-d344-4104-bfc9-d28fdee424fd" returned: 0 in 0.463s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:35:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a4204ad3-463a-4830-b8ba-74e91a73fcf8 tempest-VolumesGetTest-670933563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9b3f468a-d344-4104-bfc9-d28fdee424fd {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:35:03 devstack sudo[100518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9b3f468a-d344-4104-bfc9-d28fdee424fd
Jul 14 16:35:03 devstack sudo[100518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:35:04 devstack sudo[100518]: pam_unix(sudo:session): session closed for user root
Jul 14 16:35:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a4204ad3-463a-4830-b8ba-74e91a73fcf8 tempest-VolumesGetTest-670933563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9b3f468a-d344-4104-bfc9-d28fdee424fd" returned: 0 in 0.281s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:35:04 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a4204ad3-463a-4830-b8ba-74e91a73fcf8 tempest-VolumesGetTest-670933563 None] Lock "cinder-quobyte-9b3f468a-d344-4104-bfc9-d28fdee424fd" released by "delete_volume" :: held 0.842s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:35:04 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-a4204ad3-463a-4830-b8ba-74e91a73fcf8 tempest-VolumesGetTest-670933563 None] Created reservations ['1e73ef69-c9fb-4353-b215-b0b5d0f91f83', 'eca6788e-b0b7-4872-b42b-02463816762d', 'c23a8c38-fdd3-478f-88c6-3d2a3ce6dff3', 'fa5da8a1-3dee-4342-bbd5-7a720ce4dc32'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:35:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a4204ad3-463a-4830-b8ba-74e91a73fcf8 tempest-VolumesGetTest-670933563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:35:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a4204ad3-463a-4830-b8ba-74e91a73fcf8 tempest-VolumesGetTest-670933563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:35:04 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a4204ad3-463a-4830-b8ba-74e91a73fcf8 tempest-VolumesGetTest-670933563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:35:04 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a4204ad3-463a-4830-b8ba-74e91a73fcf8 tempest-VolumesGetTest-670933563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:35:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a4204ad3-463a-4830-b8ba-74e91a73fcf8 tempest-VolumesGetTest-670933563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:35:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a4204ad3-463a-4830-b8ba-74e91a73fcf8 tempest-VolumesGetTest-670933563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:35:04 devstack sudo[100522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:35:04 devstack sudo[100522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:35:04 devstack sudo[100522]: pam_unix(sudo:session): session closed for user root
Jul 14 16:35:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a4204ad3-463a-4830-b8ba-74e91a73fcf8 tempest-VolumesGetTest-670933563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.305s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:35:04 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-a4204ad3-463a-4830-b8ba-74e91a73fcf8 tempest-VolumesGetTest-670933563 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:35:04 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-a4204ad3-463a-4830-b8ba-74e91a73fcf8 tempest-VolumesGetTest-670933563 None] Deleted volume successfully.
Jul 14 16:35:04 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a4204ad3-463a-4830-b8ba-74e91a73fcf8 tempest-VolumesGetTest-670933563 None] Lock "cinder-9b3f468a-d344-4104-bfc9-d28fdee424fd-delete_volume" released by "delete_volume" :: held 1.432s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:35:05 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-5db7ccb4-e14f-4061-a104-e0852c882fb4 tempest-VolumesGetTest-670933563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:35:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5db7ccb4-e14f-4061-a104-e0852c882fb4 tempest-VolumesGetTest-670933563 None] Flow 'volume_create_manager' (162afc44-f3e8-43ca-9894-fc05871185c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:35:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5db7ccb4-e14f-4061-a104-e0852c882fb4 tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (147006f6-0cbe-4516-8b24-f5ebc86b51d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:35:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5db7ccb4-e14f-4061-a104-e0852c882fb4 tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (147006f6-0cbe-4516-8b24-f5ebc86b51d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:35:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1704359637',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69e33ae0-7c97-408c-9749-6962132d6611,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8c3355673ee24c43976f8dc0f9c36446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:35:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:35:05Z,use_quota=True,user_id='aa32643715c74d909a5b4725f5caada8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:35:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5db7ccb4-e14f-4061-a104-e0852c882fb4 tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e844a436-05f1-4f5c-9b4e-1863a4a77a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:35:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5db7ccb4-e14f-4061-a104-e0852c882fb4 tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e844a436-05f1-4f5c-9b4e-1863a4a77a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:35:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5db7ccb4-e14f-4061-a104-e0852c882fb4 tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24b8ee8d-b633-42d9-812b-d2fbe7af6b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:35:05 devstack cinder-volume[87166]: DEBUG cinder.image.glance [None req-5db7ccb4-e14f-4061-a104-e0852c882fb4 tempest-VolumesGetTest-670933563 None] Creating Keystone auth plugin from conf {{(pid=87166) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 14 16:35:06 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5db7ccb4-e14f-4061-a104-e0852c882fb4 tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24b8ee8d-b633-42d9-812b-d2fbe7af6b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '69e33ae0-7c97-408c-9749-6962132d6611', 'volume_name': 'volume-69e33ae0-7c97-408c-9749-6962132d6611', 'volume_size': 1, 'image_id': '9a5fa908-fde1-4478-9fb5-d52ec5aeacfd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9a5fa908-fde1-4478-9fb5-d52ec5aeacfd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6db24ec5a0f441c18a787b3e9a478713', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9a5fa908-fde1-4478-9fb5-d52ec5aeacfd', 'created_at': datetime.datetime(2026, 7, 14, 14, 17, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 14, 17, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9a5fa908-fde1-4478-9fb5-d52ec5aeacfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74f781610da0>}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:35:06 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5db7ccb4-e14f-4061-a104-e0852c882fb4 tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c757d316-a2ca-4afb-bbf9-12ba4616b8f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:35:06 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5db7ccb4-e14f-4061-a104-e0852c882fb4 tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c757d316-a2ca-4afb-bbf9-12ba4616b8f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:35:06 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5db7ccb4-e14f-4061-a104-e0852c882fb4 tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70184928-6f11-4b62-92a4-715806a0def8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:35:06 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-5db7ccb4-e14f-4061-a104-e0852c882fb4 tempest-VolumesGetTest-670933563 None] Volume 69e33ae0-7c97-408c-9749-6962132d6611: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-69e33ae0-7c97-408c-9749-6962132d6611', 'volume_size': 1, 'image_id': '9a5fa908-fde1-4478-9fb5-d52ec5aeacfd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9a5fa908-fde1-4478-9fb5-d52ec5aeacfd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6db24ec5a0f441c18a787b3e9a478713', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9a5fa908-fde1-4478-9fb5-d52ec5aeacfd', 'created_at': datetime.datetime(2026, 7, 14, 14, 17, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 14, 17, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9a5fa908-fde1-4478-9fb5-d52ec5aeacfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74f781610da0>}
Jul 14 16:35:06 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-5db7ccb4-e14f-4061-a104-e0852c882fb4 tempest-VolumesGetTest-670933563 None] Trying to clone 69e33ae0-7c97-408c-9749-6962132d6611 from image 9a5fa908-fde1-4478-9fb5-d52ec5aeacfd at location (None, [{'url': 'file:///opt/stack/data/glance/images/9a5fa908-fde1-4478-9fb5-d52ec5aeacfd', 'metadata': {}}]). {{(pid=87166) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 14 16:35:06 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-5db7ccb4-e14f-4061-a104-e0852c882fb4 tempest-VolumesGetTest-670933563 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_1459i429devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87166) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 14 16:35:06 devstack cinder-volume[87166]: INFO cinder.image.image_utils [None req-5db7ccb4-e14f-4061-a104-e0852c882fb4 tempest-VolumesGetTest-670933563 None] Image download 20.69 MB at 20.69 MB/s
Jul 14 16:35:06 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[7065e4a7-e044-4326-8bc9-beed82cc3fb7]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:35:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5db7ccb4-e14f-4061-a104-e0852c882fb4 tempest-VolumesGetTest-670933563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_1459i429devstack@QuobyteHD {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:35:06 devstack sudo[100562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_1459i429devstack@QuobyteHD
Jul 14 16:35:06 devstack sudo[100562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:35:07 devstack sudo[100562]: pam_unix(sudo:session): session closed for user root
Jul 14 16:35:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5db7ccb4-e14f-4061-a104-e0852c882fb4 tempest-VolumesGetTest-670933563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_1459i429devstack@QuobyteHD" returned: 0 in 0.408s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:35:07 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-5db7ccb4-e14f-4061-a104-e0852c882fb4 tempest-VolumesGetTest-670933563 None] Temporary image 9a5fa908-fde1-4478-9fb5-d52ec5aeacfd is fetched for user aa32643715c74d909a5b4725f5caada8. {{(pid=87166) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 14 16:35:07 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[e807b7b6-a4a5-402e-a6d7-4571621b3e6d]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:35:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5db7ccb4-e14f-4061-a104-e0852c882fb4 tempest-VolumesGetTest-670933563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_1459i429devstack@QuobyteHD {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:35:07 devstack sudo[100567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_1459i429devstack@QuobyteHD
Jul 14 16:35:07 devstack sudo[100567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:35:07 devstack sudo[100567]: pam_unix(sudo:session): session closed for user root
Jul 14 16:35:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5db7ccb4-e14f-4061-a104-e0852c882fb4 tempest-VolumesGetTest-670933563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_1459i429devstack@QuobyteHD" returned: 0 in 0.346s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:35:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5db7ccb4-e14f-4061-a104-e0852c882fb4 tempest-VolumesGetTest-670933563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:35:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5db7ccb4-e14f-4061-a104-e0852c882fb4 tempest-VolumesGetTest-670933563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:35:07 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5db7ccb4-e14f-4061-a104-e0852c882fb4 tempest-VolumesGetTest-670933563 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:35:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1704359637',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69e33ae0-7c97-408c-9749-6962132d6611,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8c3355673ee24c43976f8dc0f9c36446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:35:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:35:05Z,use_quota=True,user_id='aa32643715c74d909a5b4725f5caada8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:35:07 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-5db7ccb4-e14f-4061-a104-e0852c882fb4 tempest-VolumesGetTest-670933563 None] Creating volume 69e33ae0-7c97-408c-9749-6962132d6611 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:35:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5db7ccb4-e14f-4061-a104-e0852c882fb4 tempest-VolumesGetTest-670933563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:35:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5db7ccb4-e14f-4061-a104-e0852c882fb4 tempest-VolumesGetTest-670933563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:35:07 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5db7ccb4-e14f-4061-a104-e0852c882fb4 tempest-VolumesGetTest-670933563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:35:07 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5db7ccb4-e14f-4061-a104-e0852c882fb4 tempest-VolumesGetTest-670933563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:35:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5db7ccb4-e14f-4061-a104-e0852c882fb4 tempest-VolumesGetTest-670933563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:35:07 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5db7ccb4-e14f-4061-a104-e0852c882fb4 tempest-VolumesGetTest-670933563 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:35:07 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-5db7ccb4-e14f-4061-a104-e0852c882fb4 tempest-VolumesGetTest-670933563 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:35:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5db7ccb4-e14f-4061-a104-e0852c882fb4 tempest-VolumesGetTest-670933563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-69e33ae0-7c97-408c-9749-6962132d6611 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:35:07 devstack sudo[100573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-69e33ae0-7c97-408c-9749-6962132d6611 1073741824
Jul 14 16:35:07 devstack sudo[100573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:35:08 devstack sudo[100573]: pam_unix(sudo:session): session closed for user root
Jul 14 16:35:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5db7ccb4-e14f-4061-a104-e0852c882fb4 tempest-VolumesGetTest-670933563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-69e33ae0-7c97-408c-9749-6962132d6611 1073741824" returned: 0 in 0.551s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:35:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5db7ccb4-e14f-4061-a104-e0852c882fb4 tempest-VolumesGetTest-670933563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-69e33ae0-7c97-408c-9749-6962132d6611 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:35:08 devstack sudo[100579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-69e33ae0-7c97-408c-9749-6962132d6611
Jul 14 16:35:08 devstack sudo[100579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:35:08 devstack sudo[100579]: pam_unix(sudo:session): session closed for user root
Jul 14 16:35:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5db7ccb4-e14f-4061-a104-e0852c882fb4 tempest-VolumesGetTest-670933563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-69e33ae0-7c97-408c-9749-6962132d6611" returned: 0 in 0.260s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:35:08 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5db7ccb4-e14f-4061-a104-e0852c882fb4 tempest-VolumesGetTest-670933563 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:35:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5db7ccb4-e14f-4061-a104-e0852c882fb4 tempest-VolumesGetTest-670933563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:35:08 devstack cinder-volume[87166]: DEBUG cinder.volume.volume_utils [None req-5db7ccb4-e14f-4061-a104-e0852c882fb4 tempest-VolumesGetTest-670933563 None] Attempting download of 9a5fa908-fde1-4478-9fb5-d52ec5aeacfd ((None, [{'url': 'file:///opt/stack/data/glance/images/9a5fa908-fde1-4478-9fb5-d52ec5aeacfd', 'metadata': {}}])) to volume 69e33ae0-7c97-408c-9749-6962132d6611. {{(pid=87166) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 14 16:35:08 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[248bf38e-c598-4baf-8b41-c38febe5cea8]: (4, 'raw') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:35:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5db7ccb4-e14f-4061-a104-e0852c882fb4 tempest-VolumesGetTest-670933563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_qi5l_kv3 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:35:08 devstack sudo[100582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_qi5l_kv3
Jul 14 16:35:08 devstack sudo[100582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:35:08 devstack sudo[100582]: pam_unix(sudo:session): session closed for user root
Jul 14 16:35:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5db7ccb4-e14f-4061-a104-e0852c882fb4 tempest-VolumesGetTest-670933563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_qi5l_kv3" returned: 0 in 0.409s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:35:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5db7ccb4-e14f-4061-a104-e0852c882fb4 tempest-VolumesGetTest-670933563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_qi5l_kv3 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:35:09 devstack sudo[100586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_qi5l_kv3
Jul 14 16:35:09 devstack sudo[100586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:35:09 devstack sudo[100586]: pam_unix(sudo:session): session closed for user root
Jul 14 16:35:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5db7ccb4-e14f-4061-a104-e0852c882fb4 tempest-VolumesGetTest-670933563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_qi5l_kv3" returned: 1 in 0.395s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:35:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5db7ccb4-e14f-4061-a104-e0852c882fb4 tempest-VolumesGetTest-670933563 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_qi5l_kv3' failed. Not Retrying. {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 16:35:09 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[c31ed721-e9a3-429a-9633-7fa372417417]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:35:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5db7ccb4-e14f-4061-a104-e0852c882fb4 tempest-VolumesGetTest-670933563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_1459i429devstack@QuobyteHD {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:35:09 devstack sudo[100591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_1459i429devstack@QuobyteHD
Jul 14 16:35:09 devstack sudo[100591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:35:09 devstack sudo[100591]: pam_unix(sudo:session): session closed for user root
Jul 14 16:35:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5db7ccb4-e14f-4061-a104-e0852c882fb4 tempest-VolumesGetTest-670933563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_1459i429devstack@QuobyteHD" returned: 0 in 0.353s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:35:09 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-5db7ccb4-e14f-4061-a104-e0852c882fb4 tempest-VolumesGetTest-670933563 None] 9a5fa908-fde1-4478-9fb5-d52ec5aeacfd was qcow2, converting to raw {{(pid=87166) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 14 16:35:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5db7ccb4-e14f-4061-a104-e0852c882fb4 tempest-VolumesGetTest-670933563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_1459i429devstack@QuobyteHD /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-69e33ae0-7c97-408c-9749-6962132d6611 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:35:09 devstack sudo[100596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_1459i429devstack@QuobyteHD /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-69e33ae0-7c97-408c-9749-6962132d6611
Jul 14 16:35:09 devstack sudo[100596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:35:11 devstack sudo[100596]: pam_unix(sudo:session): session closed for user root
Jul 14 16:35:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5db7ccb4-e14f-4061-a104-e0852c882fb4 tempest-VolumesGetTest-670933563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_1459i429devstack@QuobyteHD /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-69e33ae0-7c97-408c-9749-6962132d6611" returned: 0 in 2.051s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:35:11 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-5db7ccb4-e14f-4061-a104-e0852c882fb4 tempest-VolumesGetTest-670933563 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_1459i429devstack@QuobyteHD, size 112.00 MB, duration 2.05 sec, destination /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-69e33ae0-7c97-408c-9749-6962132d6611 {{(pid=87166) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 14 16:35:11 devstack cinder-volume[87166]: INFO cinder.image.image_utils [None req-5db7ccb4-e14f-4061-a104-e0852c882fb4 tempest-VolumesGetTest-670933563 None] Converted 112.00 MB image at 54.58 MB/s
Jul 14 16:35:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5db7ccb4-e14f-4061-a104-e0852c882fb4 tempest-VolumesGetTest-670933563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-69e33ae0-7c97-408c-9749-6962132d6611 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:35:11 devstack sudo[100608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-69e33ae0-7c97-408c-9749-6962132d6611 1G
Jul 14 16:35:11 devstack sudo[100608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:35:12 devstack sudo[100608]: pam_unix(sudo:session): session closed for user root
Jul 14 16:35:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5db7ccb4-e14f-4061-a104-e0852c882fb4 tempest-VolumesGetTest-670933563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-69e33ae0-7c97-408c-9749-6962132d6611 1G" returned: 0 in 0.484s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:35:12 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ac0f30-9dde-468b-a383-1bec68bf4612]: (4, 'raw') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:35:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5db7ccb4-e14f-4061-a104-e0852c882fb4 tempest-VolumesGetTest-670933563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-69e33ae0-7c97-408c-9749-6962132d6611 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:35:12 devstack sudo[100619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-69e33ae0-7c97-408c-9749-6962132d6611
Jul 14 16:35:12 devstack sudo[100619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:35:12 devstack sudo[100619]: pam_unix(sudo:session): session closed for user root
Jul 14 16:35:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5db7ccb4-e14f-4061-a104-e0852c882fb4 tempest-VolumesGetTest-670933563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-69e33ae0-7c97-408c-9749-6962132d6611" returned: 0 in 0.401s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:35:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5db7ccb4-e14f-4061-a104-e0852c882fb4 tempest-VolumesGetTest-670933563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-69e33ae0-7c97-408c-9749-6962132d6611 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:35:12 devstack sudo[100623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-69e33ae0-7c97-408c-9749-6962132d6611
Jul 14 16:35:12 devstack sudo[100623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:35:13 devstack sudo[100623]: pam_unix(sudo:session): session closed for user root
Jul 14 16:35:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5db7ccb4-e14f-4061-a104-e0852c882fb4 tempest-VolumesGetTest-670933563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-69e33ae0-7c97-408c-9749-6962132d6611" returned: 1 in 0.405s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:35:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5db7ccb4-e14f-4061-a104-e0852c882fb4 tempest-VolumesGetTest-670933563 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-69e33ae0-7c97-408c-9749-6962132d6611' failed. Not Retrying. {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 16:35:13 devstack cinder-volume[87166]: DEBUG cinder.volume.volume_utils [None req-5db7ccb4-e14f-4061-a104-e0852c882fb4 tempest-VolumesGetTest-670933563 None] Downloaded image 9a5fa908-fde1-4478-9fb5-d52ec5aeacfd ((None, [{'url': 'file:///opt/stack/data/glance/images/9a5fa908-fde1-4478-9fb5-d52ec5aeacfd', 'metadata': {}}])) to volume 69e33ae0-7c97-408c-9749-6962132d6611 successfully. {{(pid=87166) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 14 16:35:13 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-5db7ccb4-e14f-4061-a104-e0852c882fb4 tempest-VolumesGetTest-670933563 None] Temporary image 9a5fa908-fde1-4478-9fb5-d52ec5aeacfd for user aa32643715c74d909a5b4725f5caada8 is deleted. {{(pid=87166) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 14 16:35:13 devstack cinder-volume[87166]: DEBUG cinder.volume.volume_utils [None req-5db7ccb4-e14f-4061-a104-e0852c882fb4 tempest-VolumesGetTest-670933563 None] Marking volume 69e33ae0-7c97-408c-9749-6962132d6611 as bootable. {{(pid=87166) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 14 16:35:13 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-5db7ccb4-e14f-4061-a104-e0852c882fb4 tempest-VolumesGetTest-670933563 None] Copying metadata from image 9a5fa908-fde1-4478-9fb5-d52ec5aeacfd to 69e33ae0-7c97-408c-9749-6962132d6611. {{(pid=87166) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 14 16:35:13 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-5db7ccb4-e14f-4061-a104-e0852c882fb4 tempest-VolumesGetTest-670933563 None] Creating volume glance metadata for volume 69e33ae0-7c97-408c-9749-6962132d6611 backed by image 9a5fa908-fde1-4478-9fb5-d52ec5aeacfd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9a5fa908-fde1-4478-9fb5-d52ec5aeacfd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87166) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 14 16:35:13 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5db7ccb4-e14f-4061-a104-e0852c882fb4 tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70184928-6f11-4b62-92a4-715806a0def8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69e33ae0-7c97-408c-9749-6962132d6611', 'volume_size': 1, 'image_id': '9a5fa908-fde1-4478-9fb5-d52ec5aeacfd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9a5fa908-fde1-4478-9fb5-d52ec5aeacfd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6db24ec5a0f441c18a787b3e9a478713', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9a5fa908-fde1-4478-9fb5-d52ec5aeacfd', 'created_at': datetime.datetime(2026, 7, 14, 14, 17, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 14, 17, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9a5fa908-fde1-4478-9fb5-d52ec5aeacfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74f781610da0>}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:35:13 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5db7ccb4-e14f-4061-a104-e0852c882fb4 tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9f39d9c-22e1-400f-bbbc-a1a0622a6945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:35:13 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-5db7ccb4-e14f-4061-a104-e0852c882fb4 tempest-VolumesGetTest-670933563 None] Volume volume-69e33ae0-7c97-408c-9749-6962132d6611 (69e33ae0-7c97-408c-9749-6962132d6611): created successfully
Jul 14 16:35:13 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5db7ccb4-e14f-4061-a104-e0852c882fb4 tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9f39d9c-22e1-400f-bbbc-a1a0622a6945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:35:13 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5db7ccb4-e14f-4061-a104-e0852c882fb4 tempest-VolumesGetTest-670933563 None] Flow 'volume_create_manager' (162afc44-f3e8-43ca-9894-fc05871185c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:35:13 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-5db7ccb4-e14f-4061-a104-e0852c882fb4 tempest-VolumesGetTest-670933563 None] Created volume successfully.
Jul 14 16:35:14 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d5dad66-651a-4513-bc93-f218a257c46c tempest-VolumesGetTest-670933563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:35:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5d5dad66-651a-4513-bc93-f218a257c46c tempest-VolumesGetTest-670933563 None] Flow 'volume_create_manager' (20feed97-4d93-43c7-a094-cbf10ec3f777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:35:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5d5dad66-651a-4513-bc93-f218a257c46c tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (165b686c-3346-4ad6-bad4-e69948355d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:35:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5d5dad66-651a-4513-bc93-f218a257c46c tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (165b686c-3346-4ad6-bad4-e69948355d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:35:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1415744672',display_name='tempest-VolumesGetTest-Volume-475920390',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=961a66dc-797e-4465-acb5-397f65ac0299,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c3355673ee24c43976f8dc0f9c36446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:35:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:35:15Z,use_quota=True,user_id='aa32643715c74d909a5b4725f5caada8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:35:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5d5dad66-651a-4513-bc93-f218a257c46c tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (534f781b-68c5-40c9-b50e-1d5f2f0a8791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:35:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5d5dad66-651a-4513-bc93-f218a257c46c tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (534f781b-68c5-40c9-b50e-1d5f2f0a8791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:35:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5d5dad66-651a-4513-bc93-f218a257c46c tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01f7f7e5-2977-4046-9ae4-e86d76b7e0e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:35:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5d5dad66-651a-4513-bc93-f218a257c46c tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01f7f7e5-2977-4046-9ae4-e86d76b7e0e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '961a66dc-797e-4465-acb5-397f65ac0299', 'volume_name': 'volume-961a66dc-797e-4465-acb5-397f65ac0299', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:35:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5d5dad66-651a-4513-bc93-f218a257c46c tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e769dc3-998d-4f8e-a62d-80b92e517b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:35:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5d5dad66-651a-4513-bc93-f218a257c46c tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e769dc3-998d-4f8e-a62d-80b92e517b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:35:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5d5dad66-651a-4513-bc93-f218a257c46c tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a16c32b6-a237-4116-a46e-92782d78c04d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:35:15 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-5d5dad66-651a-4513-bc93-f218a257c46c tempest-VolumesGetTest-670933563 None] Volume 961a66dc-797e-4465-acb5-397f65ac0299: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-961a66dc-797e-4465-acb5-397f65ac0299', 'volume_size': 1}
Jul 14 16:35:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5d5dad66-651a-4513-bc93-f218a257c46c tempest-VolumesGetTest-670933563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:35:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5d5dad66-651a-4513-bc93-f218a257c46c tempest-VolumesGetTest-670933563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:35:15 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5d5dad66-651a-4513-bc93-f218a257c46c tempest-VolumesGetTest-670933563 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:35:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1415744672',display_name='tempest-VolumesGetTest-Volume-475920390',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=961a66dc-797e-4465-acb5-397f65ac0299,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c3355673ee24c43976f8dc0f9c36446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:35:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:35:15Z,use_quota=True,user_id='aa32643715c74d909a5b4725f5caada8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:35:15 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-5d5dad66-651a-4513-bc93-f218a257c46c tempest-VolumesGetTest-670933563 None] Creating volume 961a66dc-797e-4465-acb5-397f65ac0299 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:35:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5d5dad66-651a-4513-bc93-f218a257c46c tempest-VolumesGetTest-670933563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:35:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5d5dad66-651a-4513-bc93-f218a257c46c tempest-VolumesGetTest-670933563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:35:15 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5d5dad66-651a-4513-bc93-f218a257c46c tempest-VolumesGetTest-670933563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:35:15 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5d5dad66-651a-4513-bc93-f218a257c46c tempest-VolumesGetTest-670933563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:35:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5d5dad66-651a-4513-bc93-f218a257c46c tempest-VolumesGetTest-670933563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:35:15 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5d5dad66-651a-4513-bc93-f218a257c46c tempest-VolumesGetTest-670933563 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:35:15 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-5d5dad66-651a-4513-bc93-f218a257c46c tempest-VolumesGetTest-670933563 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:35:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5d5dad66-651a-4513-bc93-f218a257c46c tempest-VolumesGetTest-670933563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-961a66dc-797e-4465-acb5-397f65ac0299 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:35:15 devstack sudo[100628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-961a66dc-797e-4465-acb5-397f65ac0299 1073741824
Jul 14 16:35:15 devstack sudo[100628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:35:15 devstack sudo[100628]: pam_unix(sudo:session): session closed for user root
Jul 14 16:35:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5d5dad66-651a-4513-bc93-f218a257c46c tempest-VolumesGetTest-670933563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-961a66dc-797e-4465-acb5-397f65ac0299 1073741824" returned: 0 in 0.567s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:35:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5d5dad66-651a-4513-bc93-f218a257c46c tempest-VolumesGetTest-670933563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-961a66dc-797e-4465-acb5-397f65ac0299 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:35:15 devstack sudo[100633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-961a66dc-797e-4465-acb5-397f65ac0299
Jul 14 16:35:15 devstack sudo[100633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:35:15 devstack sudo[100633]: pam_unix(sudo:session): session closed for user root
Jul 14 16:35:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5d5dad66-651a-4513-bc93-f218a257c46c tempest-VolumesGetTest-670933563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-961a66dc-797e-4465-acb5-397f65ac0299" returned: 0 in 0.338s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:35:15 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5d5dad66-651a-4513-bc93-f218a257c46c tempest-VolumesGetTest-670933563 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:35:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5d5dad66-651a-4513-bc93-f218a257c46c tempest-VolumesGetTest-670933563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:35:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5d5dad66-651a-4513-bc93-f218a257c46c tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a16c32b6-a237-4116-a46e-92782d78c04d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-961a66dc-797e-4465-acb5-397f65ac0299', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:35:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5d5dad66-651a-4513-bc93-f218a257c46c tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3c22267-173f-4d82-aae0-0c3e488b1701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:35:16 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-5d5dad66-651a-4513-bc93-f218a257c46c tempest-VolumesGetTest-670933563 None] Volume volume-961a66dc-797e-4465-acb5-397f65ac0299 (961a66dc-797e-4465-acb5-397f65ac0299): created successfully
Jul 14 16:35:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5d5dad66-651a-4513-bc93-f218a257c46c tempest-VolumesGetTest-670933563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3c22267-173f-4d82-aae0-0c3e488b1701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:35:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5d5dad66-651a-4513-bc93-f218a257c46c tempest-VolumesGetTest-670933563 None] Flow 'volume_create_manager' (20feed97-4d93-43c7-a094-cbf10ec3f777) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:35:16 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-5d5dad66-651a-4513-bc93-f218a257c46c tempest-VolumesGetTest-670933563 None] Created volume successfully.
Jul 14 16:35:16 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-098b03ea-6247-4e6b-9b7e-8325d61ae248 tempest-TestInstancesWithCinderVolumes-233006016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:35:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-098b03ea-6247-4e6b-9b7e-8325d61ae248 tempest-TestInstancesWithCinderVolumes-233006016 None] Flow 'volume_create_manager' (22335007-00c8-4345-915b-7c9182332c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:35:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-098b03ea-6247-4e6b-9b7e-8325d61ae248 tempest-TestInstancesWithCinderVolumes-233006016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (716d69e8-78a6-4a7c-89e7-bfbb753958b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:35:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-098b03ea-6247-4e6b-9b7e-8325d61ae248 tempest-TestInstancesWithCinderVolumes-233006016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (716d69e8-78a6-4a7c-89e7-bfbb753958b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:35:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-952409761',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26538d81-51f2-42f7-8dac-0b8cc9f6cf87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b597fbf212a4ebf86e324e5cd02c92a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:35:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:35:17Z,use_quota=True,user_id='8b14fec21aaf48808c0ca5afdb578868',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3aad1acc-1103-4e34-bcc2-838e496bec6a),volume_type_id=3aad1acc-1103-4e34-bcc2-838e496bec6a)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:35:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-098b03ea-6247-4e6b-9b7e-8325d61ae248 tempest-TestInstancesWithCinderVolumes-233006016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7854e12-5f82-4b4c-9484-39fac641511e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:35:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-098b03ea-6247-4e6b-9b7e-8325d61ae248 tempest-TestInstancesWithCinderVolumes-233006016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7854e12-5f82-4b4c-9484-39fac641511e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:35:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-098b03ea-6247-4e6b-9b7e-8325d61ae248 tempest-TestInstancesWithCinderVolumes-233006016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (587e79c9-a031-42b3-8495-fa0d12a49813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:35:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-098b03ea-6247-4e6b-9b7e-8325d61ae248 tempest-TestInstancesWithCinderVolumes-233006016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (587e79c9-a031-42b3-8495-fa0d12a49813) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26538d81-51f2-42f7-8dac-0b8cc9f6cf87', 'volume_name': 'volume-26538d81-51f2-42f7-8dac-0b8cc9f6cf87', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:35:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-098b03ea-6247-4e6b-9b7e-8325d61ae248 tempest-TestInstancesWithCinderVolumes-233006016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f2c834f-3598-43e6-a7c8-163ca86eca4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:35:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-098b03ea-6247-4e6b-9b7e-8325d61ae248 tempest-TestInstancesWithCinderVolumes-233006016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f2c834f-3598-43e6-a7c8-163ca86eca4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:35:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-098b03ea-6247-4e6b-9b7e-8325d61ae248 tempest-TestInstancesWithCinderVolumes-233006016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d345fc61-7e4b-4e6d-b2d3-a444ef1298ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:35:16 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-098b03ea-6247-4e6b-9b7e-8325d61ae248 tempest-TestInstancesWithCinderVolumes-233006016 None] Volume 26538d81-51f2-42f7-8dac-0b8cc9f6cf87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26538d81-51f2-42f7-8dac-0b8cc9f6cf87', 'volume_size': 1}
Jul 14 16:35:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-098b03ea-6247-4e6b-9b7e-8325d61ae248 tempest-TestInstancesWithCinderVolumes-233006016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:35:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-098b03ea-6247-4e6b-9b7e-8325d61ae248 tempest-TestInstancesWithCinderVolumes-233006016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:35:16 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-098b03ea-6247-4e6b-9b7e-8325d61ae248 tempest-TestInstancesWithCinderVolumes-233006016 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:35:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-952409761',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26538d81-51f2-42f7-8dac-0b8cc9f6cf87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b597fbf212a4ebf86e324e5cd02c92a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:35:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:35:17Z,use_quota=True,user_id='8b14fec21aaf48808c0ca5afdb578868',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3aad1acc-1103-4e34-bcc2-838e496bec6a),volume_type_id=3aad1acc-1103-4e34-bcc2-838e496bec6a)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:35:16 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-098b03ea-6247-4e6b-9b7e-8325d61ae248 tempest-TestInstancesWithCinderVolumes-233006016 None] Creating volume 26538d81-51f2-42f7-8dac-0b8cc9f6cf87 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:35:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-098b03ea-6247-4e6b-9b7e-8325d61ae248 tempest-TestInstancesWithCinderVolumes-233006016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:35:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-098b03ea-6247-4e6b-9b7e-8325d61ae248 tempest-TestInstancesWithCinderVolumes-233006016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:35:16 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-098b03ea-6247-4e6b-9b7e-8325d61ae248 tempest-TestInstancesWithCinderVolumes-233006016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:35:16 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-098b03ea-6247-4e6b-9b7e-8325d61ae248 tempest-TestInstancesWithCinderVolumes-233006016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:35:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-098b03ea-6247-4e6b-9b7e-8325d61ae248 tempest-TestInstancesWithCinderVolumes-233006016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:35:16 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-098b03ea-6247-4e6b-9b7e-8325d61ae248 tempest-TestInstancesWithCinderVolumes-233006016 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:35:16 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-098b03ea-6247-4e6b-9b7e-8325d61ae248 tempest-TestInstancesWithCinderVolumes-233006016 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:35:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-098b03ea-6247-4e6b-9b7e-8325d61ae248 tempest-TestInstancesWithCinderVolumes-233006016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-26538d81-51f2-42f7-8dac-0b8cc9f6cf87 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:35:16 devstack sudo[100637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-26538d81-51f2-42f7-8dac-0b8cc9f6cf87 1073741824
Jul 14 16:35:16 devstack sudo[100637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:35:17 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-172ebb4b-b1c1-4fbe-8e16-09fc5ae767b4 tempest-TestInstancesWithCinderVolumes-233006016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:35:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-172ebb4b-b1c1-4fbe-8e16-09fc5ae767b4 tempest-TestInstancesWithCinderVolumes-233006016 None] Flow 'volume_create_manager' (12c49080-0698-47c3-97e8-9cce7206469f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:35:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-172ebb4b-b1c1-4fbe-8e16-09fc5ae767b4 tempest-TestInstancesWithCinderVolumes-233006016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eccc779-0710-4af4-8f61-7df2992811f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:35:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-172ebb4b-b1c1-4fbe-8e16-09fc5ae767b4 tempest-TestInstancesWithCinderVolumes-233006016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eccc779-0710-4af4-8f61-7df2992811f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:35:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-280317828',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=309b338a-6d5f-432c-b189-9abe7111c154,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b597fbf212a4ebf86e324e5cd02c92a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:35:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:35:17Z,use_quota=True,user_id='8b14fec21aaf48808c0ca5afdb578868',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d5b0c62-a34d-43e7-adc3-02228143ed7a),volume_type_id=8d5b0c62-a34d-43e7-adc3-02228143ed7a)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:35:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-172ebb4b-b1c1-4fbe-8e16-09fc5ae767b4 tempest-TestInstancesWithCinderVolumes-233006016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b29b0c5-cd95-45f9-913a-24be2640d576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:35:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-172ebb4b-b1c1-4fbe-8e16-09fc5ae767b4 tempest-TestInstancesWithCinderVolumes-233006016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b29b0c5-cd95-45f9-913a-24be2640d576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:35:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-172ebb4b-b1c1-4fbe-8e16-09fc5ae767b4 tempest-TestInstancesWithCinderVolumes-233006016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adced4b5-fe8c-434d-b520-d96c19879ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:35:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-172ebb4b-b1c1-4fbe-8e16-09fc5ae767b4 tempest-TestInstancesWithCinderVolumes-233006016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adced4b5-fe8c-434d-b520-d96c19879ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '309b338a-6d5f-432c-b189-9abe7111c154', 'volume_name': 'volume-309b338a-6d5f-432c-b189-9abe7111c154', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:35:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-172ebb4b-b1c1-4fbe-8e16-09fc5ae767b4 tempest-TestInstancesWithCinderVolumes-233006016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cf9bf50-b1b7-43ef-8e09-99e8a6c97da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:35:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-172ebb4b-b1c1-4fbe-8e16-09fc5ae767b4 tempest-TestInstancesWithCinderVolumes-233006016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cf9bf50-b1b7-43ef-8e09-99e8a6c97da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:35:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-172ebb4b-b1c1-4fbe-8e16-09fc5ae767b4 tempest-TestInstancesWithCinderVolumes-233006016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dff4dde8-9a82-4fe6-9680-e7a2cbd201f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:35:17 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-172ebb4b-b1c1-4fbe-8e16-09fc5ae767b4 tempest-TestInstancesWithCinderVolumes-233006016 None] Volume 309b338a-6d5f-432c-b189-9abe7111c154: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-309b338a-6d5f-432c-b189-9abe7111c154', 'volume_size': 1}
Jul 14 16:35:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-172ebb4b-b1c1-4fbe-8e16-09fc5ae767b4 tempest-TestInstancesWithCinderVolumes-233006016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:35:17 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b38b73af-21cf-498e-926b-136b201bc4d2 tempest-VolumesGetTest-670933563 None] Acquiring lock "cinder-961a66dc-797e-4465-acb5-397f65ac0299-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:35:17 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b38b73af-21cf-498e-926b-136b201bc4d2 tempest-VolumesGetTest-670933563 None] Lock "cinder-961a66dc-797e-4465-acb5-397f65ac0299-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:35:17 devstack sudo[100637]: pam_unix(sudo:session): session closed for user root
Jul 14 16:35:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-098b03ea-6247-4e6b-9b7e-8325d61ae248 tempest-TestInstancesWithCinderVolumes-233006016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-26538d81-51f2-42f7-8dac-0b8cc9f6cf87 1073741824" returned: 0 in 0.833s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:35:17 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b38b73af-21cf-498e-926b-136b201bc4d2 tempest-VolumesGetTest-670933563 None] Acquiring lock "cinder-quobyte-961a66dc-797e-4465-acb5-397f65ac0299" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:35:17 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b38b73af-21cf-498e-926b-136b201bc4d2 tempest-VolumesGetTest-670933563 None] Lock "cinder-quobyte-961a66dc-797e-4465-acb5-397f65ac0299" acquired by "delete_volume" :: waited 0.019s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:35:17 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd96916-929e-4585-a257-2c0732c540db]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:35:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b38b73af-21cf-498e-926b-136b201bc4d2 tempest-VolumesGetTest-670933563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-961a66dc-797e-4465-acb5-397f65ac0299 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:35:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-098b03ea-6247-4e6b-9b7e-8325d61ae248 tempest-TestInstancesWithCinderVolumes-233006016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-26538d81-51f2-42f7-8dac-0b8cc9f6cf87 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:35:17 devstack sudo[100644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-26538d81-51f2-42f7-8dac-0b8cc9f6cf87
Jul 14 16:35:17 devstack sudo[100644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:35:17 devstack sudo[100643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-961a66dc-797e-4465-acb5-397f65ac0299
Jul 14 16:35:17 devstack sudo[100643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:35:18 devstack sudo[100644]: pam_unix(sudo:session): session closed for user root
Jul 14 16:35:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-098b03ea-6247-4e6b-9b7e-8325d61ae248 tempest-TestInstancesWithCinderVolumes-233006016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-26538d81-51f2-42f7-8dac-0b8cc9f6cf87" returned: 0 in 0.364s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:35:18 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-098b03ea-6247-4e6b-9b7e-8325d61ae248 tempest-TestInstancesWithCinderVolumes-233006016 None] <== create_volume: return (1275ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:35:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-098b03ea-6247-4e6b-9b7e-8325d61ae248 tempest-TestInstancesWithCinderVolumes-233006016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.278s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:35:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-172ebb4b-b1c1-4fbe-8e16-09fc5ae767b4 tempest-TestInstancesWithCinderVolumes-233006016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.683s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:35:18 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-172ebb4b-b1c1-4fbe-8e16-09fc5ae767b4 tempest-TestInstancesWithCinderVolumes-233006016 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:35:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-280317828',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=309b338a-6d5f-432c-b189-9abe7111c154,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b597fbf212a4ebf86e324e5cd02c92a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:35:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:35:17Z,use_quota=True,user_id='8b14fec21aaf48808c0ca5afdb578868',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8d5b0c62-a34d-43e7-adc3-02228143ed7a),volume_type_id=8d5b0c62-a34d-43e7-adc3-02228143ed7a)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:35:18 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-172ebb4b-b1c1-4fbe-8e16-09fc5ae767b4 tempest-TestInstancesWithCinderVolumes-233006016 None] Creating volume 309b338a-6d5f-432c-b189-9abe7111c154 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:35:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-172ebb4b-b1c1-4fbe-8e16-09fc5ae767b4 tempest-TestInstancesWithCinderVolumes-233006016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:35:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-172ebb4b-b1c1-4fbe-8e16-09fc5ae767b4 tempest-TestInstancesWithCinderVolumes-233006016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:35:18 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-172ebb4b-b1c1-4fbe-8e16-09fc5ae767b4 tempest-TestInstancesWithCinderVolumes-233006016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:35:18 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-172ebb4b-b1c1-4fbe-8e16-09fc5ae767b4 tempest-TestInstancesWithCinderVolumes-233006016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:35:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-172ebb4b-b1c1-4fbe-8e16-09fc5ae767b4 tempest-TestInstancesWithCinderVolumes-233006016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:35:18 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-172ebb4b-b1c1-4fbe-8e16-09fc5ae767b4 tempest-TestInstancesWithCinderVolumes-233006016 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:35:18 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-172ebb4b-b1c1-4fbe-8e16-09fc5ae767b4 tempest-TestInstancesWithCinderVolumes-233006016 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:35:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-172ebb4b-b1c1-4fbe-8e16-09fc5ae767b4 tempest-TestInstancesWithCinderVolumes-233006016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-309b338a-6d5f-432c-b189-9abe7111c154 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:35:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-098b03ea-6247-4e6b-9b7e-8325d61ae248 tempest-TestInstancesWithCinderVolumes-233006016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d345fc61-7e4b-4e6d-b2d3-a444ef1298ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26538d81-51f2-42f7-8dac-0b8cc9f6cf87', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:35:18 devstack sudo[100648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-309b338a-6d5f-432c-b189-9abe7111c154 1073741824
Jul 14 16:35:18 devstack sudo[100648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:35:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-098b03ea-6247-4e6b-9b7e-8325d61ae248 tempest-TestInstancesWithCinderVolumes-233006016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca386112-f4d7-457b-b5e8-76d41d6761b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:35:18 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-098b03ea-6247-4e6b-9b7e-8325d61ae248 tempest-TestInstancesWithCinderVolumes-233006016 None] Volume volume-26538d81-51f2-42f7-8dac-0b8cc9f6cf87 (26538d81-51f2-42f7-8dac-0b8cc9f6cf87): created successfully
Jul 14 16:35:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-098b03ea-6247-4e6b-9b7e-8325d61ae248 tempest-TestInstancesWithCinderVolumes-233006016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca386112-f4d7-457b-b5e8-76d41d6761b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:35:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-098b03ea-6247-4e6b-9b7e-8325d61ae248 tempest-TestInstancesWithCinderVolumes-233006016 None] Flow 'volume_create_manager' (22335007-00c8-4345-915b-7c9182332c39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:35:18 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-098b03ea-6247-4e6b-9b7e-8325d61ae248 tempest-TestInstancesWithCinderVolumes-233006016 None] Created volume successfully.
Jul 14 16:35:18 devstack sudo[100643]: pam_unix(sudo:session): session closed for user root
Jul 14 16:35:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b38b73af-21cf-498e-926b-136b201bc4d2 tempest-VolumesGetTest-670933563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-961a66dc-797e-4465-acb5-397f65ac0299" returned: 0 in 0.680s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:35:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b38b73af-21cf-498e-926b-136b201bc4d2 tempest-VolumesGetTest-670933563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-961a66dc-797e-4465-acb5-397f65ac0299 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:35:18 devstack sudo[100653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-961a66dc-797e-4465-acb5-397f65ac0299
Jul 14 16:35:18 devstack sudo[100653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:35:18 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-09ea82b3-6606-4af7-ab7c-5f7d695e743e tempest-TestInstancesWithCinderVolumes-233006016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:35:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-09ea82b3-6606-4af7-ab7c-5f7d695e743e tempest-TestInstancesWithCinderVolumes-233006016 None] Flow 'volume_create_manager' (19ab2d8a-f74e-4371-b35f-f9fe24ef2da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:35:18 devstack sudo[100648]: pam_unix(sudo:session): session closed for user root
Jul 14 16:35:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-09ea82b3-6606-4af7-ab7c-5f7d695e743e tempest-TestInstancesWithCinderVolumes-233006016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df002144-6633-453a-b09b-e4dc8e793503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:35:18 devstack sudo[100653]: pam_unix(sudo:session): session closed for user root
Jul 14 16:35:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-172ebb4b-b1c1-4fbe-8e16-09fc5ae767b4 tempest-TestInstancesWithCinderVolumes-233006016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-309b338a-6d5f-432c-b189-9abe7111c154 1073741824" returned: 0 in 0.653s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:35:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b38b73af-21cf-498e-926b-136b201bc4d2 tempest-VolumesGetTest-670933563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-961a66dc-797e-4465-acb5-397f65ac0299" returned: 0 in 0.382s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:35:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-09ea82b3-6606-4af7-ab7c-5f7d695e743e tempest-TestInstancesWithCinderVolumes-233006016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df002144-6633-453a-b09b-e4dc8e793503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:35:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-194132500',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2720fa3b-96fa-4808-a90b-6663750f24d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b597fbf212a4ebf86e324e5cd02c92a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:35:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:35:19Z,use_quota=True,user_id='8b14fec21aaf48808c0ca5afdb578868',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6fe19b4-f209-484d-bca7-37289c01b703),volume_type_id=e6fe19b4-f209-484d-bca7-37289c01b703)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:35:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-09ea82b3-6606-4af7-ab7c-5f7d695e743e tempest-TestInstancesWithCinderVolumes-233006016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (174713c7-fb6c-4a85-b958-d678e83b5fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:35:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-09ea82b3-6606-4af7-ab7c-5f7d695e743e tempest-TestInstancesWithCinderVolumes-233006016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (174713c7-fb6c-4a85-b958-d678e83b5fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:35:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-09ea82b3-6606-4af7-ab7c-5f7d695e743e tempest-TestInstancesWithCinderVolumes-233006016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d4d035c-fa38-4acf-b84c-41ad8012ea39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:35:18 devstack cinder-volume[87166]: DEBUG cinder.image.glance [None req-09ea82b3-6606-4af7-ab7c-5f7d695e743e tempest-TestInstancesWithCinderVolumes-233006016 None] Creating Keystone auth plugin from conf {{(pid=87166) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 14 16:35:18 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b38b73af-21cf-498e-926b-136b201bc4d2 tempest-VolumesGetTest-670933563 None] Lock "cinder-quobyte-961a66dc-797e-4465-acb5-397f65ac0299" released by "delete_volume" :: held 1.150s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:35:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-172ebb4b-b1c1-4fbe-8e16-09fc5ae767b4 tempest-TestInstancesWithCinderVolumes-233006016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-309b338a-6d5f-432c-b189-9abe7111c154 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:35:18 devstack sudo[100660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-309b338a-6d5f-432c-b189-9abe7111c154
Jul 14 16:35:18 devstack sudo[100660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:35:18 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-b38b73af-21cf-498e-926b-136b201bc4d2 tempest-VolumesGetTest-670933563 None] Created reservations ['987ce50f-4029-41b1-9b2b-2f13c698fec1', 'dd951748-4b5c-4379-b1e8-0348e2277fb8', '0ed050d2-40d5-4b51-ae89-bd4c46c87b7c', '0ed9f9b7-2b3c-43ad-a449-02bf9fc4d05b'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:35:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b38b73af-21cf-498e-926b-136b201bc4d2 tempest-VolumesGetTest-670933563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:35:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b38b73af-21cf-498e-926b-136b201bc4d2 tempest-VolumesGetTest-670933563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:35:18 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-b38b73af-21cf-498e-926b-136b201bc4d2 tempest-VolumesGetTest-670933563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:35:18 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-b38b73af-21cf-498e-926b-136b201bc4d2 tempest-VolumesGetTest-670933563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:35:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b38b73af-21cf-498e-926b-136b201bc4d2 tempest-VolumesGetTest-670933563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:35:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b38b73af-21cf-498e-926b-136b201bc4d2 tempest-VolumesGetTest-670933563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:35:18 devstack sudo[100662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:35:18 devstack sudo[100662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:35:19 devstack sudo[100660]: pam_unix(sudo:session): session closed for user root
Jul 14 16:35:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-172ebb4b-b1c1-4fbe-8e16-09fc5ae767b4 tempest-TestInstancesWithCinderVolumes-233006016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-309b338a-6d5f-432c-b189-9abe7111c154" returned: 0 in 0.313s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:35:19 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-172ebb4b-b1c1-4fbe-8e16-09fc5ae767b4 tempest-TestInstancesWithCinderVolumes-233006016 None] <== create_volume: return (1078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:35:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-172ebb4b-b1c1-4fbe-8e16-09fc5ae767b4 tempest-TestInstancesWithCinderVolumes-233006016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:35:19 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-172ebb4b-b1c1-4fbe-8e16-09fc5ae767b4 tempest-TestInstancesWithCinderVolumes-233006016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dff4dde8-9a82-4fe6-9680-e7a2cbd201f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-309b338a-6d5f-432c-b189-9abe7111c154', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:35:19 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-172ebb4b-b1c1-4fbe-8e16-09fc5ae767b4 tempest-TestInstancesWithCinderVolumes-233006016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d1b3c4e-284e-4abc-8d4f-cfc79760fca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:35:19 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-09ea82b3-6606-4af7-ab7c-5f7d695e743e tempest-TestInstancesWithCinderVolumes-233006016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d4d035c-fa38-4acf-b84c-41ad8012ea39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2720fa3b-96fa-4808-a90b-6663750f24d4', 'volume_name': 'volume-2720fa3b-96fa-4808-a90b-6663750f24d4', 'volume_size': 1, 'image_id': '799fadc5-063a-42f5-9f7d-510fc13d5ecb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/799fadc5-063a-42f5-9f7d-510fc13d5ecb', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--977216940', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4b597fbf212a4ebf86e324e5cd02c92a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '799fadc5-063a-42f5-9f7d-510fc13d5ecb', 'created_at': datetime.datetime(2026, 7, 14, 14, 35, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 14, 35, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/799fadc5-063a-42f5-9f7d-510fc13d5ecb/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74f7810b71a0>}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:35:19 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-09ea82b3-6606-4af7-ab7c-5f7d695e743e tempest-TestInstancesWithCinderVolumes-233006016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d0f4e0b-9162-4bc2-bd74-abcc4db39d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:35:19 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-09ea82b3-6606-4af7-ab7c-5f7d695e743e tempest-TestInstancesWithCinderVolumes-233006016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d0f4e0b-9162-4bc2-bd74-abcc4db39d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:35:19 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-09ea82b3-6606-4af7-ab7c-5f7d695e743e tempest-TestInstancesWithCinderVolumes-233006016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97986753-2f7f-4083-b694-5ef1d31969b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:35:19 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-09ea82b3-6606-4af7-ab7c-5f7d695e743e tempest-TestInstancesWithCinderVolumes-233006016 None] Volume 2720fa3b-96fa-4808-a90b-6663750f24d4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2720fa3b-96fa-4808-a90b-6663750f24d4', 'volume_size': 1, 'image_id': '799fadc5-063a-42f5-9f7d-510fc13d5ecb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/799fadc5-063a-42f5-9f7d-510fc13d5ecb', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--977216940', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4b597fbf212a4ebf86e324e5cd02c92a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '799fadc5-063a-42f5-9f7d-510fc13d5ecb', 'created_at': datetime.datetime(2026, 7, 14, 14, 35, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 14, 35, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/799fadc5-063a-42f5-9f7d-510fc13d5ecb/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74f7810b71a0>}
Jul 14 16:35:19 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-09ea82b3-6606-4af7-ab7c-5f7d695e743e tempest-TestInstancesWithCinderVolumes-233006016 None] Trying to clone 2720fa3b-96fa-4808-a90b-6663750f24d4 from image 799fadc5-063a-42f5-9f7d-510fc13d5ecb at location (None, [{'url': 'file:///opt/stack/data/glance/images/799fadc5-063a-42f5-9f7d-510fc13d5ecb', 'metadata': {}}]). {{(pid=87166) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 14 16:35:19 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-172ebb4b-b1c1-4fbe-8e16-09fc5ae767b4 tempest-TestInstancesWithCinderVolumes-233006016 None] Volume volume-309b338a-6d5f-432c-b189-9abe7111c154 (309b338a-6d5f-432c-b189-9abe7111c154): created successfully
Jul 14 16:35:19 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-172ebb4b-b1c1-4fbe-8e16-09fc5ae767b4 tempest-TestInstancesWithCinderVolumes-233006016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d1b3c4e-284e-4abc-8d4f-cfc79760fca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:35:19 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-172ebb4b-b1c1-4fbe-8e16-09fc5ae767b4 tempest-TestInstancesWithCinderVolumes-233006016 None] Flow 'volume_create_manager' (12c49080-0698-47c3-97e8-9cce7206469f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:35:19 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-172ebb4b-b1c1-4fbe-8e16-09fc5ae767b4 tempest-TestInstancesWithCinderVolumes-233006016 None] Created volume successfully.
Jul 14 16:35:19 devstack sudo[100662]: pam_unix(sudo:session): session closed for user root
Jul 14 16:35:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b38b73af-21cf-498e-926b-136b201bc4d2 tempest-VolumesGetTest-670933563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.312s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:35:19 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-b38b73af-21cf-498e-926b-136b201bc4d2 tempest-VolumesGetTest-670933563 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:35:19 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-b38b73af-21cf-498e-926b-136b201bc4d2 tempest-VolumesGetTest-670933563 None] Deleted volume successfully.
Jul 14 16:35:19 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b38b73af-21cf-498e-926b-136b201bc4d2 tempest-VolumesGetTest-670933563 None] Lock "cinder-961a66dc-797e-4465-acb5-397f65ac0299-delete_volume" released by "delete_volume" :: held 1.871s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:35:19 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-8e8f801f-878c-4f99-aa22-e44f158c4751 tempest-VolumesGetTest-670933563 None] Acquiring lock "cinder-69e33ae0-7c97-408c-9749-6962132d6611-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:35:19 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-8e8f801f-878c-4f99-aa22-e44f158c4751 tempest-VolumesGetTest-670933563 None] Lock "cinder-69e33ae0-7c97-408c-9749-6962132d6611-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:35:19 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-8e8f801f-878c-4f99-aa22-e44f158c4751 tempest-VolumesGetTest-670933563 None] Acquiring lock "cinder-quobyte-69e33ae0-7c97-408c-9749-6962132d6611" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:35:19 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-8e8f801f-878c-4f99-aa22-e44f158c4751 tempest-VolumesGetTest-670933563 None] Lock "cinder-quobyte-69e33ae0-7c97-408c-9749-6962132d6611" acquired by "delete_volume" :: waited 0.027s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:35:19 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[34997d7a-2d69-4c0a-b663-7730f7da87b0]: (4, 'raw') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:35:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-8e8f801f-878c-4f99-aa22-e44f158c4751 tempest-VolumesGetTest-670933563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-69e33ae0-7c97-408c-9749-6962132d6611 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:35:19 devstack sudo[100667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-69e33ae0-7c97-408c-9749-6962132d6611
Jul 14 16:35:19 devstack sudo[100667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:35:20 devstack sudo[100667]: pam_unix(sudo:session): session closed for user root
Jul 14 16:35:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-8e8f801f-878c-4f99-aa22-e44f158c4751 tempest-VolumesGetTest-670933563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-69e33ae0-7c97-408c-9749-6962132d6611" returned: 0 in 0.402s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:35:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-8e8f801f-878c-4f99-aa22-e44f158c4751 tempest-VolumesGetTest-670933563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-69e33ae0-7c97-408c-9749-6962132d6611 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:35:20 devstack sudo[100671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-69e33ae0-7c97-408c-9749-6962132d6611
Jul 14 16:35:20 devstack sudo[100671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:35:20 devstack sudo[100671]: pam_unix(sudo:session): session closed for user root
Jul 14 16:35:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-8e8f801f-878c-4f99-aa22-e44f158c4751 tempest-VolumesGetTest-670933563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-69e33ae0-7c97-408c-9749-6962132d6611" returned: 1 in 0.421s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:35:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-8e8f801f-878c-4f99-aa22-e44f158c4751 tempest-VolumesGetTest-670933563 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-69e33ae0-7c97-408c-9749-6962132d6611' failed. Not Retrying. {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 16:35:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-8e8f801f-878c-4f99-aa22-e44f158c4751 tempest-VolumesGetTest-670933563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-69e33ae0-7c97-408c-9749-6962132d6611 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:35:20 devstack sudo[100676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-69e33ae0-7c97-408c-9749-6962132d6611
Jul 14 16:35:20 devstack sudo[100676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:35:20 devstack sudo[100676]: pam_unix(sudo:session): session closed for user root
Jul 14 16:35:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-8e8f801f-878c-4f99-aa22-e44f158c4751 tempest-VolumesGetTest-670933563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-69e33ae0-7c97-408c-9749-6962132d6611" returned: 0 in 0.313s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:35:20 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-8e8f801f-878c-4f99-aa22-e44f158c4751 tempest-VolumesGetTest-670933563 None] Lock "cinder-quobyte-69e33ae0-7c97-408c-9749-6962132d6611" released by "delete_volume" :: held 1.218s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:35:21 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-8e8f801f-878c-4f99-aa22-e44f158c4751 tempest-VolumesGetTest-670933563 None] Created reservations ['2f3a04af-4cc1-45e0-95a7-d0d72cb5f206', 'a70f41ae-f8b0-4aed-bf2d-3b1fd1f3ebca', '66142b92-497e-4f5a-9453-1647c4eff71e', '018a0390-dbf9-497c-8702-79b691b09a70'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:35:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-8e8f801f-878c-4f99-aa22-e44f158c4751 tempest-VolumesGetTest-670933563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:35:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-8e8f801f-878c-4f99-aa22-e44f158c4751 tempest-VolumesGetTest-670933563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:35:21 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-8e8f801f-878c-4f99-aa22-e44f158c4751 tempest-VolumesGetTest-670933563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:35:21 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-8e8f801f-878c-4f99-aa22-e44f158c4751 tempest-VolumesGetTest-670933563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:35:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-8e8f801f-878c-4f99-aa22-e44f158c4751 tempest-VolumesGetTest-670933563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:35:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-8e8f801f-878c-4f99-aa22-e44f158c4751 tempest-VolumesGetTest-670933563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:35:21 devstack sudo[100680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:35:21 devstack sudo[100680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:35:21 devstack sudo[100680]: pam_unix(sudo:session): session closed for user root
Jul 14 16:35:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-8e8f801f-878c-4f99-aa22-e44f158c4751 tempest-VolumesGetTest-670933563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.283s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:35:21 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-8e8f801f-878c-4f99-aa22-e44f158c4751 tempest-VolumesGetTest-670933563 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:35:21 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-8e8f801f-878c-4f99-aa22-e44f158c4751 tempest-VolumesGetTest-670933563 None] Deleted volume successfully.
Jul 14 16:35:21 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-8e8f801f-878c-4f99-aa22-e44f158c4751 tempest-VolumesGetTest-670933563 None] Lock "cinder-69e33ae0-7c97-408c-9749-6962132d6611-delete_volume" released by "delete_volume" :: held 1.749s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:35:22 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fa960e5-96b0-45f8-a86e-81ebfb07227d tempest-TestShelveInstance-2021071679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:35:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6fa960e5-96b0-45f8-a86e-81ebfb07227d tempest-TestShelveInstance-2021071679 None] Flow 'volume_create_manager' (70b59bf5-a75b-46ce-bdc7-1694f7ab482e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:35:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6fa960e5-96b0-45f8-a86e-81ebfb07227d tempest-TestShelveInstance-2021071679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (831f08ef-cf14-4505-8c58-8fd6b9bcaff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:35:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6fa960e5-96b0-45f8-a86e-81ebfb07227d tempest-TestShelveInstance-2021071679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (831f08ef-cf14-4505-8c58-8fd6b9bcaff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:35:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-934907129',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cca2447-51d6-4611-8fcd-5f9876a9877e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='188e7799a1124e11a26c4f5c9c0326a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:35:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:35:22Z,use_quota=True,user_id='d6b33b5f729342b59d54f5987d840436',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:35:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6fa960e5-96b0-45f8-a86e-81ebfb07227d tempest-TestShelveInstance-2021071679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75c78321-0633-47ea-82a0-51c65550ef0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:35:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6fa960e5-96b0-45f8-a86e-81ebfb07227d tempest-TestShelveInstance-2021071679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75c78321-0633-47ea-82a0-51c65550ef0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:35:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6fa960e5-96b0-45f8-a86e-81ebfb07227d tempest-TestShelveInstance-2021071679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c0a5737-88c4-4994-ae31-f1b53ef0d9e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:35:22 devstack cinder-volume[87166]: DEBUG cinder.image.glance [None req-6fa960e5-96b0-45f8-a86e-81ebfb07227d tempest-TestShelveInstance-2021071679 None] Creating Keystone auth plugin from conf {{(pid=87166) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 14 16:35:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6fa960e5-96b0-45f8-a86e-81ebfb07227d tempest-TestShelveInstance-2021071679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c0a5737-88c4-4994-ae31-f1b53ef0d9e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8cca2447-51d6-4611-8fcd-5f9876a9877e', 'volume_name': 'volume-8cca2447-51d6-4611-8fcd-5f9876a9877e', 'volume_size': 1, 'image_id': '9a5fa908-fde1-4478-9fb5-d52ec5aeacfd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9a5fa908-fde1-4478-9fb5-d52ec5aeacfd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6db24ec5a0f441c18a787b3e9a478713', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9a5fa908-fde1-4478-9fb5-d52ec5aeacfd', 'created_at': datetime.datetime(2026, 7, 14, 14, 17, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 14, 17, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9a5fa908-fde1-4478-9fb5-d52ec5aeacfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74f776a96de0>}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:35:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6fa960e5-96b0-45f8-a86e-81ebfb07227d tempest-TestShelveInstance-2021071679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3adc238e-14fe-4fb1-899c-1b7c627fb3ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:35:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6fa960e5-96b0-45f8-a86e-81ebfb07227d tempest-TestShelveInstance-2021071679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3adc238e-14fe-4fb1-899c-1b7c627fb3ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:35:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6fa960e5-96b0-45f8-a86e-81ebfb07227d tempest-TestShelveInstance-2021071679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0495e2c4-21e7-4e50-9b67-d20ae7891a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:35:22 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-6fa960e5-96b0-45f8-a86e-81ebfb07227d tempest-TestShelveInstance-2021071679 None] Volume 8cca2447-51d6-4611-8fcd-5f9876a9877e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8cca2447-51d6-4611-8fcd-5f9876a9877e', 'volume_size': 1, 'image_id': '9a5fa908-fde1-4478-9fb5-d52ec5aeacfd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9a5fa908-fde1-4478-9fb5-d52ec5aeacfd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6db24ec5a0f441c18a787b3e9a478713', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9a5fa908-fde1-4478-9fb5-d52ec5aeacfd', 'created_at': datetime.datetime(2026, 7, 14, 14, 17, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 14, 17, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9a5fa908-fde1-4478-9fb5-d52ec5aeacfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74f776a96de0>}
Jul 14 16:35:22 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fa960e5-96b0-45f8-a86e-81ebfb07227d tempest-TestShelveInstance-2021071679 None] Trying to clone 8cca2447-51d6-4611-8fcd-5f9876a9877e from image 9a5fa908-fde1-4478-9fb5-d52ec5aeacfd at location (None, [{'url': 'file:///opt/stack/data/glance/images/9a5fa908-fde1-4478-9fb5-d52ec5aeacfd', 'metadata': {}}]). {{(pid=87166) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 14 16:35:23 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-6fa960e5-96b0-45f8-a86e-81ebfb07227d tempest-TestShelveInstance-2021071679 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_993qxbridevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87166) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 14 16:35:23 devstack cinder-volume[87166]: INFO cinder.image.image_utils [None req-6fa960e5-96b0-45f8-a86e-81ebfb07227d tempest-TestShelveInstance-2021071679 None] Image download 20.69 MB at 20.69 MB/s
Jul 14 16:35:23 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d89c0f3-c2bb-46ef-a46b-16085484a0dc]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:35:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6fa960e5-96b0-45f8-a86e-81ebfb07227d tempest-TestShelveInstance-2021071679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_993qxbridevstack@QuobyteHD {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:35:23 devstack sudo[100684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_993qxbridevstack@QuobyteHD
Jul 14 16:35:23 devstack sudo[100684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:35:23 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-09ea82b3-6606-4af7-ab7c-5f7d695e743e tempest-TestInstancesWithCinderVolumes-233006016 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_799fadc5-063a-42f5-9f7d-510fc13d5ecb_onabw9xjdevstack@QuobyteHD, size 20.69 MB, duration 4.13 sec {{(pid=87166) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 14 16:35:23 devstack cinder-volume[87166]: INFO cinder.image.image_utils [None req-09ea82b3-6606-4af7-ab7c-5f7d695e743e tempest-TestInstancesWithCinderVolumes-233006016 None] Image download 20.69 MB at 5.01 MB/s
Jul 14 16:35:23 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[937d18fa-c360-49ed-9cd5-2b06d7c8e222]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:35:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-09ea82b3-6606-4af7-ab7c-5f7d695e743e tempest-TestInstancesWithCinderVolumes-233006016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_799fadc5-063a-42f5-9f7d-510fc13d5ecb_onabw9xjdevstack@QuobyteHD {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:35:23 devstack sudo[100686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_799fadc5-063a-42f5-9f7d-510fc13d5ecb_onabw9xjdevstack@QuobyteHD
Jul 14 16:35:23 devstack sudo[100686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:35:23 devstack sudo[100684]: pam_unix(sudo:session): session closed for user root
Jul 14 16:35:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6fa960e5-96b0-45f8-a86e-81ebfb07227d tempest-TestShelveInstance-2021071679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_993qxbridevstack@QuobyteHD" returned: 0 in 0.433s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:35:23 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-6fa960e5-96b0-45f8-a86e-81ebfb07227d tempest-TestShelveInstance-2021071679 None] Temporary image 9a5fa908-fde1-4478-9fb5-d52ec5aeacfd is fetched for user d6b33b5f729342b59d54f5987d840436. {{(pid=87166) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 14 16:35:23 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d966dd8-5f5e-452b-a4ca-b65f3e2a3ff6]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:35:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6fa960e5-96b0-45f8-a86e-81ebfb07227d tempest-TestShelveInstance-2021071679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_993qxbridevstack@QuobyteHD {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:35:23 devstack sudo[100691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_993qxbridevstack@QuobyteHD
Jul 14 16:35:23 devstack sudo[100691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:35:23 devstack sudo[100686]: pam_unix(sudo:session): session closed for user root
Jul 14 16:35:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-09ea82b3-6606-4af7-ab7c-5f7d695e743e tempest-TestInstancesWithCinderVolumes-233006016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_799fadc5-063a-42f5-9f7d-510fc13d5ecb_onabw9xjdevstack@QuobyteHD" returned: 0 in 0.386s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:35:23 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-09ea82b3-6606-4af7-ab7c-5f7d695e743e tempest-TestInstancesWithCinderVolumes-233006016 None] Temporary image 799fadc5-063a-42f5-9f7d-510fc13d5ecb is fetched for user 8b14fec21aaf48808c0ca5afdb578868. {{(pid=87166) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 14 16:35:23 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[e596750c-b68b-44b9-99a3-abe2e1215532]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:35:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-09ea82b3-6606-4af7-ab7c-5f7d695e743e tempest-TestInstancesWithCinderVolumes-233006016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_799fadc5-063a-42f5-9f7d-510fc13d5ecb_onabw9xjdevstack@QuobyteHD {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:35:23 devstack sudo[100691]: pam_unix(sudo:session): session closed for user root
Jul 14 16:35:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6fa960e5-96b0-45f8-a86e-81ebfb07227d tempest-TestShelveInstance-2021071679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_993qxbridevstack@QuobyteHD" returned: 0 in 0.349s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:35:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6fa960e5-96b0-45f8-a86e-81ebfb07227d tempest-TestShelveInstance-2021071679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:35:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6fa960e5-96b0-45f8-a86e-81ebfb07227d tempest-TestShelveInstance-2021071679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:35:23 devstack sudo[100696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_799fadc5-063a-42f5-9f7d-510fc13d5ecb_onabw9xjdevstack@QuobyteHD
Jul 14 16:35:23 devstack sudo[100696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:35:23 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6fa960e5-96b0-45f8-a86e-81ebfb07227d tempest-TestShelveInstance-2021071679 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:35:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-934907129',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cca2447-51d6-4611-8fcd-5f9876a9877e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='188e7799a1124e11a26c4f5c9c0326a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:35:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:35:22Z,use_quota=True,user_id='d6b33b5f729342b59d54f5987d840436',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:35:23 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-6fa960e5-96b0-45f8-a86e-81ebfb07227d tempest-TestShelveInstance-2021071679 None] Creating volume 8cca2447-51d6-4611-8fcd-5f9876a9877e {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:35:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6fa960e5-96b0-45f8-a86e-81ebfb07227d tempest-TestShelveInstance-2021071679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:35:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6fa960e5-96b0-45f8-a86e-81ebfb07227d tempest-TestShelveInstance-2021071679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:35:23 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6fa960e5-96b0-45f8-a86e-81ebfb07227d tempest-TestShelveInstance-2021071679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:35:23 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6fa960e5-96b0-45f8-a86e-81ebfb07227d tempest-TestShelveInstance-2021071679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:35:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6fa960e5-96b0-45f8-a86e-81ebfb07227d tempest-TestShelveInstance-2021071679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:35:23 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6fa960e5-96b0-45f8-a86e-81ebfb07227d tempest-TestShelveInstance-2021071679 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:35:23 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-6fa960e5-96b0-45f8-a86e-81ebfb07227d tempest-TestShelveInstance-2021071679 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:35:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6fa960e5-96b0-45f8-a86e-81ebfb07227d tempest-TestShelveInstance-2021071679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8cca2447-51d6-4611-8fcd-5f9876a9877e 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:35:23 devstack sudo[100701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8cca2447-51d6-4611-8fcd-5f9876a9877e 1073741824
Jul 14 16:35:23 devstack sudo[100701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:35:24 devstack sudo[100696]: pam_unix(sudo:session): session closed for user root
Jul 14 16:35:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-09ea82b3-6606-4af7-ab7c-5f7d695e743e tempest-TestInstancesWithCinderVolumes-233006016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_799fadc5-063a-42f5-9f7d-510fc13d5ecb_onabw9xjdevstack@QuobyteHD" returned: 0 in 0.339s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:35:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-09ea82b3-6606-4af7-ab7c-5f7d695e743e tempest-TestInstancesWithCinderVolumes-233006016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:35:24 devstack sudo[100701]: pam_unix(sudo:session): session closed for user root
Jul 14 16:35:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6fa960e5-96b0-45f8-a86e-81ebfb07227d tempest-TestShelveInstance-2021071679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8cca2447-51d6-4611-8fcd-5f9876a9877e 1073741824" returned: 0 in 0.456s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:35:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6fa960e5-96b0-45f8-a86e-81ebfb07227d tempest-TestShelveInstance-2021071679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8cca2447-51d6-4611-8fcd-5f9876a9877e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:35:24 devstack sudo[100710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8cca2447-51d6-4611-8fcd-5f9876a9877e
Jul 14 16:35:24 devstack sudo[100710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:35:24 devstack sudo[100710]: pam_unix(sudo:session): session closed for user root
Jul 14 16:35:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6fa960e5-96b0-45f8-a86e-81ebfb07227d tempest-TestShelveInstance-2021071679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8cca2447-51d6-4611-8fcd-5f9876a9877e" returned: 0 in 0.254s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:35:24 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6fa960e5-96b0-45f8-a86e-81ebfb07227d tempest-TestShelveInstance-2021071679 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:35:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6fa960e5-96b0-45f8-a86e-81ebfb07227d tempest-TestShelveInstance-2021071679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:35:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-09ea82b3-6606-4af7-ab7c-5f7d695e743e tempest-TestInstancesWithCinderVolumes-233006016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.545s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:35:24 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-09ea82b3-6606-4af7-ab7c-5f7d695e743e tempest-TestInstancesWithCinderVolumes-233006016 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:35:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-194132500',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2720fa3b-96fa-4808-a90b-6663750f24d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b597fbf212a4ebf86e324e5cd02c92a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:35:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:35:19Z,use_quota=True,user_id='8b14fec21aaf48808c0ca5afdb578868',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6fe19b4-f209-484d-bca7-37289c01b703),volume_type_id=e6fe19b4-f209-484d-bca7-37289c01b703)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:35:24 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-09ea82b3-6606-4af7-ab7c-5f7d695e743e tempest-TestInstancesWithCinderVolumes-233006016 None] Creating volume 2720fa3b-96fa-4808-a90b-6663750f24d4 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:35:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-09ea82b3-6606-4af7-ab7c-5f7d695e743e tempest-TestInstancesWithCinderVolumes-233006016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:35:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-09ea82b3-6606-4af7-ab7c-5f7d695e743e tempest-TestInstancesWithCinderVolumes-233006016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:35:24 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-09ea82b3-6606-4af7-ab7c-5f7d695e743e tempest-TestInstancesWithCinderVolumes-233006016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:35:24 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-09ea82b3-6606-4af7-ab7c-5f7d695e743e tempest-TestInstancesWithCinderVolumes-233006016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:35:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-09ea82b3-6606-4af7-ab7c-5f7d695e743e tempest-TestInstancesWithCinderVolumes-233006016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:35:24 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-09ea82b3-6606-4af7-ab7c-5f7d695e743e tempest-TestInstancesWithCinderVolumes-233006016 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:35:24 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-09ea82b3-6606-4af7-ab7c-5f7d695e743e tempest-TestInstancesWithCinderVolumes-233006016 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:35:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-09ea82b3-6606-4af7-ab7c-5f7d695e743e tempest-TestInstancesWithCinderVolumes-233006016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2720fa3b-96fa-4808-a90b-6663750f24d4 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:35:24 devstack sudo[100713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2720fa3b-96fa-4808-a90b-6663750f24d4 1073741824
Jul 14 16:35:24 devstack sudo[100713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:35:24 devstack cinder-volume[87166]: DEBUG cinder.volume.volume_utils [None req-6fa960e5-96b0-45f8-a86e-81ebfb07227d tempest-TestShelveInstance-2021071679 None] Attempting download of 9a5fa908-fde1-4478-9fb5-d52ec5aeacfd ((None, [{'url': 'file:///opt/stack/data/glance/images/9a5fa908-fde1-4478-9fb5-d52ec5aeacfd', 'metadata': {}}])) to volume 8cca2447-51d6-4611-8fcd-5f9876a9877e. {{(pid=87166) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 14 16:35:24 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec8de0c9-fb4c-46a5-9f15-8e1cfeb9d674]: (4, 'raw') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:35:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6fa960e5-96b0-45f8-a86e-81ebfb07227d tempest-TestShelveInstance-2021071679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_apwka9yn {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:35:24 devstack sudo[100715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_apwka9yn
Jul 14 16:35:24 devstack sudo[100715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:35:25 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0728798-bb13-4e17-8fb9-4a014d6cff6b tempest-VolumesNegativeTest-1086099852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:35:25 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a0728798-bb13-4e17-8fb9-4a014d6cff6b tempest-VolumesNegativeTest-1086099852 None] Flow 'volume_create_manager' (c2d3b7bb-bf0a-47b1-a88d-d9212f823bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:35:25 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a0728798-bb13-4e17-8fb9-4a014d6cff6b tempest-VolumesNegativeTest-1086099852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6017298-8cbb-4800-ab4a-6f4d231552b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:35:25 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a0728798-bb13-4e17-8fb9-4a014d6cff6b tempest-VolumesNegativeTest-1086099852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6017298-8cbb-4800-ab4a-6f4d231552b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:35:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-622940148',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=008ce108-d562-44c8-b189-511510b0f73f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd155ceb207e40c5a5a30550d20b1877',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:35:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:35:25Z,use_quota=True,user_id='08903bacbc174ba5995cd3d416cd7416',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:35:25 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a0728798-bb13-4e17-8fb9-4a014d6cff6b tempest-VolumesNegativeTest-1086099852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3198a2c-a8a3-4a2f-950d-3efd73e91a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:35:25 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a0728798-bb13-4e17-8fb9-4a014d6cff6b tempest-VolumesNegativeTest-1086099852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3198a2c-a8a3-4a2f-950d-3efd73e91a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:35:25 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a0728798-bb13-4e17-8fb9-4a014d6cff6b tempest-VolumesNegativeTest-1086099852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af42d5a1-fb84-4e50-b5ea-03a9170846e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:35:25 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a0728798-bb13-4e17-8fb9-4a014d6cff6b tempest-VolumesNegativeTest-1086099852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af42d5a1-fb84-4e50-b5ea-03a9170846e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '008ce108-d562-44c8-b189-511510b0f73f', 'volume_name': 'volume-008ce108-d562-44c8-b189-511510b0f73f', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:35:25 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a0728798-bb13-4e17-8fb9-4a014d6cff6b tempest-VolumesNegativeTest-1086099852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a15023d-03e7-4657-a567-3542bafa080d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:35:25 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a0728798-bb13-4e17-8fb9-4a014d6cff6b tempest-VolumesNegativeTest-1086099852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a15023d-03e7-4657-a567-3542bafa080d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:35:25 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a0728798-bb13-4e17-8fb9-4a014d6cff6b tempest-VolumesNegativeTest-1086099852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab946260-ce34-489a-8ea3-63b3dcfb6d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:35:25 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-a0728798-bb13-4e17-8fb9-4a014d6cff6b tempest-VolumesNegativeTest-1086099852 None] Volume 008ce108-d562-44c8-b189-511510b0f73f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-008ce108-d562-44c8-b189-511510b0f73f', 'volume_size': 1}
Jul 14 16:35:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a0728798-bb13-4e17-8fb9-4a014d6cff6b tempest-VolumesNegativeTest-1086099852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:35:25 devstack sudo[100713]: pam_unix(sudo:session): session closed for user root
Jul 14 16:35:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-09ea82b3-6606-4af7-ab7c-5f7d695e743e tempest-TestInstancesWithCinderVolumes-233006016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2720fa3b-96fa-4808-a90b-6663750f24d4 1073741824" returned: 0 in 0.471s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:35:25 devstack sudo[100715]: pam_unix(sudo:session): session closed for user root
Jul 14 16:35:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6fa960e5-96b0-45f8-a86e-81ebfb07227d tempest-TestShelveInstance-2021071679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_apwka9yn" returned: 0 in 0.381s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:35:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6fa960e5-96b0-45f8-a86e-81ebfb07227d tempest-TestShelveInstance-2021071679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_apwka9yn {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:35:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-09ea82b3-6606-4af7-ab7c-5f7d695e743e tempest-TestInstancesWithCinderVolumes-233006016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2720fa3b-96fa-4808-a90b-6663750f24d4 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:35:25 devstack sudo[100723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2720fa3b-96fa-4808-a90b-6663750f24d4
Jul 14 16:35:25 devstack sudo[100723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:35:25 devstack sudo[100722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_apwka9yn
Jul 14 16:35:25 devstack sudo[100722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:35:25 devstack sudo[100723]: pam_unix(sudo:session): session closed for user root
Jul 14 16:35:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-09ea82b3-6606-4af7-ab7c-5f7d695e743e tempest-TestInstancesWithCinderVolumes-233006016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2720fa3b-96fa-4808-a90b-6663750f24d4" returned: 0 in 0.246s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:35:25 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-09ea82b3-6606-4af7-ab7c-5f7d695e743e tempest-TestInstancesWithCinderVolumes-233006016 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:35:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-09ea82b3-6606-4af7-ab7c-5f7d695e743e tempest-TestInstancesWithCinderVolumes-233006016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:35:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a0728798-bb13-4e17-8fb9-4a014d6cff6b tempest-VolumesNegativeTest-1086099852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.370s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:35:25 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a0728798-bb13-4e17-8fb9-4a014d6cff6b tempest-VolumesNegativeTest-1086099852 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:35:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-622940148',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=008ce108-d562-44c8-b189-511510b0f73f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd155ceb207e40c5a5a30550d20b1877',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:35:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:35:25Z,use_quota=True,user_id='08903bacbc174ba5995cd3d416cd7416',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:35:25 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-a0728798-bb13-4e17-8fb9-4a014d6cff6b tempest-VolumesNegativeTest-1086099852 None] Creating volume 008ce108-d562-44c8-b189-511510b0f73f {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:35:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a0728798-bb13-4e17-8fb9-4a014d6cff6b tempest-VolumesNegativeTest-1086099852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:35:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a0728798-bb13-4e17-8fb9-4a014d6cff6b tempest-VolumesNegativeTest-1086099852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:35:25 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a0728798-bb13-4e17-8fb9-4a014d6cff6b tempest-VolumesNegativeTest-1086099852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:35:25 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a0728798-bb13-4e17-8fb9-4a014d6cff6b tempest-VolumesNegativeTest-1086099852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:35:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a0728798-bb13-4e17-8fb9-4a014d6cff6b tempest-VolumesNegativeTest-1086099852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:35:25 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a0728798-bb13-4e17-8fb9-4a014d6cff6b tempest-VolumesNegativeTest-1086099852 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:35:25 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-a0728798-bb13-4e17-8fb9-4a014d6cff6b tempest-VolumesNegativeTest-1086099852 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:35:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a0728798-bb13-4e17-8fb9-4a014d6cff6b tempest-VolumesNegativeTest-1086099852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-008ce108-d562-44c8-b189-511510b0f73f 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:35:25 devstack sudo[100722]: pam_unix(sudo:session): session closed for user root
Jul 14 16:35:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6fa960e5-96b0-45f8-a86e-81ebfb07227d tempest-TestShelveInstance-2021071679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_apwka9yn" returned: 1 in 0.329s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:35:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6fa960e5-96b0-45f8-a86e-81ebfb07227d tempest-TestShelveInstance-2021071679 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_apwka9yn' failed. Not Retrying. {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 16:35:25 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7086b8e-93bb-4153-8b37-db23ccd94b9e]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:35:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6fa960e5-96b0-45f8-a86e-81ebfb07227d tempest-TestShelveInstance-2021071679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_993qxbridevstack@QuobyteHD {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:35:25 devstack sudo[100729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-008ce108-d562-44c8-b189-511510b0f73f 1073741824
Jul 14 16:35:25 devstack sudo[100729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:35:25 devstack cinder-volume[87166]: DEBUG cinder.volume.volume_utils [None req-09ea82b3-6606-4af7-ab7c-5f7d695e743e tempest-TestInstancesWithCinderVolumes-233006016 None] Attempting download of 799fadc5-063a-42f5-9f7d-510fc13d5ecb ((None, [{'url': 'file:///opt/stack/data/glance/images/799fadc5-063a-42f5-9f7d-510fc13d5ecb', 'metadata': {}}])) to volume 2720fa3b-96fa-4808-a90b-6663750f24d4. {{(pid=87166) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 14 16:35:25 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4961462-b67c-4534-85f7-6d82a5a034bf]: (4, 'raw') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:35:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-09ea82b3-6606-4af7-ab7c-5f7d695e743e tempest-TestInstancesWithCinderVolumes-233006016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_799fadc5-063a-42f5-9f7d-510fc13d5ecb_14rmmcwo {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:35:25 devstack sudo[100731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_993qxbridevstack@QuobyteHD
Jul 14 16:35:25 devstack sudo[100731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:35:25 devstack sudo[100732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_799fadc5-063a-42f5-9f7d-510fc13d5ecb_14rmmcwo
Jul 14 16:35:25 devstack sudo[100732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:35:25 devstack sudo[100731]: pam_unix(sudo:session): session closed for user root
Jul 14 16:35:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6fa960e5-96b0-45f8-a86e-81ebfb07227d tempest-TestShelveInstance-2021071679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_993qxbridevstack@QuobyteHD" returned: 0 in 0.362s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:35:25 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-6fa960e5-96b0-45f8-a86e-81ebfb07227d tempest-TestShelveInstance-2021071679 None] 9a5fa908-fde1-4478-9fb5-d52ec5aeacfd was qcow2, converting to raw {{(pid=87166) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 14 16:35:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6fa960e5-96b0-45f8-a86e-81ebfb07227d tempest-TestShelveInstance-2021071679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_993qxbridevstack@QuobyteHD /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8cca2447-51d6-4611-8fcd-5f9876a9877e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:35:25 devstack sudo[100742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_993qxbridevstack@QuobyteHD /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8cca2447-51d6-4611-8fcd-5f9876a9877e
Jul 14 16:35:25 devstack sudo[100742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:35:25 devstack sudo[100729]: pam_unix(sudo:session): session closed for user root
Jul 14 16:35:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a0728798-bb13-4e17-8fb9-4a014d6cff6b tempest-VolumesNegativeTest-1086099852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-008ce108-d562-44c8-b189-511510b0f73f 1073741824" returned: 0 in 0.447s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:35:25 devstack sudo[100732]: pam_unix(sudo:session): session closed for user root
Jul 14 16:35:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-09ea82b3-6606-4af7-ab7c-5f7d695e743e tempest-TestInstancesWithCinderVolumes-233006016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_799fadc5-063a-42f5-9f7d-510fc13d5ecb_14rmmcwo" returned: 0 in 0.354s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:35:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-09ea82b3-6606-4af7-ab7c-5f7d695e743e tempest-TestInstancesWithCinderVolumes-233006016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_799fadc5-063a-42f5-9f7d-510fc13d5ecb_14rmmcwo {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:35:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a0728798-bb13-4e17-8fb9-4a014d6cff6b tempest-VolumesNegativeTest-1086099852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-008ce108-d562-44c8-b189-511510b0f73f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:35:26 devstack sudo[100747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-008ce108-d562-44c8-b189-511510b0f73f
Jul 14 16:35:26 devstack sudo[100747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:35:26 devstack sudo[100746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_799fadc5-063a-42f5-9f7d-510fc13d5ecb_14rmmcwo
Jul 14 16:35:26 devstack sudo[100746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:35:26 devstack sudo[100746]: pam_unix(sudo:session): session closed for user root
Jul 14 16:35:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-09ea82b3-6606-4af7-ab7c-5f7d695e743e tempest-TestInstancesWithCinderVolumes-233006016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_799fadc5-063a-42f5-9f7d-510fc13d5ecb_14rmmcwo" returned: 1 in 0.324s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:35:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-09ea82b3-6606-4af7-ab7c-5f7d695e743e tempest-TestInstancesWithCinderVolumes-233006016 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_799fadc5-063a-42f5-9f7d-510fc13d5ecb_14rmmcwo' failed. Not Retrying. {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 16:35:26 devstack sudo[100747]: pam_unix(sudo:session): session closed for user root
Jul 14 16:35:26 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[7591260b-2567-4124-9d6e-a3f7bbc24cc3]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:35:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-09ea82b3-6606-4af7-ab7c-5f7d695e743e tempest-TestInstancesWithCinderVolumes-233006016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_799fadc5-063a-42f5-9f7d-510fc13d5ecb_onabw9xjdevstack@QuobyteHD {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:35:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a0728798-bb13-4e17-8fb9-4a014d6cff6b tempest-VolumesNegativeTest-1086099852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-008ce108-d562-44c8-b189-511510b0f73f" returned: 0 in 0.311s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:35:26 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a0728798-bb13-4e17-8fb9-4a014d6cff6b tempest-VolumesNegativeTest-1086099852 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:35:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a0728798-bb13-4e17-8fb9-4a014d6cff6b tempest-VolumesNegativeTest-1086099852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:35:26 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a0728798-bb13-4e17-8fb9-4a014d6cff6b tempest-VolumesNegativeTest-1086099852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab946260-ce34-489a-8ea3-63b3dcfb6d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-008ce108-d562-44c8-b189-511510b0f73f', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:35:26 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a0728798-bb13-4e17-8fb9-4a014d6cff6b tempest-VolumesNegativeTest-1086099852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (132a2b76-b911-4102-bf80-69ed9825c344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:35:26 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-a0728798-bb13-4e17-8fb9-4a014d6cff6b tempest-VolumesNegativeTest-1086099852 None] Volume volume-008ce108-d562-44c8-b189-511510b0f73f (008ce108-d562-44c8-b189-511510b0f73f): created successfully
Jul 14 16:35:26 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a0728798-bb13-4e17-8fb9-4a014d6cff6b tempest-VolumesNegativeTest-1086099852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (132a2b76-b911-4102-bf80-69ed9825c344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:35:26 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a0728798-bb13-4e17-8fb9-4a014d6cff6b tempest-VolumesNegativeTest-1086099852 None] Flow 'volume_create_manager' (c2d3b7bb-bf0a-47b1-a88d-d9212f823bd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:35:26 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-a0728798-bb13-4e17-8fb9-4a014d6cff6b tempest-VolumesNegativeTest-1086099852 None] Created volume successfully.
Jul 14 16:35:26 devstack sudo[100760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_799fadc5-063a-42f5-9f7d-510fc13d5ecb_onabw9xjdevstack@QuobyteHD
Jul 14 16:35:26 devstack sudo[100760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:35:26 devstack sudo[100760]: pam_unix(sudo:session): session closed for user root
Jul 14 16:35:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-09ea82b3-6606-4af7-ab7c-5f7d695e743e tempest-TestInstancesWithCinderVolumes-233006016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_799fadc5-063a-42f5-9f7d-510fc13d5ecb_onabw9xjdevstack@QuobyteHD" returned: 0 in 0.360s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:35:26 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-09ea82b3-6606-4af7-ab7c-5f7d695e743e tempest-TestInstancesWithCinderVolumes-233006016 None] 799fadc5-063a-42f5-9f7d-510fc13d5ecb was qcow2, converting to raw {{(pid=87166) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 14 16:35:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-09ea82b3-6606-4af7-ab7c-5f7d695e743e tempest-TestInstancesWithCinderVolumes-233006016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_799fadc5-063a-42f5-9f7d-510fc13d5ecb_onabw9xjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2720fa3b-96fa-4808-a90b-6663750f24d4 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:35:26 devstack sudo[100765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_799fadc5-063a-42f5-9f7d-510fc13d5ecb_onabw9xjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2720fa3b-96fa-4808-a90b-6663750f24d4
Jul 14 16:35:26 devstack sudo[100765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:35:27 devstack sudo[100742]: pam_unix(sudo:session): session closed for user root
Jul 14 16:35:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6fa960e5-96b0-45f8-a86e-81ebfb07227d tempest-TestShelveInstance-2021071679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_993qxbridevstack@QuobyteHD /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8cca2447-51d6-4611-8fcd-5f9876a9877e" returned: 0 in 1.625s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:35:27 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-6fa960e5-96b0-45f8-a86e-81ebfb07227d tempest-TestShelveInstance-2021071679 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9a5fa908-fde1-4478-9fb5-d52ec5aeacfd_993qxbridevstack@QuobyteHD, size 112.00 MB, duration 1.63 sec, destination /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8cca2447-51d6-4611-8fcd-5f9876a9877e {{(pid=87166) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 14 16:35:27 devstack cinder-volume[87166]: INFO cinder.image.image_utils [None req-6fa960e5-96b0-45f8-a86e-81ebfb07227d tempest-TestShelveInstance-2021071679 None] Converted 112.00 MB image at 68.85 MB/s
Jul 14 16:35:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6fa960e5-96b0-45f8-a86e-81ebfb07227d tempest-TestShelveInstance-2021071679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8cca2447-51d6-4611-8fcd-5f9876a9877e 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:35:27 devstack sudo[100773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8cca2447-51d6-4611-8fcd-5f9876a9877e 1G
Jul 14 16:35:27 devstack sudo[100773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:35:27 devstack sudo[100773]: pam_unix(sudo:session): session closed for user root
Jul 14 16:35:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6fa960e5-96b0-45f8-a86e-81ebfb07227d tempest-TestShelveInstance-2021071679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8cca2447-51d6-4611-8fcd-5f9876a9877e 1G" returned: 0 in 0.430s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:35:28 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f5e15e-8b9c-447f-bb34-20fc82025a99]: (4, 'raw') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:35:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6fa960e5-96b0-45f8-a86e-81ebfb07227d tempest-TestShelveInstance-2021071679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8cca2447-51d6-4611-8fcd-5f9876a9877e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:35:28 devstack sudo[100781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8cca2447-51d6-4611-8fcd-5f9876a9877e
Jul 14 16:35:28 devstack sudo[100781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:35:28 devstack sudo[100765]: pam_unix(sudo:session): session closed for user root
Jul 14 16:35:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-09ea82b3-6606-4af7-ab7c-5f7d695e743e tempest-TestInstancesWithCinderVolumes-233006016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_799fadc5-063a-42f5-9f7d-510fc13d5ecb_onabw9xjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2720fa3b-96fa-4808-a90b-6663750f24d4" returned: 0 in 1.717s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:35:28 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-09ea82b3-6606-4af7-ab7c-5f7d695e743e tempest-TestInstancesWithCinderVolumes-233006016 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_799fadc5-063a-42f5-9f7d-510fc13d5ecb_onabw9xjdevstack@QuobyteHD, size 112.00 MB, duration 1.72 sec, destination /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2720fa3b-96fa-4808-a90b-6663750f24d4 {{(pid=87166) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 14 16:35:28 devstack cinder-volume[87166]: INFO cinder.image.image_utils [None req-09ea82b3-6606-4af7-ab7c-5f7d695e743e tempest-TestInstancesWithCinderVolumes-233006016 None] Converted 112.00 MB image at 65.16 MB/s
Jul 14 16:35:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-09ea82b3-6606-4af7-ab7c-5f7d695e743e tempest-TestInstancesWithCinderVolumes-233006016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2720fa3b-96fa-4808-a90b-6663750f24d4 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:35:28 devstack sudo[100781]: pam_unix(sudo:session): session closed for user root
Jul 14 16:35:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6fa960e5-96b0-45f8-a86e-81ebfb07227d tempest-TestShelveInstance-2021071679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8cca2447-51d6-4611-8fcd-5f9876a9877e" returned: 0 in 0.415s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:35:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6fa960e5-96b0-45f8-a86e-81ebfb07227d tempest-TestShelveInstance-2021071679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8cca2447-51d6-4611-8fcd-5f9876a9877e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:35:28 devstack sudo[100785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2720fa3b-96fa-4808-a90b-6663750f24d4 1G
Jul 14 16:35:28 devstack sudo[100785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:35:28 devstack sudo[100786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8cca2447-51d6-4611-8fcd-5f9876a9877e
Jul 14 16:35:28 devstack sudo[100786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:35:28 devstack sudo[100785]: pam_unix(sudo:session): session closed for user root
Jul 14 16:35:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-09ea82b3-6606-4af7-ab7c-5f7d695e743e tempest-TestInstancesWithCinderVolumes-233006016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2720fa3b-96fa-4808-a90b-6663750f24d4 1G" returned: 0 in 0.403s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:35:28 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b61e6d8-caa5-4bd3-9511-465bc8f156e3]: (4, 'raw') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:35:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-09ea82b3-6606-4af7-ab7c-5f7d695e743e tempest-TestInstancesWithCinderVolumes-233006016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2720fa3b-96fa-4808-a90b-6663750f24d4 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:35:28 devstack sudo[100786]: pam_unix(sudo:session): session closed for user root
Jul 14 16:35:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6fa960e5-96b0-45f8-a86e-81ebfb07227d tempest-TestShelveInstance-2021071679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8cca2447-51d6-4611-8fcd-5f9876a9877e" returned: 1 in 0.446s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:35:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6fa960e5-96b0-45f8-a86e-81ebfb07227d tempest-TestShelveInstance-2021071679 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8cca2447-51d6-4611-8fcd-5f9876a9877e' failed. Not Retrying. {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 16:35:28 devstack cinder-volume[87166]: DEBUG cinder.volume.volume_utils [None req-6fa960e5-96b0-45f8-a86e-81ebfb07227d tempest-TestShelveInstance-2021071679 None] Downloaded image 9a5fa908-fde1-4478-9fb5-d52ec5aeacfd ((None, [{'url': 'file:///opt/stack/data/glance/images/9a5fa908-fde1-4478-9fb5-d52ec5aeacfd', 'metadata': {}}])) to volume 8cca2447-51d6-4611-8fcd-5f9876a9877e successfully. {{(pid=87166) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 14 16:35:28 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-6fa960e5-96b0-45f8-a86e-81ebfb07227d tempest-TestShelveInstance-2021071679 None] Temporary image 9a5fa908-fde1-4478-9fb5-d52ec5aeacfd for user d6b33b5f729342b59d54f5987d840436 is deleted. {{(pid=87166) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 14 16:35:28 devstack cinder-volume[87166]: DEBUG cinder.volume.volume_utils [None req-6fa960e5-96b0-45f8-a86e-81ebfb07227d tempest-TestShelveInstance-2021071679 None] Marking volume 8cca2447-51d6-4611-8fcd-5f9876a9877e as bootable. {{(pid=87166) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 14 16:35:28 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fa960e5-96b0-45f8-a86e-81ebfb07227d tempest-TestShelveInstance-2021071679 None] Copying metadata from image 9a5fa908-fde1-4478-9fb5-d52ec5aeacfd to 8cca2447-51d6-4611-8fcd-5f9876a9877e. {{(pid=87166) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 14 16:35:28 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fa960e5-96b0-45f8-a86e-81ebfb07227d tempest-TestShelveInstance-2021071679 None] Creating volume glance metadata for volume 8cca2447-51d6-4611-8fcd-5f9876a9877e backed by image 9a5fa908-fde1-4478-9fb5-d52ec5aeacfd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9a5fa908-fde1-4478-9fb5-d52ec5aeacfd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87166) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 14 16:35:29 devstack sudo[100795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2720fa3b-96fa-4808-a90b-6663750f24d4
Jul 14 16:35:29 devstack sudo[100795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:35:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6fa960e5-96b0-45f8-a86e-81ebfb07227d tempest-TestShelveInstance-2021071679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0495e2c4-21e7-4e50-9b67-d20ae7891a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cca2447-51d6-4611-8fcd-5f9876a9877e', 'volume_size': 1, 'image_id': '9a5fa908-fde1-4478-9fb5-d52ec5aeacfd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9a5fa908-fde1-4478-9fb5-d52ec5aeacfd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6db24ec5a0f441c18a787b3e9a478713', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9a5fa908-fde1-4478-9fb5-d52ec5aeacfd', 'created_at': datetime.datetime(2026, 7, 14, 14, 17, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 14, 17, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9a5fa908-fde1-4478-9fb5-d52ec5aeacfd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74f776a96de0>}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:35:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6fa960e5-96b0-45f8-a86e-81ebfb07227d tempest-TestShelveInstance-2021071679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (454ced3f-de4f-4329-b50f-5a96149c6e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:35:29 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-6fa960e5-96b0-45f8-a86e-81ebfb07227d tempest-TestShelveInstance-2021071679 None] Volume volume-8cca2447-51d6-4611-8fcd-5f9876a9877e (8cca2447-51d6-4611-8fcd-5f9876a9877e): created successfully
Jul 14 16:35:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6fa960e5-96b0-45f8-a86e-81ebfb07227d tempest-TestShelveInstance-2021071679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (454ced3f-de4f-4329-b50f-5a96149c6e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:35:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6fa960e5-96b0-45f8-a86e-81ebfb07227d tempest-TestShelveInstance-2021071679 None] Flow 'volume_create_manager' (70b59bf5-a75b-46ce-bdc7-1694f7ab482e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:35:29 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-6fa960e5-96b0-45f8-a86e-81ebfb07227d tempest-TestShelveInstance-2021071679 None] Created volume successfully.
Jul 14 16:35:29 devstack sudo[100795]: pam_unix(sudo:session): session closed for user root
Jul 14 16:35:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-09ea82b3-6606-4af7-ab7c-5f7d695e743e tempest-TestInstancesWithCinderVolumes-233006016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2720fa3b-96fa-4808-a90b-6663750f24d4" returned: 0 in 0.452s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:35:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-09ea82b3-6606-4af7-ab7c-5f7d695e743e tempest-TestInstancesWithCinderVolumes-233006016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2720fa3b-96fa-4808-a90b-6663750f24d4 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:35:29 devstack sudo[100801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2720fa3b-96fa-4808-a90b-6663750f24d4
Jul 14 16:35:29 devstack sudo[100801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:35:29 devstack sudo[100801]: pam_unix(sudo:session): session closed for user root
Jul 14 16:35:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-09ea82b3-6606-4af7-ab7c-5f7d695e743e tempest-TestInstancesWithCinderVolumes-233006016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2720fa3b-96fa-4808-a90b-6663750f24d4" returned: 1 in 0.435s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:35:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-09ea82b3-6606-4af7-ab7c-5f7d695e743e tempest-TestInstancesWithCinderVolumes-233006016 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2720fa3b-96fa-4808-a90b-6663750f24d4' failed. Not Retrying. {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 16:35:29 devstack cinder-volume[87166]: DEBUG cinder.volume.volume_utils [None req-09ea82b3-6606-4af7-ab7c-5f7d695e743e tempest-TestInstancesWithCinderVolumes-233006016 None] Downloaded image 799fadc5-063a-42f5-9f7d-510fc13d5ecb ((None, [{'url': 'file:///opt/stack/data/glance/images/799fadc5-063a-42f5-9f7d-510fc13d5ecb', 'metadata': {}}])) to volume 2720fa3b-96fa-4808-a90b-6663750f24d4 successfully. {{(pid=87166) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 14 16:35:29 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-09ea82b3-6606-4af7-ab7c-5f7d695e743e tempest-TestInstancesWithCinderVolumes-233006016 None] Temporary image 799fadc5-063a-42f5-9f7d-510fc13d5ecb for user 8b14fec21aaf48808c0ca5afdb578868 is deleted. {{(pid=87166) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 14 16:35:29 devstack cinder-volume[87166]: DEBUG cinder.volume.volume_utils [None req-09ea82b3-6606-4af7-ab7c-5f7d695e743e tempest-TestInstancesWithCinderVolumes-233006016 None] Marking volume 2720fa3b-96fa-4808-a90b-6663750f24d4 as bootable. {{(pid=87166) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 14 16:35:29 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-09ea82b3-6606-4af7-ab7c-5f7d695e743e tempest-TestInstancesWithCinderVolumes-233006016 None] Copying metadata from image 799fadc5-063a-42f5-9f7d-510fc13d5ecb to 2720fa3b-96fa-4808-a90b-6663750f24d4. {{(pid=87166) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 14 16:35:29 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-09ea82b3-6606-4af7-ab7c-5f7d695e743e tempest-TestInstancesWithCinderVolumes-233006016 None] Creating volume glance metadata for volume 2720fa3b-96fa-4808-a90b-6663750f24d4 backed by image 799fadc5-063a-42f5-9f7d-510fc13d5ecb with: {'image_id': '799fadc5-063a-42f5-9f7d-510fc13d5ecb', 'image_name': 'tempest-scenario-img--977216940', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87166) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 14 16:35:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-09ea82b3-6606-4af7-ab7c-5f7d695e743e tempest-TestInstancesWithCinderVolumes-233006016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97986753-2f7f-4083-b694-5ef1d31969b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2720fa3b-96fa-4808-a90b-6663750f24d4', 'volume_size': 1, 'image_id': '799fadc5-063a-42f5-9f7d-510fc13d5ecb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/799fadc5-063a-42f5-9f7d-510fc13d5ecb', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--977216940', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4b597fbf212a4ebf86e324e5cd02c92a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '799fadc5-063a-42f5-9f7d-510fc13d5ecb', 'created_at': datetime.datetime(2026, 7, 14, 14, 35, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 14, 35, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/799fadc5-063a-42f5-9f7d-510fc13d5ecb/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74f7810b71a0>}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:35:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-09ea82b3-6606-4af7-ab7c-5f7d695e743e tempest-TestInstancesWithCinderVolumes-233006016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d4b6eed-3887-4f85-848c-2373e0719b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:35:29 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-09ea82b3-6606-4af7-ab7c-5f7d695e743e tempest-TestInstancesWithCinderVolumes-233006016 None] Volume volume-2720fa3b-96fa-4808-a90b-6663750f24d4 (2720fa3b-96fa-4808-a90b-6663750f24d4): created successfully
Jul 14 16:35:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-09ea82b3-6606-4af7-ab7c-5f7d695e743e tempest-TestInstancesWithCinderVolumes-233006016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d4b6eed-3887-4f85-848c-2373e0719b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:35:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-09ea82b3-6606-4af7-ab7c-5f7d695e743e tempest-TestInstancesWithCinderVolumes-233006016 None] Flow 'volume_create_manager' (19ab2d8a-f74e-4371-b35f-f9fe24ef2da0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:35:29 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-09ea82b3-6606-4af7-ab7c-5f7d695e743e tempest-TestInstancesWithCinderVolumes-233006016 None] Created volume successfully.
Jul 14 16:35:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-f15fc66a-22c3-413a-b7e8-1c08365c3def req-b00250c0-8dbc-431f-8b02-7a51f880b844 tempest-TestShelveInstance-2021071679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:35:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-f15fc66a-22c3-413a-b7e8-1c08365c3def req-b00250c0-8dbc-431f-8b02-7a51f880b844 tempest-TestShelveInstance-2021071679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:35:33 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e6b874-66d0-4693-a235-11dec9c45408]: (4, 'raw') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:35:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-f15fc66a-22c3-413a-b7e8-1c08365c3def req-b00250c0-8dbc-431f-8b02-7a51f880b844 tempest-TestShelveInstance-2021071679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8cca2447-51d6-4611-8fcd-5f9876a9877e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:35:33 devstack sudo[100891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8cca2447-51d6-4611-8fcd-5f9876a9877e
Jul 14 16:35:33 devstack sudo[100891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:35:33 devstack sudo[100891]: pam_unix(sudo:session): session closed for user root
Jul 14 16:35:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-f15fc66a-22c3-413a-b7e8-1c08365c3def req-b00250c0-8dbc-431f-8b02-7a51f880b844 tempest-TestShelveInstance-2021071679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8cca2447-51d6-4611-8fcd-5f9876a9877e" returned: 0 in 0.646s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:35:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-f15fc66a-22c3-413a-b7e8-1c08365c3def req-b00250c0-8dbc-431f-8b02-7a51f880b844 tempest-TestShelveInstance-2021071679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8cca2447-51d6-4611-8fcd-5f9876a9877e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:35:34 devstack sudo[100905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8cca2447-51d6-4611-8fcd-5f9876a9877e
Jul 14 16:35:34 devstack sudo[100905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:35:34 devstack sudo[100905]: pam_unix(sudo:session): session closed for user root
Jul 14 16:35:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-f15fc66a-22c3-413a-b7e8-1c08365c3def req-b00250c0-8dbc-431f-8b02-7a51f880b844 tempest-TestShelveInstance-2021071679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8cca2447-51d6-4611-8fcd-5f9876a9877e" returned: 1 in 0.764s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:35:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-f15fc66a-22c3-413a-b7e8-1c08365c3def req-b00250c0-8dbc-431f-8b02-7a51f880b844 tempest-TestShelveInstance-2021071679 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8cca2447-51d6-4611-8fcd-5f9876a9877e' failed. Not Retrying. {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 16:35:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-f15fc66a-22c3-413a-b7e8-1c08365c3def req-b00250c0-8dbc-431f-8b02-7a51f880b844 tempest-TestShelveInstance-2021071679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.498s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:35:34 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-f15fc66a-22c3-413a-b7e8-1c08365c3def req-b00250c0-8dbc-431f-8b02-7a51f880b844 tempest-TestShelveInstance-2021071679 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052', 'name': 'volume-8cca2447-51d6-4611-8fcd-5f9876a9877e', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6967c87a-7417-4604-9a7b-9c4a6839af42', 'enforce_multipath': True} {{(pid=87166) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 14 16:35:34 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-f15fc66a-22c3-413a-b7e8-1c08365c3def req-b00250c0-8dbc-431f-8b02-7a51f880b844 tempest-TestShelveInstance-2021071679 None] attachment_update completed successfully.
Jul 14 16:35:35 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 16:35:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:35:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:35:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:35:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:35:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:35:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:35:35 devstack sudo[100920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:35:35 devstack sudo[100920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:35:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-106d10a6-25fb-4760-8908-802be12c8cff req-aad18a75-95de-4ca1-bbf2-e55999d6cd6f tempest-TestInstancesWithCinderVolumes-233006016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:35:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-106d10a6-25fb-4760-8908-802be12c8cff req-aad18a75-95de-4ca1-bbf2-e55999d6cd6f tempest-TestInstancesWithCinderVolumes-233006016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:35:35 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[413829df-65f9-4300-a101-c2cb594471a0]: (4, 'raw') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:35:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-106d10a6-25fb-4760-8908-802be12c8cff req-aad18a75-95de-4ca1-bbf2-e55999d6cd6f tempest-TestInstancesWithCinderVolumes-233006016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2720fa3b-96fa-4808-a90b-6663750f24d4 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:35:35 devstack sudo[100923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2720fa3b-96fa-4808-a90b-6663750f24d4
Jul 14 16:35:35 devstack sudo[100923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:35:36 devstack sudo[100920]: pam_unix(sudo:session): session closed for user root
Jul 14 16:35:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.649s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:35:36 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:35:36 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Running periodic task VolumeManager._thread_info {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 16:35:36 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] thread count: 29 {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 14 16:35:36 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] thread info: [<_MainThread(MainThread, started 128606490927232)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128606415432960)>, <Thread(Thread-3 (stat_writer), started daemon 128606378859328)>, <Thread(Rabbit-heartbeat, started daemon 128606379646144)>, <Thread(Thread-5 (_runner), started daemon 128606377685824)>, <Thread(Thread-7 (_runner), started daemon 128606377701888)>, <Thread(fd_logger, started daemon 128606377091392)>, <Thread(privsep_reader, started daemon 128606375782080)>, <Thread(tpool_thread_0, started daemon 128606365607616)>, <Thread(tpool_thread_1, started daemon 128606357214912)>, <Thread(tpool_thread_2, started daemon 128606348822208)>, <Thread(tpool_thread_3, started daemon 128606340413120)>, <Thread(tpool_thread_4, started daemon 128606332004032)>, <Thread(tpool_thread_5, started daemon 128606323594944)>, <Thread(tpool_thread_6, started daemon 128606315185856)>, <Thread(tpool_thread_7, started daemon 128606306776768)>, <Thread(tpool_thread_8, started daemon 128606298367680)>, <Thread(tpool_thread_9, started daemon 128606289958592)>, <Thread(tpool_thread_10, started daemon 128606281549504)>, <Thread(tpool_thread_11, started daemon 128606273140416)>, <Thread(tpool_thread_12, started daemon 128606264731328)>, <Thread(tpool_thread_13, started daemon 128606256322240)>, <Thread(tpool_thread_14, started daemon 128606247913152)>, <Thread(tpool_thread_15, started daemon 128606239504064)>, <Thread(tpool_thread_16, started daemon 128606231094976)>, <Thread(tpool_thread_17, started daemon 128606222685888)>, <Thread(tpool_thread_18, started daemon 128606214276800)>, <Thread(tpool_thread_19, started daemon 128606205867712)>, <Thread(Rabbit-heartbeat, started daemon 128606368169344)>] {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 14 16:35:36 devstack sudo[100923]: pam_unix(sudo:session): session closed for user root
Jul 14 16:35:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-106d10a6-25fb-4760-8908-802be12c8cff req-aad18a75-95de-4ca1-bbf2-e55999d6cd6f tempest-TestInstancesWithCinderVolumes-233006016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2720fa3b-96fa-4808-a90b-6663750f24d4" returned: 0 in 0.548s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:35:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-106d10a6-25fb-4760-8908-802be12c8cff req-aad18a75-95de-4ca1-bbf2-e55999d6cd6f tempest-TestInstancesWithCinderVolumes-233006016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2720fa3b-96fa-4808-a90b-6663750f24d4 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:35:36 devstack sudo[100928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2720fa3b-96fa-4808-a90b-6663750f24d4
Jul 14 16:35:36 devstack sudo[100928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:35:36 devstack sudo[100928]: pam_unix(sudo:session): session closed for user root
Jul 14 16:35:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-106d10a6-25fb-4760-8908-802be12c8cff req-aad18a75-95de-4ca1-bbf2-e55999d6cd6f tempest-TestInstancesWithCinderVolumes-233006016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2720fa3b-96fa-4808-a90b-6663750f24d4" returned: 1 in 0.551s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:35:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-106d10a6-25fb-4760-8908-802be12c8cff req-aad18a75-95de-4ca1-bbf2-e55999d6cd6f tempest-TestInstancesWithCinderVolumes-233006016 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2720fa3b-96fa-4808-a90b-6663750f24d4' failed. Not Retrying. {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 16:35:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-106d10a6-25fb-4760-8908-802be12c8cff req-aad18a75-95de-4ca1-bbf2-e55999d6cd6f tempest-TestInstancesWithCinderVolumes-233006016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.159s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:35:36 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-106d10a6-25fb-4760-8908-802be12c8cff req-aad18a75-95de-4ca1-bbf2-e55999d6cd6f tempest-TestInstancesWithCinderVolumes-233006016 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052', 'name': 'volume-2720fa3b-96fa-4808-a90b-6663750f24d4', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f85212bc-77ed-4e9e-8f9c-d323cf8c6b97', 'enforce_multipath': True} {{(pid=87166) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 14 16:35:37 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-106d10a6-25fb-4760-8908-802be12c8cff req-aad18a75-95de-4ca1-bbf2-e55999d6cd6f tempest-TestInstancesWithCinderVolumes-233006016 None] attachment_update completed successfully.
Jul 14 16:35:47 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:UPDATE=71,cinder:INSERT=38,cinder:SELECT=69,cinder:DELETE=7 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 16:35:47 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:INSERT=28,cinder:UPDATE=98,cinder:SELECT=89,cinder:DELETE=7 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 16:35:53 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-bc961009-5ffc-43ca-a16f-1d900996a25f tempest-VolumesNegativeTest-1086099852 None] Acquiring lock "cinder-008ce108-d562-44c8-b189-511510b0f73f-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:35:53 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-bc961009-5ffc-43ca-a16f-1d900996a25f tempest-VolumesNegativeTest-1086099852 None] Lock "cinder-008ce108-d562-44c8-b189-511510b0f73f-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:35:53 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-bc961009-5ffc-43ca-a16f-1d900996a25f tempest-VolumesNegativeTest-1086099852 None] Acquiring lock "cinder-quobyte-008ce108-d562-44c8-b189-511510b0f73f" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:35:53 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-bc961009-5ffc-43ca-a16f-1d900996a25f tempest-VolumesNegativeTest-1086099852 None] Lock "cinder-quobyte-008ce108-d562-44c8-b189-511510b0f73f" acquired by "delete_volume" :: waited 0.023s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:35:53 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f14431-e7f7-42ce-877d-25d537142689]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:35:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bc961009-5ffc-43ca-a16f-1d900996a25f tempest-VolumesNegativeTest-1086099852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-008ce108-d562-44c8-b189-511510b0f73f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:35:53 devstack sudo[101472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-008ce108-d562-44c8-b189-511510b0f73f
Jul 14 16:35:53 devstack sudo[101472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:35:53 devstack sudo[101472]: pam_unix(sudo:session): session closed for user root
Jul 14 16:35:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bc961009-5ffc-43ca-a16f-1d900996a25f tempest-VolumesNegativeTest-1086099852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-008ce108-d562-44c8-b189-511510b0f73f" returned: 0 in 0.422s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:35:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bc961009-5ffc-43ca-a16f-1d900996a25f tempest-VolumesNegativeTest-1086099852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-008ce108-d562-44c8-b189-511510b0f73f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:35:53 devstack sudo[101477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-008ce108-d562-44c8-b189-511510b0f73f
Jul 14 16:35:53 devstack sudo[101477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:35:54 devstack sudo[101477]: pam_unix(sudo:session): session closed for user root
Jul 14 16:35:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bc961009-5ffc-43ca-a16f-1d900996a25f tempest-VolumesNegativeTest-1086099852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-008ce108-d562-44c8-b189-511510b0f73f" returned: 0 in 0.383s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:35:54 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-bc961009-5ffc-43ca-a16f-1d900996a25f tempest-VolumesNegativeTest-1086099852 None] Lock "cinder-quobyte-008ce108-d562-44c8-b189-511510b0f73f" released by "delete_volume" :: held 0.912s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:35:54 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-bc961009-5ffc-43ca-a16f-1d900996a25f tempest-VolumesNegativeTest-1086099852 None] Created reservations ['161f2ac0-4424-4686-a407-973e0660e8a7', '54792b1c-6a80-4bb9-8319-b4bea8ba9993', '24d27b81-8265-422e-bda4-72fdc270ba1c', 'd899b5ae-c966-4787-887d-0c37561c2969'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:35:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-bc961009-5ffc-43ca-a16f-1d900996a25f tempest-VolumesNegativeTest-1086099852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:35:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-bc961009-5ffc-43ca-a16f-1d900996a25f tempest-VolumesNegativeTest-1086099852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:35:54 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-bc961009-5ffc-43ca-a16f-1d900996a25f tempest-VolumesNegativeTest-1086099852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:35:54 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-bc961009-5ffc-43ca-a16f-1d900996a25f tempest-VolumesNegativeTest-1086099852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:35:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-bc961009-5ffc-43ca-a16f-1d900996a25f tempest-VolumesNegativeTest-1086099852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:35:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bc961009-5ffc-43ca-a16f-1d900996a25f tempest-VolumesNegativeTest-1086099852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:35:54 devstack sudo[101480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:35:54 devstack sudo[101480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:35:55 devstack sudo[101480]: pam_unix(sudo:session): session closed for user root
Jul 14 16:35:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bc961009-5ffc-43ca-a16f-1d900996a25f tempest-VolumesNegativeTest-1086099852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.595s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:35:55 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-bc961009-5ffc-43ca-a16f-1d900996a25f tempest-VolumesNegativeTest-1086099852 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:35:55 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-bc961009-5ffc-43ca-a16f-1d900996a25f tempest-VolumesNegativeTest-1086099852 None] Deleted volume successfully.
Jul 14 16:35:55 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-bc961009-5ffc-43ca-a16f-1d900996a25f tempest-VolumesNegativeTest-1086099852 None] Lock "cinder-008ce108-d562-44c8-b189-511510b0f73f-delete_volume" released by "delete_volume" :: held 1.895s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:36:07 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:SELECT=8,cinder:UPDATE=11,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 16:36:07 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:SELECT=3,cinder:INSERT=1,cinder:UPDATE=6 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 16:36:09 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-30fdfc30-281f-4b36-ba39-7ebc7a90d4f4 tempest-VolumesSnapshotTestJSON-1267003830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:36:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-30fdfc30-281f-4b36-ba39-7ebc7a90d4f4 tempest-VolumesSnapshotTestJSON-1267003830 None] Flow 'volume_create_manager' (8993ff08-bcfe-42b4-8655-74d2c6bf370c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:36:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-30fdfc30-281f-4b36-ba39-7ebc7a90d4f4 tempest-VolumesSnapshotTestJSON-1267003830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3b04498-d805-44c9-adaa-c7a47df79207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:36:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-30fdfc30-281f-4b36-ba39-7ebc7a90d4f4 tempest-VolumesSnapshotTestJSON-1267003830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3b04498-d805-44c9-adaa-c7a47df79207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:36:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1231034245',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70abf183-e8d5-4ed8-a35f-fa471663d562,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65194e8f19bb4338a91cd9f0acf1eb0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:36:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:36:10Z,use_quota=True,user_id='48498ac3871c4da88bbb68565031775f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:36:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-30fdfc30-281f-4b36-ba39-7ebc7a90d4f4 tempest-VolumesSnapshotTestJSON-1267003830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3564b29-3c50-4c0a-94a8-e42c0ec03026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:36:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-30fdfc30-281f-4b36-ba39-7ebc7a90d4f4 tempest-VolumesSnapshotTestJSON-1267003830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3564b29-3c50-4c0a-94a8-e42c0ec03026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:36:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-30fdfc30-281f-4b36-ba39-7ebc7a90d4f4 tempest-VolumesSnapshotTestJSON-1267003830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be3b0f19-3067-43ec-b39e-b8c6c75660b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:36:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-30fdfc30-281f-4b36-ba39-7ebc7a90d4f4 tempest-VolumesSnapshotTestJSON-1267003830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be3b0f19-3067-43ec-b39e-b8c6c75660b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70abf183-e8d5-4ed8-a35f-fa471663d562', 'volume_name': 'volume-70abf183-e8d5-4ed8-a35f-fa471663d562', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:36:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-30fdfc30-281f-4b36-ba39-7ebc7a90d4f4 tempest-VolumesSnapshotTestJSON-1267003830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1a0012e-a3f3-4cfe-bfae-b86aefc4a586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:36:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-30fdfc30-281f-4b36-ba39-7ebc7a90d4f4 tempest-VolumesSnapshotTestJSON-1267003830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1a0012e-a3f3-4cfe-bfae-b86aefc4a586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:36:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-30fdfc30-281f-4b36-ba39-7ebc7a90d4f4 tempest-VolumesSnapshotTestJSON-1267003830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdb5d846-b481-454d-827f-e2fe4c8a9788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:36:10 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-30fdfc30-281f-4b36-ba39-7ebc7a90d4f4 tempest-VolumesSnapshotTestJSON-1267003830 None] Volume 70abf183-e8d5-4ed8-a35f-fa471663d562: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70abf183-e8d5-4ed8-a35f-fa471663d562', 'volume_size': 1}
Jul 14 16:36:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-30fdfc30-281f-4b36-ba39-7ebc7a90d4f4 tempest-VolumesSnapshotTestJSON-1267003830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:36:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-30fdfc30-281f-4b36-ba39-7ebc7a90d4f4 tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:36:10 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-30fdfc30-281f-4b36-ba39-7ebc7a90d4f4 tempest-VolumesSnapshotTestJSON-1267003830 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:36:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1231034245',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70abf183-e8d5-4ed8-a35f-fa471663d562,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65194e8f19bb4338a91cd9f0acf1eb0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:36:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:36:10Z,use_quota=True,user_id='48498ac3871c4da88bbb68565031775f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:36:10 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-30fdfc30-281f-4b36-ba39-7ebc7a90d4f4 tempest-VolumesSnapshotTestJSON-1267003830 None] Creating volume 70abf183-e8d5-4ed8-a35f-fa471663d562 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:36:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-30fdfc30-281f-4b36-ba39-7ebc7a90d4f4 tempest-VolumesSnapshotTestJSON-1267003830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:36:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-30fdfc30-281f-4b36-ba39-7ebc7a90d4f4 tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:36:10 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-30fdfc30-281f-4b36-ba39-7ebc7a90d4f4 tempest-VolumesSnapshotTestJSON-1267003830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:36:10 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-30fdfc30-281f-4b36-ba39-7ebc7a90d4f4 tempest-VolumesSnapshotTestJSON-1267003830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:36:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-30fdfc30-281f-4b36-ba39-7ebc7a90d4f4 tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:36:10 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-30fdfc30-281f-4b36-ba39-7ebc7a90d4f4 tempest-VolumesSnapshotTestJSON-1267003830 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:36:10 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-30fdfc30-281f-4b36-ba39-7ebc7a90d4f4 tempest-VolumesSnapshotTestJSON-1267003830 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:36:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-30fdfc30-281f-4b36-ba39-7ebc7a90d4f4 tempest-VolumesSnapshotTestJSON-1267003830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-70abf183-e8d5-4ed8-a35f-fa471663d562 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:36:10 devstack sudo[101637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-70abf183-e8d5-4ed8-a35f-fa471663d562 1073741824
Jul 14 16:36:10 devstack sudo[101637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:36:10 devstack sudo[101637]: pam_unix(sudo:session): session closed for user root
Jul 14 16:36:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-30fdfc30-281f-4b36-ba39-7ebc7a90d4f4 tempest-VolumesSnapshotTestJSON-1267003830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-70abf183-e8d5-4ed8-a35f-fa471663d562 1073741824" returned: 0 in 0.510s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:36:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-30fdfc30-281f-4b36-ba39-7ebc7a90d4f4 tempest-VolumesSnapshotTestJSON-1267003830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-70abf183-e8d5-4ed8-a35f-fa471663d562 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:36:10 devstack sudo[101644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-70abf183-e8d5-4ed8-a35f-fa471663d562
Jul 14 16:36:10 devstack sudo[101644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:36:10 devstack sudo[101644]: pam_unix(sudo:session): session closed for user root
Jul 14 16:36:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-30fdfc30-281f-4b36-ba39-7ebc7a90d4f4 tempest-VolumesSnapshotTestJSON-1267003830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-70abf183-e8d5-4ed8-a35f-fa471663d562" returned: 0 in 0.288s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:36:10 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-30fdfc30-281f-4b36-ba39-7ebc7a90d4f4 tempest-VolumesSnapshotTestJSON-1267003830 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:36:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-30fdfc30-281f-4b36-ba39-7ebc7a90d4f4 tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:36:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-30fdfc30-281f-4b36-ba39-7ebc7a90d4f4 tempest-VolumesSnapshotTestJSON-1267003830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdb5d846-b481-454d-827f-e2fe4c8a9788) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70abf183-e8d5-4ed8-a35f-fa471663d562', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:36:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-30fdfc30-281f-4b36-ba39-7ebc7a90d4f4 tempest-VolumesSnapshotTestJSON-1267003830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cab0e642-f3ee-43ec-a03b-7fbf448641f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:36:10 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-30fdfc30-281f-4b36-ba39-7ebc7a90d4f4 tempest-VolumesSnapshotTestJSON-1267003830 None] Volume volume-70abf183-e8d5-4ed8-a35f-fa471663d562 (70abf183-e8d5-4ed8-a35f-fa471663d562): created successfully
Jul 14 16:36:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-30fdfc30-281f-4b36-ba39-7ebc7a90d4f4 tempest-VolumesSnapshotTestJSON-1267003830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cab0e642-f3ee-43ec-a03b-7fbf448641f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:36:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-30fdfc30-281f-4b36-ba39-7ebc7a90d4f4 tempest-VolumesSnapshotTestJSON-1267003830 None] Flow 'volume_create_manager' (8993ff08-bcfe-42b4-8655-74d2c6bf370c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:36:10 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-30fdfc30-281f-4b36-ba39-7ebc7a90d4f4 tempest-VolumesSnapshotTestJSON-1267003830 None] Created volume successfully.
Jul 14 16:36:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-22f38036-e2a1-4708-bc1b-46a322d73fee tempest-VolumesSnapshotTestJSON-1267003830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:36:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-22f38036-e2a1-4708-bc1b-46a322d73fee tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:36:12 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-22f38036-e2a1-4708-bc1b-46a322d73fee tempest-VolumesSnapshotTestJSON-1267003830 None] Creating offline snapshot a1e1301e-1e00-444d-b764-b969b8d954b3 of volume 70abf183-e8d5-4ed8-a35f-fa471663d562 {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 16:36:12 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1762163-e9dc-4354-b043-0915230434e3]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:36:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-22f38036-e2a1-4708-bc1b-46a322d73fee tempest-VolumesSnapshotTestJSON-1267003830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-70abf183-e8d5-4ed8-a35f-fa471663d562 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:36:12 devstack sudo[101661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-70abf183-e8d5-4ed8-a35f-fa471663d562
Jul 14 16:36:12 devstack sudo[101661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:36:12 devstack sudo[101661]: pam_unix(sudo:session): session closed for user root
Jul 14 16:36:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-22f38036-e2a1-4708-bc1b-46a322d73fee tempest-VolumesSnapshotTestJSON-1267003830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-70abf183-e8d5-4ed8-a35f-fa471663d562" returned: 0 in 0.432s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:36:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-22f38036-e2a1-4708-bc1b-46a322d73fee tempest-VolumesSnapshotTestJSON-1267003830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-70abf183-e8d5-4ed8-a35f-fa471663d562,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-70abf183-e8d5-4ed8-a35f-fa471663d562.a1e1301e-1e00-444d-b764-b969b8d954b3 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:36:12 devstack sudo[101674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-70abf183-e8d5-4ed8-a35f-fa471663d562,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-70abf183-e8d5-4ed8-a35f-fa471663d562.a1e1301e-1e00-444d-b764-b969b8d954b3 1G
Jul 14 16:36:12 devstack sudo[101674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:36:13 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-f04c285e-fb44-4ac9-a1fe-ad58b3485f90 req-7132d35b-52dc-4586-8606-4365bd363028 tempest-TestShelveInstance-2021071679 None] Terminate volume connection completed successfully.
Jul 14 16:36:13 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-f04c285e-fb44-4ac9-a1fe-ad58b3485f90 req-7132d35b-52dc-4586-8606-4365bd363028 tempest-TestShelveInstance-2021071679 None] Deleting attachment 6967c87a-7417-4604-9a7b-9c4a6839af42. {{(pid=87166) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 14 16:36:13 devstack sudo[101674]: pam_unix(sudo:session): session closed for user root
Jul 14 16:36:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-22f38036-e2a1-4708-bc1b-46a322d73fee tempest-VolumesSnapshotTestJSON-1267003830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-70abf183-e8d5-4ed8-a35f-fa471663d562,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-70abf183-e8d5-4ed8-a35f-fa471663d562.a1e1301e-1e00-444d-b764-b969b8d954b3 1G" returned: 0 in 0.601s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:36:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-22f38036-e2a1-4708-bc1b-46a322d73fee tempest-VolumesSnapshotTestJSON-1267003830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70abf183-e8d5-4ed8-a35f-fa471663d562 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-70abf183-e8d5-4ed8-a35f-fa471663d562.a1e1301e-1e00-444d-b764-b969b8d954b3 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:36:13 devstack sudo[101692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70abf183-e8d5-4ed8-a35f-fa471663d562 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-70abf183-e8d5-4ed8-a35f-fa471663d562.a1e1301e-1e00-444d-b764-b969b8d954b3
Jul 14 16:36:13 devstack sudo[101692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:36:13 devstack sudo[101692]: pam_unix(sudo:session): session closed for user root
Jul 14 16:36:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-22f38036-e2a1-4708-bc1b-46a322d73fee tempest-VolumesSnapshotTestJSON-1267003830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70abf183-e8d5-4ed8-a35f-fa471663d562 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-70abf183-e8d5-4ed8-a35f-fa471663d562.a1e1301e-1e00-444d-b764-b969b8d954b3" returned: 0 in 0.324s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:36:13 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-22f38036-e2a1-4708-bc1b-46a322d73fee tempest-VolumesSnapshotTestJSON-1267003830 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-70abf183-e8d5-4ed8-a35f-fa471663d562.a1e1301e-1e00-444d-b764-b969b8d954b3 is being set with open permissions: ugo+rw
Jul 14 16:36:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-22f38036-e2a1-4708-bc1b-46a322d73fee tempest-VolumesSnapshotTestJSON-1267003830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-70abf183-e8d5-4ed8-a35f-fa471663d562.a1e1301e-1e00-444d-b764-b969b8d954b3 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:36:13 devstack sudo[101697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-70abf183-e8d5-4ed8-a35f-fa471663d562.a1e1301e-1e00-444d-b764-b969b8d954b3
Jul 14 16:36:13 devstack sudo[101697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:36:13 devstack sudo[101697]: pam_unix(sudo:session): session closed for user root
Jul 14 16:36:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-22f38036-e2a1-4708-bc1b-46a322d73fee tempest-VolumesSnapshotTestJSON-1267003830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-70abf183-e8d5-4ed8-a35f-fa471663d562.a1e1301e-1e00-444d-b764-b969b8d954b3" returned: 0 in 0.253s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:36:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-22f38036-e2a1-4708-bc1b-46a322d73fee tempest-VolumesSnapshotTestJSON-1267003830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-70abf183-e8d5-4ed8-a35f-fa471663d562.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:36:14 devstack sudo[101700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-70abf183-e8d5-4ed8-a35f-fa471663d562.info
Jul 14 16:36:14 devstack sudo[101700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:36:14 devstack sudo[101700]: pam_unix(sudo:session): session closed for user root
Jul 14 16:36:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-22f38036-e2a1-4708-bc1b-46a322d73fee tempest-VolumesSnapshotTestJSON-1267003830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-70abf183-e8d5-4ed8-a35f-fa471663d562.info" returned: 0 in 0.251s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:36:14 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-22f38036-e2a1-4708-bc1b-46a322d73fee tempest-VolumesSnapshotTestJSON-1267003830 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-70abf183-e8d5-4ed8-a35f-fa471663d562.info is being set with open permissions: ugo+rw
Jul 14 16:36:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-22f38036-e2a1-4708-bc1b-46a322d73fee tempest-VolumesSnapshotTestJSON-1267003830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-70abf183-e8d5-4ed8-a35f-fa471663d562.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:36:14 devstack sudo[101703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-70abf183-e8d5-4ed8-a35f-fa471663d562.info
Jul 14 16:36:14 devstack sudo[101703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:36:14 devstack sudo[101703]: pam_unix(sudo:session): session closed for user root
Jul 14 16:36:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-22f38036-e2a1-4708-bc1b-46a322d73fee tempest-VolumesSnapshotTestJSON-1267003830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-70abf183-e8d5-4ed8-a35f-fa471663d562.info" returned: 0 in 0.245s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:36:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-22f38036-e2a1-4708-bc1b-46a322d73fee tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.195s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:36:14 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-22f38036-e2a1-4708-bc1b-46a322d73fee tempest-VolumesSnapshotTestJSON-1267003830 None] Create snapshot completed successfully
Jul 14 16:36:15 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d8af226b-9f6e-4d9a-96c9-b5d1098571a9 tempest-VolumesSnapshotTestJSON-1267003830 None] Acquiring lock "cinder-a1e1301e-1e00-444d-b764-b969b8d954b3-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:36:15 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d8af226b-9f6e-4d9a-96c9-b5d1098571a9 tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "cinder-a1e1301e-1e00-444d-b764-b969b8d954b3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:36:15 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d8af226b-9f6e-4d9a-96c9-b5d1098571a9 tempest-VolumesSnapshotTestJSON-1267003830 None] Acquiring lock "cinder-quobyte-70abf183-e8d5-4ed8-a35f-fa471663d562" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:36:15 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d8af226b-9f6e-4d9a-96c9-b5d1098571a9 tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "cinder-quobyte-70abf183-e8d5-4ed8-a35f-fa471663d562" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:36:15 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d8af226b-9f6e-4d9a-96c9-b5d1098571a9 tempest-VolumesSnapshotTestJSON-1267003830 None] Acquiring lock "cinder-quobyte-a1e1301e-1e00-444d-b764-b969b8d954b3" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:36:15 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d8af226b-9f6e-4d9a-96c9-b5d1098571a9 tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "cinder-quobyte-a1e1301e-1e00-444d-b764-b969b8d954b3" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:36:15 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-d8af226b-9f6e-4d9a-96c9-b5d1098571a9 tempest-VolumesSnapshotTestJSON-1267003830 None] Deleting offline snapshot a1e1301e-1e00-444d-b764-b969b8d954b3 of volume 70abf183-e8d5-4ed8-a35f-fa471663d562 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 16:36:15 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-d8af226b-9f6e-4d9a-96c9-b5d1098571a9 tempest-VolumesSnapshotTestJSON-1267003830 None] snapshot_file for this snap is: volume-70abf183-e8d5-4ed8-a35f-fa471663d562.a1e1301e-1e00-444d-b764-b969b8d954b3 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 16:36:15 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b60415b-da47-4e3a-a7cb-fd7be688c635]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:36:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d8af226b-9f6e-4d9a-96c9-b5d1098571a9 tempest-VolumesSnapshotTestJSON-1267003830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-70abf183-e8d5-4ed8-a35f-fa471663d562.a1e1301e-1e00-444d-b764-b969b8d954b3 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:36:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-2b6df443-8a6e-4c69-83df-90860e94b9d9 req-db907cbf-c686-4f66-b3ce-548c6bc81364 tempest-TestInstancesWithCinderVolumes-233006016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:36:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-2b6df443-8a6e-4c69-83df-90860e94b9d9 req-db907cbf-c686-4f66-b3ce-548c6bc81364 tempest-TestInstancesWithCinderVolumes-233006016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:36:15 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8578873-ed74-4e72-b0e0-915e00e66098]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:36:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-2b6df443-8a6e-4c69-83df-90860e94b9d9 req-db907cbf-c686-4f66-b3ce-548c6bc81364 tempest-TestInstancesWithCinderVolumes-233006016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-26538d81-51f2-42f7-8dac-0b8cc9f6cf87 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:36:15 devstack sudo[101724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-70abf183-e8d5-4ed8-a35f-fa471663d562.a1e1301e-1e00-444d-b764-b969b8d954b3
Jul 14 16:36:15 devstack sudo[101724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:36:15 devstack sudo[101725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-26538d81-51f2-42f7-8dac-0b8cc9f6cf87
Jul 14 16:36:15 devstack sudo[101725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:36:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-6c6e4a20-30ac-4fe5-8b5f-3f7be06198ff req-428ae51d-4a7e-42d9-be62-f623841d76fe tempest-TestShelveInstance-2021071679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:36:16 devstack sudo[101724]: pam_unix(sudo:session): session closed for user root
Jul 14 16:36:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d8af226b-9f6e-4d9a-96c9-b5d1098571a9 tempest-VolumesSnapshotTestJSON-1267003830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-70abf183-e8d5-4ed8-a35f-fa471663d562.a1e1301e-1e00-444d-b764-b969b8d954b3" returned: 0 in 0.417s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:36:16 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-d8af226b-9f6e-4d9a-96c9-b5d1098571a9 tempest-VolumesSnapshotTestJSON-1267003830 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70abf183-e8d5-4ed8-a35f-fa471663d562(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 16:36:16 devstack sudo[101725]: pam_unix(sudo:session): session closed for user root
Jul 14 16:36:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-2b6df443-8a6e-4c69-83df-90860e94b9d9 req-db907cbf-c686-4f66-b3ce-548c6bc81364 tempest-TestInstancesWithCinderVolumes-233006016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-26538d81-51f2-42f7-8dac-0b8cc9f6cf87" returned: 0 in 0.405s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:36:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-2b6df443-8a6e-4c69-83df-90860e94b9d9 req-db907cbf-c686-4f66-b3ce-548c6bc81364 tempest-TestInstancesWithCinderVolumes-233006016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.427s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:36:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-6c6e4a20-30ac-4fe5-8b5f-3f7be06198ff req-428ae51d-4a7e-42d9-be62-f623841d76fe tempest-TestShelveInstance-2021071679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.143s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:36:16 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c52d72-b7bb-49c2-a508-94fb3adea550]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:36:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d8af226b-9f6e-4d9a-96c9-b5d1098571a9 tempest-VolumesSnapshotTestJSON-1267003830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-70abf183-e8d5-4ed8-a35f-fa471663d562 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:36:16 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb92d86-25af-4916-876d-96f0abc02771]: (4, 'raw') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:36:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-6c6e4a20-30ac-4fe5-8b5f-3f7be06198ff req-428ae51d-4a7e-42d9-be62-f623841d76fe tempest-TestShelveInstance-2021071679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8cca2447-51d6-4611-8fcd-5f9876a9877e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:36:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-2b6df443-8a6e-4c69-83df-90860e94b9d9 req-db907cbf-c686-4f66-b3ce-548c6bc81364 tempest-TestInstancesWithCinderVolumes-233006016 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052', 'name': 'volume-26538d81-51f2-42f7-8dac-0b8cc9f6cf87', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ea44e2ee-67ac-4492-824c-919395edd5ac', 'enforce_multipath': True} {{(pid=87166) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 14 16:36:16 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-2b6df443-8a6e-4c69-83df-90860e94b9d9 req-db907cbf-c686-4f66-b3ce-548c6bc81364 tempest-TestInstancesWithCinderVolumes-233006016 None] attachment_update completed successfully.
Jul 14 16:36:16 devstack sudo[101742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-70abf183-e8d5-4ed8-a35f-fa471663d562
Jul 14 16:36:16 devstack sudo[101742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:36:16 devstack sudo[101743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8cca2447-51d6-4611-8fcd-5f9876a9877e
Jul 14 16:36:16 devstack sudo[101743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:36:16 devstack sudo[101742]: pam_unix(sudo:session): session closed for user root
Jul 14 16:36:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d8af226b-9f6e-4d9a-96c9-b5d1098571a9 tempest-VolumesSnapshotTestJSON-1267003830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-70abf183-e8d5-4ed8-a35f-fa471663d562" returned: 0 in 0.432s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:36:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d8af226b-9f6e-4d9a-96c9-b5d1098571a9 tempest-VolumesSnapshotTestJSON-1267003830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-70abf183-e8d5-4ed8-a35f-fa471663d562.a1e1301e-1e00-444d-b764-b969b8d954b3 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:36:16 devstack sudo[101754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-70abf183-e8d5-4ed8-a35f-fa471663d562.a1e1301e-1e00-444d-b764-b969b8d954b3
Jul 14 16:36:16 devstack sudo[101754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:36:16 devstack sudo[101743]: pam_unix(sudo:session): session closed for user root
Jul 14 16:36:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-6c6e4a20-30ac-4fe5-8b5f-3f7be06198ff req-428ae51d-4a7e-42d9-be62-f623841d76fe tempest-TestShelveInstance-2021071679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8cca2447-51d6-4611-8fcd-5f9876a9877e" returned: 0 in 0.484s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:36:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-6c6e4a20-30ac-4fe5-8b5f-3f7be06198ff req-428ae51d-4a7e-42d9-be62-f623841d76fe tempest-TestShelveInstance-2021071679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8cca2447-51d6-4611-8fcd-5f9876a9877e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:36:16 devstack sudo[101756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8cca2447-51d6-4611-8fcd-5f9876a9877e
Jul 14 16:36:16 devstack sudo[101756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:36:17 devstack sudo[101754]: pam_unix(sudo:session): session closed for user root
Jul 14 16:36:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d8af226b-9f6e-4d9a-96c9-b5d1098571a9 tempest-VolumesSnapshotTestJSON-1267003830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-70abf183-e8d5-4ed8-a35f-fa471663d562.a1e1301e-1e00-444d-b764-b969b8d954b3" returned: 0 in 0.412s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:36:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d8af226b-9f6e-4d9a-96c9-b5d1098571a9 tempest-VolumesSnapshotTestJSON-1267003830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-70abf183-e8d5-4ed8-a35f-fa471663d562.a1e1301e-1e00-444d-b764-b969b8d954b3 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:36:17 devstack sudo[101762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-70abf183-e8d5-4ed8-a35f-fa471663d562.a1e1301e-1e00-444d-b764-b969b8d954b3
Jul 14 16:36:17 devstack sudo[101762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:36:17 devstack sudo[101756]: pam_unix(sudo:session): session closed for user root
Jul 14 16:36:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-6c6e4a20-30ac-4fe5-8b5f-3f7be06198ff req-428ae51d-4a7e-42d9-be62-f623841d76fe tempest-TestShelveInstance-2021071679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8cca2447-51d6-4611-8fcd-5f9876a9877e" returned: 1 in 0.383s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:36:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-6c6e4a20-30ac-4fe5-8b5f-3f7be06198ff req-428ae51d-4a7e-42d9-be62-f623841d76fe tempest-TestShelveInstance-2021071679 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8cca2447-51d6-4611-8fcd-5f9876a9877e' failed. Not Retrying. {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 16:36:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-6c6e4a20-30ac-4fe5-8b5f-3f7be06198ff req-428ae51d-4a7e-42d9-be62-f623841d76fe tempest-TestShelveInstance-2021071679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.926s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:36:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-6c6e4a20-30ac-4fe5-8b5f-3f7be06198ff req-428ae51d-4a7e-42d9-be62-f623841d76fe tempest-TestShelveInstance-2021071679 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052', 'name': 'volume-8cca2447-51d6-4611-8fcd-5f9876a9877e', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f6e1fde1-facd-4c78-b577-d61f8102ea68', 'enforce_multipath': True} {{(pid=87166) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 14 16:36:17 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-6c6e4a20-30ac-4fe5-8b5f-3f7be06198ff req-428ae51d-4a7e-42d9-be62-f623841d76fe tempest-TestShelveInstance-2021071679 None] attachment_update completed successfully.
Jul 14 16:36:17 devstack sudo[101762]: pam_unix(sudo:session): session closed for user root
Jul 14 16:36:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d8af226b-9f6e-4d9a-96c9-b5d1098571a9 tempest-VolumesSnapshotTestJSON-1267003830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-70abf183-e8d5-4ed8-a35f-fa471663d562.a1e1301e-1e00-444d-b764-b969b8d954b3" returned: 0 in 0.267s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:36:17 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d8af226b-9f6e-4d9a-96c9-b5d1098571a9 tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "cinder-quobyte-a1e1301e-1e00-444d-b764-b969b8d954b3" released by "_delete_snapshot" :: held 1.677s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:36:17 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d8af226b-9f6e-4d9a-96c9-b5d1098571a9 tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "cinder-quobyte-70abf183-e8d5-4ed8-a35f-fa471663d562" released by "delete_snapshot" :: held 1.707s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:36:17 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-d8af226b-9f6e-4d9a-96c9-b5d1098571a9 tempest-VolumesSnapshotTestJSON-1267003830 None] Created reservations ['5d4d1302-be49-422d-9036-ea62a7506b5a', '33ba4839-7c4b-4e29-ae5e-8db1feca7cb3', 'bbd83057-2ede-4ba3-8a56-53eb80f40761', '604472e1-1cac-401c-bbb8-b8054dcbf7a1'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:36:17 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-d8af226b-9f6e-4d9a-96c9-b5d1098571a9 tempest-VolumesSnapshotTestJSON-1267003830 None] Delete snapshot completed successfully.
Jul 14 16:36:17 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d8af226b-9f6e-4d9a-96c9-b5d1098571a9 tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "cinder-a1e1301e-1e00-444d-b764-b969b8d954b3-delete_snapshot" released by "delete_snapshot" :: held 1.938s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:36:18 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1087f60-c593-4311-9efa-34d153b72d81 tempest-VolumesSnapshotTestJSON-1267003830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:36:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f1087f60-c593-4311-9efa-34d153b72d81 tempest-VolumesSnapshotTestJSON-1267003830 None] Flow 'volume_create_manager' (96e8f74f-fed1-410f-bec8-683a91dc0290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:36:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f1087f60-c593-4311-9efa-34d153b72d81 tempest-VolumesSnapshotTestJSON-1267003830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4add51ae-1061-4a5c-ae79-203c5c10513a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:36:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f1087f60-c593-4311-9efa-34d153b72d81 tempest-VolumesSnapshotTestJSON-1267003830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4add51ae-1061-4a5c-ae79-203c5c10513a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:36:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1203856204',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39540946-977f-423a-9994-a11302ff0aae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65194e8f19bb4338a91cd9f0acf1eb0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:36:18Z,use_quota=True,user_id='48498ac3871c4da88bbb68565031775f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:36:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f1087f60-c593-4311-9efa-34d153b72d81 tempest-VolumesSnapshotTestJSON-1267003830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48e15549-f5a8-4450-ad8c-caf35df5c197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:36:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f1087f60-c593-4311-9efa-34d153b72d81 tempest-VolumesSnapshotTestJSON-1267003830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48e15549-f5a8-4450-ad8c-caf35df5c197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:36:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f1087f60-c593-4311-9efa-34d153b72d81 tempest-VolumesSnapshotTestJSON-1267003830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87a44cb8-9481-4af5-8bcc-dd6455483ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:36:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f1087f60-c593-4311-9efa-34d153b72d81 tempest-VolumesSnapshotTestJSON-1267003830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87a44cb8-9481-4af5-8bcc-dd6455483ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39540946-977f-423a-9994-a11302ff0aae', 'volume_name': 'volume-39540946-977f-423a-9994-a11302ff0aae', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:36:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f1087f60-c593-4311-9efa-34d153b72d81 tempest-VolumesSnapshotTestJSON-1267003830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (045f38c8-2fcd-469e-bbb1-73990625fed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:36:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f1087f60-c593-4311-9efa-34d153b72d81 tempest-VolumesSnapshotTestJSON-1267003830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (045f38c8-2fcd-469e-bbb1-73990625fed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:36:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f1087f60-c593-4311-9efa-34d153b72d81 tempest-VolumesSnapshotTestJSON-1267003830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (942acfc3-5ca5-4cc9-b860-7be60707c4e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:36:18 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-f1087f60-c593-4311-9efa-34d153b72d81 tempest-VolumesSnapshotTestJSON-1267003830 None] Volume 39540946-977f-423a-9994-a11302ff0aae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39540946-977f-423a-9994-a11302ff0aae', 'volume_size': 1}
Jul 14 16:36:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f1087f60-c593-4311-9efa-34d153b72d81 tempest-VolumesSnapshotTestJSON-1267003830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:36:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f1087f60-c593-4311-9efa-34d153b72d81 tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:36:18 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f1087f60-c593-4311-9efa-34d153b72d81 tempest-VolumesSnapshotTestJSON-1267003830 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:36:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1203856204',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39540946-977f-423a-9994-a11302ff0aae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65194e8f19bb4338a91cd9f0acf1eb0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:36:18Z,use_quota=True,user_id='48498ac3871c4da88bbb68565031775f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:36:18 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-f1087f60-c593-4311-9efa-34d153b72d81 tempest-VolumesSnapshotTestJSON-1267003830 None] Creating volume 39540946-977f-423a-9994-a11302ff0aae {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:36:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f1087f60-c593-4311-9efa-34d153b72d81 tempest-VolumesSnapshotTestJSON-1267003830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:36:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f1087f60-c593-4311-9efa-34d153b72d81 tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:36:18 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f1087f60-c593-4311-9efa-34d153b72d81 tempest-VolumesSnapshotTestJSON-1267003830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:36:18 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f1087f60-c593-4311-9efa-34d153b72d81 tempest-VolumesSnapshotTestJSON-1267003830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:36:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f1087f60-c593-4311-9efa-34d153b72d81 tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:36:18 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f1087f60-c593-4311-9efa-34d153b72d81 tempest-VolumesSnapshotTestJSON-1267003830 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:36:18 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-f1087f60-c593-4311-9efa-34d153b72d81 tempest-VolumesSnapshotTestJSON-1267003830 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:36:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f1087f60-c593-4311-9efa-34d153b72d81 tempest-VolumesSnapshotTestJSON-1267003830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-39540946-977f-423a-9994-a11302ff0aae 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:36:18 devstack sudo[101776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-39540946-977f-423a-9994-a11302ff0aae 1073741824
Jul 14 16:36:18 devstack sudo[101776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:36:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-4b01b064-09e2-41ee-9227-91af651ae0ab req-e378156f-236d-4291-80a1-ee48b8da73f2 tempest-TestInstancesWithCinderVolumes-233006016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:36:19 devstack sudo[101776]: pam_unix(sudo:session): session closed for user root
Jul 14 16:36:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f1087f60-c593-4311-9efa-34d153b72d81 tempest-VolumesSnapshotTestJSON-1267003830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-39540946-977f-423a-9994-a11302ff0aae 1073741824" returned: 0 in 0.576s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:36:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f1087f60-c593-4311-9efa-34d153b72d81 tempest-VolumesSnapshotTestJSON-1267003830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-39540946-977f-423a-9994-a11302ff0aae {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:36:19 devstack sudo[101791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-39540946-977f-423a-9994-a11302ff0aae
Jul 14 16:36:19 devstack sudo[101791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:36:19 devstack sudo[101791]: pam_unix(sudo:session): session closed for user root
Jul 14 16:36:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f1087f60-c593-4311-9efa-34d153b72d81 tempest-VolumesSnapshotTestJSON-1267003830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-39540946-977f-423a-9994-a11302ff0aae" returned: 0 in 0.281s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:36:19 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f1087f60-c593-4311-9efa-34d153b72d81 tempest-VolumesSnapshotTestJSON-1267003830 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:36:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f1087f60-c593-4311-9efa-34d153b72d81 tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:36:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-4b01b064-09e2-41ee-9227-91af651ae0ab req-e378156f-236d-4291-80a1-ee48b8da73f2 tempest-TestInstancesWithCinderVolumes-233006016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.483s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:36:19 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f1087f60-c593-4311-9efa-34d153b72d81 tempest-VolumesSnapshotTestJSON-1267003830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (942acfc3-5ca5-4cc9-b860-7be60707c4e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39540946-977f-423a-9994-a11302ff0aae', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:36:19 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f1087f60-c593-4311-9efa-34d153b72d81 tempest-VolumesSnapshotTestJSON-1267003830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b6e1bd7-d9ef-4bde-af91-38b2343deb0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:36:19 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[323294a7-8a08-4ca1-b985-dbf87f42f6aa]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:36:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-4b01b064-09e2-41ee-9227-91af651ae0ab req-e378156f-236d-4291-80a1-ee48b8da73f2 tempest-TestInstancesWithCinderVolumes-233006016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-309b338a-6d5f-432c-b189-9abe7111c154 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:36:19 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-f1087f60-c593-4311-9efa-34d153b72d81 tempest-VolumesSnapshotTestJSON-1267003830 None] Volume volume-39540946-977f-423a-9994-a11302ff0aae (39540946-977f-423a-9994-a11302ff0aae): created successfully
Jul 14 16:36:19 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f1087f60-c593-4311-9efa-34d153b72d81 tempest-VolumesSnapshotTestJSON-1267003830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b6e1bd7-d9ef-4bde-af91-38b2343deb0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:36:19 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f1087f60-c593-4311-9efa-34d153b72d81 tempest-VolumesSnapshotTestJSON-1267003830 None] Flow 'volume_create_manager' (96e8f74f-fed1-410f-bec8-683a91dc0290) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:36:19 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-f1087f60-c593-4311-9efa-34d153b72d81 tempest-VolumesSnapshotTestJSON-1267003830 None] Created volume successfully.
Jul 14 16:36:19 devstack sudo[101795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-309b338a-6d5f-432c-b189-9abe7111c154
Jul 14 16:36:19 devstack sudo[101795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:36:19 devstack sudo[101795]: pam_unix(sudo:session): session closed for user root
Jul 14 16:36:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-4b01b064-09e2-41ee-9227-91af651ae0ab req-e378156f-236d-4291-80a1-ee48b8da73f2 tempest-TestInstancesWithCinderVolumes-233006016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-309b338a-6d5f-432c-b189-9abe7111c154" returned: 0 in 0.421s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:36:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-4b01b064-09e2-41ee-9227-91af651ae0ab req-e378156f-236d-4291-80a1-ee48b8da73f2 tempest-TestInstancesWithCinderVolumes-233006016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.449s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:36:20 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-4b01b064-09e2-41ee-9227-91af651ae0ab req-e378156f-236d-4291-80a1-ee48b8da73f2 tempest-TestInstancesWithCinderVolumes-233006016 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052', 'name': 'volume-309b338a-6d5f-432c-b189-9abe7111c154', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8d94bd18-e1ac-47b6-a70c-3c5bf120c4cf', 'enforce_multipath': True} {{(pid=87166) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 14 16:36:20 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-4b01b064-09e2-41ee-9227-91af651ae0ab req-e378156f-236d-4291-80a1-ee48b8da73f2 tempest-TestInstancesWithCinderVolumes-233006016 None] attachment_update completed successfully.
Jul 14 16:36:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b351d622-a058-428e-b7fd-ea5a27a023fb tempest-VolumesSnapshotTestJSON-1267003830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:36:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b351d622-a058-428e-b7fd-ea5a27a023fb tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:36:21 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-b351d622-a058-428e-b7fd-ea5a27a023fb tempest-VolumesSnapshotTestJSON-1267003830 None] Creating offline snapshot 827c9ca2-496b-4250-b024-da0b082bc0ae of volume 39540946-977f-423a-9994-a11302ff0aae {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 16:36:21 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f652bc-492b-40ab-b3c7-fbf084876fb4]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:36:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b351d622-a058-428e-b7fd-ea5a27a023fb tempest-VolumesSnapshotTestJSON-1267003830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-39540946-977f-423a-9994-a11302ff0aae {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:36:21 devstack sudo[101862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-39540946-977f-423a-9994-a11302ff0aae
Jul 14 16:36:21 devstack sudo[101862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:36:21 devstack sudo[101862]: pam_unix(sudo:session): session closed for user root
Jul 14 16:36:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b351d622-a058-428e-b7fd-ea5a27a023fb tempest-VolumesSnapshotTestJSON-1267003830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-39540946-977f-423a-9994-a11302ff0aae" returned: 0 in 0.530s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:36:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b351d622-a058-428e-b7fd-ea5a27a023fb tempest-VolumesSnapshotTestJSON-1267003830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-39540946-977f-423a-9994-a11302ff0aae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-39540946-977f-423a-9994-a11302ff0aae.827c9ca2-496b-4250-b024-da0b082bc0ae 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:36:21 devstack sudo[101872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-39540946-977f-423a-9994-a11302ff0aae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-39540946-977f-423a-9994-a11302ff0aae.827c9ca2-496b-4250-b024-da0b082bc0ae 1G
Jul 14 16:36:21 devstack sudo[101872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:36:22 devstack sudo[101872]: pam_unix(sudo:session): session closed for user root
Jul 14 16:36:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b351d622-a058-428e-b7fd-ea5a27a023fb tempest-VolumesSnapshotTestJSON-1267003830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-39540946-977f-423a-9994-a11302ff0aae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-39540946-977f-423a-9994-a11302ff0aae.827c9ca2-496b-4250-b024-da0b082bc0ae 1G" returned: 0 in 0.542s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:36:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b351d622-a058-428e-b7fd-ea5a27a023fb tempest-VolumesSnapshotTestJSON-1267003830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39540946-977f-423a-9994-a11302ff0aae -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-39540946-977f-423a-9994-a11302ff0aae.827c9ca2-496b-4250-b024-da0b082bc0ae {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:36:22 devstack sudo[101880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39540946-977f-423a-9994-a11302ff0aae -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-39540946-977f-423a-9994-a11302ff0aae.827c9ca2-496b-4250-b024-da0b082bc0ae
Jul 14 16:36:22 devstack sudo[101880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:36:22 devstack sudo[101880]: pam_unix(sudo:session): session closed for user root
Jul 14 16:36:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b351d622-a058-428e-b7fd-ea5a27a023fb tempest-VolumesSnapshotTestJSON-1267003830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39540946-977f-423a-9994-a11302ff0aae -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-39540946-977f-423a-9994-a11302ff0aae.827c9ca2-496b-4250-b024-da0b082bc0ae" returned: 0 in 0.311s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:36:22 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-b351d622-a058-428e-b7fd-ea5a27a023fb tempest-VolumesSnapshotTestJSON-1267003830 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-39540946-977f-423a-9994-a11302ff0aae.827c9ca2-496b-4250-b024-da0b082bc0ae is being set with open permissions: ugo+rw
Jul 14 16:36:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b351d622-a058-428e-b7fd-ea5a27a023fb tempest-VolumesSnapshotTestJSON-1267003830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-39540946-977f-423a-9994-a11302ff0aae.827c9ca2-496b-4250-b024-da0b082bc0ae {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:36:22 devstack sudo[101891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-39540946-977f-423a-9994-a11302ff0aae.827c9ca2-496b-4250-b024-da0b082bc0ae
Jul 14 16:36:22 devstack sudo[101891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:36:22 devstack sudo[101891]: pam_unix(sudo:session): session closed for user root
Jul 14 16:36:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b351d622-a058-428e-b7fd-ea5a27a023fb tempest-VolumesSnapshotTestJSON-1267003830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-39540946-977f-423a-9994-a11302ff0aae.827c9ca2-496b-4250-b024-da0b082bc0ae" returned: 0 in 0.283s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:36:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b351d622-a058-428e-b7fd-ea5a27a023fb tempest-VolumesSnapshotTestJSON-1267003830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-39540946-977f-423a-9994-a11302ff0aae.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:36:22 devstack sudo[101896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-39540946-977f-423a-9994-a11302ff0aae.info
Jul 14 16:36:22 devstack sudo[101896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:36:23 devstack sudo[101896]: pam_unix(sudo:session): session closed for user root
Jul 14 16:36:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b351d622-a058-428e-b7fd-ea5a27a023fb tempest-VolumesSnapshotTestJSON-1267003830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-39540946-977f-423a-9994-a11302ff0aae.info" returned: 0 in 0.388s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:36:23 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-b351d622-a058-428e-b7fd-ea5a27a023fb tempest-VolumesSnapshotTestJSON-1267003830 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-39540946-977f-423a-9994-a11302ff0aae.info is being set with open permissions: ugo+rw
Jul 14 16:36:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b351d622-a058-428e-b7fd-ea5a27a023fb tempest-VolumesSnapshotTestJSON-1267003830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-39540946-977f-423a-9994-a11302ff0aae.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:36:23 devstack sudo[101899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-39540946-977f-423a-9994-a11302ff0aae.info
Jul 14 16:36:23 devstack sudo[101899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:36:23 devstack sudo[101899]: pam_unix(sudo:session): session closed for user root
Jul 14 16:36:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b351d622-a058-428e-b7fd-ea5a27a023fb tempest-VolumesSnapshotTestJSON-1267003830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-39540946-977f-423a-9994-a11302ff0aae.info" returned: 0 in 0.277s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:36:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b351d622-a058-428e-b7fd-ea5a27a023fb tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.469s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:36:23 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-b351d622-a058-428e-b7fd-ea5a27a023fb tempest-VolumesSnapshotTestJSON-1267003830 None] Create snapshot completed successfully
Jul 14 16:36:24 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-76396de0-5276-4520-989e-c15da3aaa673 tempest-VolumesSnapshotTestJSON-1267003830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:36:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-76396de0-5276-4520-989e-c15da3aaa673 tempest-VolumesSnapshotTestJSON-1267003830 None] Flow 'volume_create_manager' (301a71d4-be1b-4928-acc0-a995ebd7f225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:36:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-76396de0-5276-4520-989e-c15da3aaa673 tempest-VolumesSnapshotTestJSON-1267003830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cce0bbf-8a2b-4de8-944f-2109c1ab0fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:36:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-76396de0-5276-4520-989e-c15da3aaa673 tempest-VolumesSnapshotTestJSON-1267003830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cce0bbf-8a2b-4de8-944f-2109c1ab0fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1440870339',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f4de49d-435c-4ff6-be54-08072e6296ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65194e8f19bb4338a91cd9f0acf1eb0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:36:25Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=827c9ca2-496b-4250-b024-da0b082bc0ae,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:36:25Z,use_quota=True,user_id='48498ac3871c4da88bbb68565031775f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:36:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-76396de0-5276-4520-989e-c15da3aaa673 tempest-VolumesSnapshotTestJSON-1267003830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79d16046-3158-47b7-849f-5cc2f3217736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:36:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-76396de0-5276-4520-989e-c15da3aaa673 tempest-VolumesSnapshotTestJSON-1267003830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79d16046-3158-47b7-849f-5cc2f3217736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:36:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-76396de0-5276-4520-989e-c15da3aaa673 tempest-VolumesSnapshotTestJSON-1267003830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dba223e8-87ec-4ef5-aac0-e5bb302597d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:36:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-76396de0-5276-4520-989e-c15da3aaa673 tempest-VolumesSnapshotTestJSON-1267003830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dba223e8-87ec-4ef5-aac0-e5bb302597d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2f4de49d-435c-4ff6-be54-08072e6296ad', 'volume_name': 'volume-2f4de49d-435c-4ff6-be54-08072e6296ad', 'volume_size': 2, 'snapshot_id': '827c9ca2-496b-4250-b024-da0b082bc0ae'}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:36:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-76396de0-5276-4520-989e-c15da3aaa673 tempest-VolumesSnapshotTestJSON-1267003830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07bde2ee-7157-40df-808d-8c6b450f433a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:36:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-76396de0-5276-4520-989e-c15da3aaa673 tempest-VolumesSnapshotTestJSON-1267003830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07bde2ee-7157-40df-808d-8c6b450f433a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:36:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-76396de0-5276-4520-989e-c15da3aaa673 tempest-VolumesSnapshotTestJSON-1267003830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e23796af-96aa-4704-b84f-22095dc01dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:36:24 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-76396de0-5276-4520-989e-c15da3aaa673 tempest-VolumesSnapshotTestJSON-1267003830 None] Volume 2f4de49d-435c-4ff6-be54-08072e6296ad: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2f4de49d-435c-4ff6-be54-08072e6296ad', 'volume_size': 2, 'snapshot_id': '827c9ca2-496b-4250-b024-da0b082bc0ae'}
Jul 14 16:36:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-76396de0-5276-4520-989e-c15da3aaa673 tempest-VolumesSnapshotTestJSON-1267003830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:36:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-76396de0-5276-4520-989e-c15da3aaa673 tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:36:25 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-76396de0-5276-4520-989e-c15da3aaa673 tempest-VolumesSnapshotTestJSON-1267003830 None] Acquiring lock "cinder-quobyte-827c9ca2-496b-4250-b024-da0b082bc0ae-2f4de49d-435c-4ff6-be54-08072e6296ad" by "_create_volume_from_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:36:25 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-76396de0-5276-4520-989e-c15da3aaa673 tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "cinder-quobyte-827c9ca2-496b-4250-b024-da0b082bc0ae-2f4de49d-435c-4ff6-be54-08072e6296ad" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:36:25 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-76396de0-5276-4520-989e-c15da3aaa673 tempest-VolumesSnapshotTestJSON-1267003830 None] Creating volume 2f4de49d-435c-4ff6-be54-08072e6296ad from snapshot 827c9ca2-496b-4250-b024-da0b082bc0ae {{(pid=87166) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 14 16:36:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-76396de0-5276-4520-989e-c15da3aaa673 tempest-VolumesSnapshotTestJSON-1267003830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:36:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-76396de0-5276-4520-989e-c15da3aaa673 tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:36:25 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-76396de0-5276-4520-989e-c15da3aaa673 tempest-VolumesSnapshotTestJSON-1267003830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:36:25 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-76396de0-5276-4520-989e-c15da3aaa673 tempest-VolumesSnapshotTestJSON-1267003830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:36:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-76396de0-5276-4520-989e-c15da3aaa673 tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:36:25 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-76396de0-5276-4520-989e-c15da3aaa673 tempest-VolumesSnapshotTestJSON-1267003830 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:36:25 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-76396de0-5276-4520-989e-c15da3aaa673 tempest-VolumesSnapshotTestJSON-1267003830 None] Acquiring lock "cinder-quobyte-2f4de49d-435c-4ff6-be54-08072e6296ad" by "_copy_volume_from_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:36:25 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-76396de0-5276-4520-989e-c15da3aaa673 tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "cinder-quobyte-2f4de49d-435c-4ff6-be54-08072e6296ad" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:36:25 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-76396de0-5276-4520-989e-c15da3aaa673 tempest-VolumesSnapshotTestJSON-1267003830 None] snapshot: 827c9ca2-496b-4250-b024-da0b082bc0ae, volume: 2f4de49d-435c-4ff6-be54-08072e6296ad,  {{(pid=87166) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 14 16:36:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-76396de0-5276-4520-989e-c15da3aaa673 tempest-VolumesSnapshotTestJSON-1267003830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:36:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-76396de0-5276-4520-989e-c15da3aaa673 tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:36:25 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-76396de0-5276-4520-989e-c15da3aaa673 tempest-VolumesSnapshotTestJSON-1267003830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:36:25 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-76396de0-5276-4520-989e-c15da3aaa673 tempest-VolumesSnapshotTestJSON-1267003830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:36:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-76396de0-5276-4520-989e-c15da3aaa673 tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:36:25 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d89924d-056d-4b88-976b-5b9fad907461]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:36:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-76396de0-5276-4520-989e-c15da3aaa673 tempest-VolumesSnapshotTestJSON-1267003830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-39540946-977f-423a-9994-a11302ff0aae.827c9ca2-496b-4250-b024-da0b082bc0ae {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:36:25 devstack sudo[101913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-39540946-977f-423a-9994-a11302ff0aae.827c9ca2-496b-4250-b024-da0b082bc0ae
Jul 14 16:36:25 devstack sudo[101913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:36:25 devstack sudo[101913]: pam_unix(sudo:session): session closed for user root
Jul 14 16:36:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-76396de0-5276-4520-989e-c15da3aaa673 tempest-VolumesSnapshotTestJSON-1267003830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-39540946-977f-423a-9994-a11302ff0aae.827c9ca2-496b-4250-b024-da0b082bc0ae" returned: 0 in 0.423s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:36:25 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-76396de0-5276-4520-989e-c15da3aaa673 tempest-VolumesSnapshotTestJSON-1267003830 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-39540946-977f-423a-9994-a11302ff0aae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 16:36:25 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-76396de0-5276-4520-989e-c15da3aaa673 tempest-VolumesSnapshotTestJSON-1267003830 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-39540946-977f-423a-9994-a11302ff0aae {{(pid=87166) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 14 16:36:25 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-76396de0-5276-4520-989e-c15da3aaa673 tempest-VolumesSnapshotTestJSON-1267003830 None] Creating direct copy from snapshot {{(pid=87166) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 14 16:36:25 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb6e574-42c7-4699-8167-963b320d8663]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:36:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-76396de0-5276-4520-989e-c15da3aaa673 tempest-VolumesSnapshotTestJSON-1267003830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-39540946-977f-423a-9994-a11302ff0aae {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:36:25 devstack sudo[101926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-39540946-977f-423a-9994-a11302ff0aae
Jul 14 16:36:25 devstack sudo[101926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:36:26 devstack sudo[101926]: pam_unix(sudo:session): session closed for user root
Jul 14 16:36:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-76396de0-5276-4520-989e-c15da3aaa673 tempest-VolumesSnapshotTestJSON-1267003830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-39540946-977f-423a-9994-a11302ff0aae" returned: 0 in 0.496s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:36:26 devstack cinder-volume[87166]: DEBUG cinder.utils [None req-76396de0-5276-4520-989e-c15da3aaa673 tempest-VolumesSnapshotTestJSON-1267003830 None] Path /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2f4de49d-435c-4ff6-be54-08072e6296ad not found in is_blk_device check {{(pid=87166) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 14 16:36:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-76396de0-5276-4520-989e-c15da3aaa673 tempest-VolumesSnapshotTestJSON-1267003830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-39540946-977f-423a-9994-a11302ff0aae /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2f4de49d-435c-4ff6-be54-08072e6296ad {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:36:26 devstack sudo[101933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-39540946-977f-423a-9994-a11302ff0aae /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2f4de49d-435c-4ff6-be54-08072e6296ad
Jul 14 16:36:26 devstack sudo[101933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:36:26 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-89318416-771a-4a67-a4c3-e9d469a660f3 req-2b956da5-0cf9-4b40-8746-35d96a436160 tempest-TestInstancesWithCinderVolumes-233006016 None] Terminate volume connection completed successfully.
Jul 14 16:36:26 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-89318416-771a-4a67-a4c3-e9d469a660f3 req-2b956da5-0cf9-4b40-8746-35d96a436160 tempest-TestInstancesWithCinderVolumes-233006016 None] Deleting attachment ea44e2ee-67ac-4492-824c-919395edd5ac. {{(pid=87166) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 14 16:36:27 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-051bd50f-5335-489d-a2a8-8fc7fa31b97c tempest-TestInstancesWithCinderVolumes-233006016 None] Acquiring lock "cinder-26538d81-51f2-42f7-8dac-0b8cc9f6cf87-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:36:27 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-051bd50f-5335-489d-a2a8-8fc7fa31b97c tempest-TestInstancesWithCinderVolumes-233006016 None] Lock "cinder-26538d81-51f2-42f7-8dac-0b8cc9f6cf87-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:36:27 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-051bd50f-5335-489d-a2a8-8fc7fa31b97c tempest-TestInstancesWithCinderVolumes-233006016 None] Acquiring lock "cinder-quobyte-26538d81-51f2-42f7-8dac-0b8cc9f6cf87" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:36:27 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-051bd50f-5335-489d-a2a8-8fc7fa31b97c tempest-TestInstancesWithCinderVolumes-233006016 None] Lock "cinder-quobyte-26538d81-51f2-42f7-8dac-0b8cc9f6cf87" acquired by "delete_volume" :: waited 0.053s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:36:27 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f4e9c5-64a8-4df4-977b-1e3c8c416670]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:36:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-051bd50f-5335-489d-a2a8-8fc7fa31b97c tempest-TestInstancesWithCinderVolumes-233006016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-26538d81-51f2-42f7-8dac-0b8cc9f6cf87 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:36:28 devstack sudo[101951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-26538d81-51f2-42f7-8dac-0b8cc9f6cf87
Jul 14 16:36:28 devstack sudo[101951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:36:28 devstack sudo[101951]: pam_unix(sudo:session): session closed for user root
Jul 14 16:36:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-051bd50f-5335-489d-a2a8-8fc7fa31b97c tempest-TestInstancesWithCinderVolumes-233006016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-26538d81-51f2-42f7-8dac-0b8cc9f6cf87" returned: 0 in 1.003s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:36:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-051bd50f-5335-489d-a2a8-8fc7fa31b97c tempest-TestInstancesWithCinderVolumes-233006016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-26538d81-51f2-42f7-8dac-0b8cc9f6cf87 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:36:29 devstack sudo[101956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-26538d81-51f2-42f7-8dac-0b8cc9f6cf87
Jul 14 16:36:29 devstack sudo[101956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:36:30 devstack sudo[101956]: pam_unix(sudo:session): session closed for user root
Jul 14 16:36:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-051bd50f-5335-489d-a2a8-8fc7fa31b97c tempest-TestInstancesWithCinderVolumes-233006016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-26538d81-51f2-42f7-8dac-0b8cc9f6cf87" returned: 0 in 1.355s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:36:30 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-051bd50f-5335-489d-a2a8-8fc7fa31b97c tempest-TestInstancesWithCinderVolumes-233006016 None] Lock "cinder-quobyte-26538d81-51f2-42f7-8dac-0b8cc9f6cf87" released by "delete_volume" :: held 2.481s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:36:30 devstack cinder-volume[87166]: WARNING cinder.quota [None req-051bd50f-5335-489d-a2a8-8fc7fa31b97c tempest-TestInstancesWithCinderVolumes-233006016 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-684166785-2030541979 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-684166785-2030541979, it is now deprecated. Please use the default quota class for default quota.
Jul 14 16:36:30 devstack cinder-volume[87166]: WARNING cinder.quota [None req-051bd50f-5335-489d-a2a8-8fc7fa31b97c tempest-TestInstancesWithCinderVolumes-233006016 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-684166785-2030541979 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-684166785-2030541979, it is now deprecated. Please use the default quota class for default quota.
Jul 14 16:36:30 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-051bd50f-5335-489d-a2a8-8fc7fa31b97c tempest-TestInstancesWithCinderVolumes-233006016 None] Created reservations ['8cef46c7-2dcc-4352-842f-4f9e062aff64', '0312099f-c289-4c77-a540-355c07ee441c', 'bd2c131b-3470-4f9e-9897-16e1157e7d73', '3e2e9a0f-0acd-40b1-abd6-b288ebc64ad0'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:36:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-051bd50f-5335-489d-a2a8-8fc7fa31b97c tempest-TestInstancesWithCinderVolumes-233006016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:36:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-051bd50f-5335-489d-a2a8-8fc7fa31b97c tempest-TestInstancesWithCinderVolumes-233006016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:36:30 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-051bd50f-5335-489d-a2a8-8fc7fa31b97c tempest-TestInstancesWithCinderVolumes-233006016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:36:30 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-051bd50f-5335-489d-a2a8-8fc7fa31b97c tempest-TestInstancesWithCinderVolumes-233006016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:36:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-051bd50f-5335-489d-a2a8-8fc7fa31b97c tempest-TestInstancesWithCinderVolumes-233006016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:36:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-051bd50f-5335-489d-a2a8-8fc7fa31b97c tempest-TestInstancesWithCinderVolumes-233006016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:36:31 devstack sudo[101960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:36:31 devstack sudo[101960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:36:31 devstack sudo[101960]: pam_unix(sudo:session): session closed for user root
Jul 14 16:36:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-051bd50f-5335-489d-a2a8-8fc7fa31b97c tempest-TestInstancesWithCinderVolumes-233006016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.477s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:36:31 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-051bd50f-5335-489d-a2a8-8fc7fa31b97c tempest-TestInstancesWithCinderVolumes-233006016 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:36:31 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-051bd50f-5335-489d-a2a8-8fc7fa31b97c tempest-TestInstancesWithCinderVolumes-233006016 None] Deleted volume successfully.
Jul 14 16:36:31 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-051bd50f-5335-489d-a2a8-8fc7fa31b97c tempest-TestInstancesWithCinderVolumes-233006016 None] Lock "cinder-26538d81-51f2-42f7-8dac-0b8cc9f6cf87-delete_volume" released by "delete_volume" :: held 3.793s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:36:32 devstack sudo[101933]: pam_unix(sudo:session): session closed for user root
Jul 14 16:36:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-76396de0-5276-4520-989e-c15da3aaa673 tempest-VolumesSnapshotTestJSON-1267003830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-39540946-977f-423a-9994-a11302ff0aae /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2f4de49d-435c-4ff6-be54-08072e6296ad" returned: 0 in 6.515s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:36:32 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[b80cffce-d33b-4a86-9f85-92e77555a20c]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:36:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-76396de0-5276-4520-989e-c15da3aaa673 tempest-VolumesSnapshotTestJSON-1267003830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-39540946-977f-423a-9994-a11302ff0aae {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:36:32 devstack sudo[101974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-39540946-977f-423a-9994-a11302ff0aae
Jul 14 16:36:32 devstack sudo[101974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:36:33 devstack sudo[101974]: pam_unix(sudo:session): session closed for user root
Jul 14 16:36:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-76396de0-5276-4520-989e-c15da3aaa673 tempest-VolumesSnapshotTestJSON-1267003830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-39540946-977f-423a-9994-a11302ff0aae" returned: 0 in 0.580s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:36:33 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-76396de0-5276-4520-989e-c15da3aaa673 tempest-VolumesSnapshotTestJSON-1267003830 None] Image conversion details: src /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-39540946-977f-423a-9994-a11302ff0aae, size 1024.00 MB, duration 6.52 sec, destination /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2f4de49d-435c-4ff6-be54-08072e6296ad {{(pid=87166) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 14 16:36:33 devstack cinder-volume[87166]: INFO cinder.image.image_utils [None req-76396de0-5276-4520-989e-c15da3aaa673 tempest-VolumesSnapshotTestJSON-1267003830 None] Converted 1024.00 MB image at 157.15 MB/s
Jul 14 16:36:33 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-76396de0-5276-4520-989e-c15da3aaa673 tempest-VolumesSnapshotTestJSON-1267003830 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2f4de49d-435c-4ff6-be54-08072e6296ad is being set with open permissions: ugo+rw
Jul 14 16:36:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-76396de0-5276-4520-989e-c15da3aaa673 tempest-VolumesSnapshotTestJSON-1267003830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2f4de49d-435c-4ff6-be54-08072e6296ad {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:36:33 devstack sudo[101989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2f4de49d-435c-4ff6-be54-08072e6296ad
Jul 14 16:36:33 devstack sudo[101989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:36:33 devstack sudo[101989]: pam_unix(sudo:session): session closed for user root
Jul 14 16:36:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-76396de0-5276-4520-989e-c15da3aaa673 tempest-VolumesSnapshotTestJSON-1267003830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2f4de49d-435c-4ff6-be54-08072e6296ad" returned: 0 in 0.282s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:36:33 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-76396de0-5276-4520-989e-c15da3aaa673 tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "cinder-quobyte-2f4de49d-435c-4ff6-be54-08072e6296ad" released by "_copy_volume_from_snapshot" :: held 8.401s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:36:33 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-76396de0-5276-4520-989e-c15da3aaa673 tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "cinder-quobyte-827c9ca2-496b-4250-b024-da0b082bc0ae-2f4de49d-435c-4ff6-be54-08072e6296ad" released by "_create_volume_from_snapshot" :: held 8.450s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:36:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-76396de0-5276-4520-989e-c15da3aaa673 tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.468s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:36:33 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-76396de0-5276-4520-989e-c15da3aaa673 tempest-VolumesSnapshotTestJSON-1267003830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e23796af-96aa-4704-b84f-22095dc01dd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f4de49d-435c-4ff6-be54-08072e6296ad', 'volume_size': 2, 'snapshot_id': '827c9ca2-496b-4250-b024-da0b082bc0ae'}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:36:33 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-76396de0-5276-4520-989e-c15da3aaa673 tempest-VolumesSnapshotTestJSON-1267003830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb91fdbc-3b28-422a-8cfc-be6f28b52668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:36:33 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-76396de0-5276-4520-989e-c15da3aaa673 tempest-VolumesSnapshotTestJSON-1267003830 None] Volume volume-2f4de49d-435c-4ff6-be54-08072e6296ad (2f4de49d-435c-4ff6-be54-08072e6296ad): created successfully
Jul 14 16:36:33 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-76396de0-5276-4520-989e-c15da3aaa673 tempest-VolumesSnapshotTestJSON-1267003830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb91fdbc-3b28-422a-8cfc-be6f28b52668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:36:33 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-76396de0-5276-4520-989e-c15da3aaa673 tempest-VolumesSnapshotTestJSON-1267003830 None] Flow 'volume_create_manager' (301a71d4-be1b-4928-acc0-a995ebd7f225) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:36:33 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-76396de0-5276-4520-989e-c15da3aaa673 tempest-VolumesSnapshotTestJSON-1267003830 None] Created volume successfully.
Jul 14 16:36:33 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-b3d570ad-a443-4d67-b746-d54221bb439b req-79c33293-0b37-436f-896c-c00786c8d3c7 tempest-TestInstancesWithCinderVolumes-233006016 None] Terminate volume connection completed successfully.
Jul 14 16:36:33 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-b3d570ad-a443-4d67-b746-d54221bb439b req-79c33293-0b37-436f-896c-c00786c8d3c7 tempest-TestInstancesWithCinderVolumes-233006016 None] Deleting attachment 8d94bd18-e1ac-47b6-a70c-3c5bf120c4cf. {{(pid=87166) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 14 16:36:34 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-96fe22a2-a29d-44b8-a445-c357cafd519e tempest-VolumesSnapshotTestJSON-1267003830 None] Acquiring lock "cinder-2f4de49d-435c-4ff6-be54-08072e6296ad-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:36:34 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-96fe22a2-a29d-44b8-a445-c357cafd519e tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "cinder-2f4de49d-435c-4ff6-be54-08072e6296ad-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:36:34 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-96fe22a2-a29d-44b8-a445-c357cafd519e tempest-VolumesSnapshotTestJSON-1267003830 None] Acquiring lock "cinder-quobyte-2f4de49d-435c-4ff6-be54-08072e6296ad" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:36:34 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-96fe22a2-a29d-44b8-a445-c357cafd519e tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "cinder-quobyte-2f4de49d-435c-4ff6-be54-08072e6296ad" acquired by "delete_volume" :: waited 0.015s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:36:34 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[af9940f4-5d76-48d8-ba89-191100416d31]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:36:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-96fe22a2-a29d-44b8-a445-c357cafd519e tempest-VolumesSnapshotTestJSON-1267003830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2f4de49d-435c-4ff6-be54-08072e6296ad {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:36:34 devstack sudo[101995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2f4de49d-435c-4ff6-be54-08072e6296ad
Jul 14 16:36:34 devstack sudo[101995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:36:34 devstack sudo[101995]: pam_unix(sudo:session): session closed for user root
Jul 14 16:36:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-96fe22a2-a29d-44b8-a445-c357cafd519e tempest-VolumesSnapshotTestJSON-1267003830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2f4de49d-435c-4ff6-be54-08072e6296ad" returned: 0 in 0.357s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:36:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-96fe22a2-a29d-44b8-a445-c357cafd519e tempest-VolumesSnapshotTestJSON-1267003830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2f4de49d-435c-4ff6-be54-08072e6296ad {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:36:34 devstack sudo[102000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2f4de49d-435c-4ff6-be54-08072e6296ad
Jul 14 16:36:34 devstack sudo[102000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:36:34 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a05beedb-7e87-4572-8129-8a0f92313195 tempest-TestInstancesWithCinderVolumes-233006016 None] Acquiring lock "cinder-309b338a-6d5f-432c-b189-9abe7111c154-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:36:34 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a05beedb-7e87-4572-8129-8a0f92313195 tempest-TestInstancesWithCinderVolumes-233006016 None] Lock "cinder-309b338a-6d5f-432c-b189-9abe7111c154-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:36:34 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a05beedb-7e87-4572-8129-8a0f92313195 tempest-TestInstancesWithCinderVolumes-233006016 None] Acquiring lock "cinder-quobyte-309b338a-6d5f-432c-b189-9abe7111c154" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:36:34 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a05beedb-7e87-4572-8129-8a0f92313195 tempest-TestInstancesWithCinderVolumes-233006016 None] Lock "cinder-quobyte-309b338a-6d5f-432c-b189-9abe7111c154" acquired by "delete_volume" :: waited 0.035s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:36:34 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f4c48b-27e3-413e-858d-060ff5dc9948]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:36:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a05beedb-7e87-4572-8129-8a0f92313195 tempest-TestInstancesWithCinderVolumes-233006016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-309b338a-6d5f-432c-b189-9abe7111c154 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:36:34 devstack sudo[102000]: pam_unix(sudo:session): session closed for user root
Jul 14 16:36:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-96fe22a2-a29d-44b8-a445-c357cafd519e tempest-VolumesSnapshotTestJSON-1267003830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2f4de49d-435c-4ff6-be54-08072e6296ad" returned: 0 in 0.332s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:36:34 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-96fe22a2-a29d-44b8-a445-c357cafd519e tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "cinder-quobyte-2f4de49d-435c-4ff6-be54-08072e6296ad" released by "delete_volume" :: held 0.739s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:36:35 devstack sudo[102002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-309b338a-6d5f-432c-b189-9abe7111c154
Jul 14 16:36:35 devstack sudo[102002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:36:35 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-96fe22a2-a29d-44b8-a445-c357cafd519e tempest-VolumesSnapshotTestJSON-1267003830 None] Created reservations ['385af371-be09-4d6e-9267-1edde9818fe0', '9605a954-e51a-4d42-832b-2f40efddcce3', '4a0562f5-9c9f-4f22-960b-c87d4fe8df02', 'ffba98a9-4e55-49d3-a15c-2968ba6cb95f'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:36:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-96fe22a2-a29d-44b8-a445-c357cafd519e tempest-VolumesSnapshotTestJSON-1267003830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:36:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-96fe22a2-a29d-44b8-a445-c357cafd519e tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:36:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-96fe22a2-a29d-44b8-a445-c357cafd519e tempest-VolumesSnapshotTestJSON-1267003830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:36:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-96fe22a2-a29d-44b8-a445-c357cafd519e tempest-VolumesSnapshotTestJSON-1267003830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:36:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-96fe22a2-a29d-44b8-a445-c357cafd519e tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:36:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-96fe22a2-a29d-44b8-a445-c357cafd519e tempest-VolumesSnapshotTestJSON-1267003830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:36:35 devstack sudo[102005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:36:35 devstack sudo[102005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:36:35 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 16:36:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:36:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:36:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:36:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:36:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:36:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:36:35 devstack sudo[102010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:36:35 devstack sudo[102010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:36:35 devstack sudo[102002]: pam_unix(sudo:session): session closed for user root
Jul 14 16:36:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a05beedb-7e87-4572-8129-8a0f92313195 tempest-TestInstancesWithCinderVolumes-233006016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-309b338a-6d5f-432c-b189-9abe7111c154" returned: 0 in 0.594s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:36:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a05beedb-7e87-4572-8129-8a0f92313195 tempest-TestInstancesWithCinderVolumes-233006016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-309b338a-6d5f-432c-b189-9abe7111c154 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:36:35 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-51b007d9-7d8e-42d2-b96f-d5caf1c83f97 tempest-VolumesSnapshotTestJSON-1267003830 None] Acquiring lock "cinder-827c9ca2-496b-4250-b024-da0b082bc0ae-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:36:35 devstack sudo[102012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-309b338a-6d5f-432c-b189-9abe7111c154
Jul 14 16:36:35 devstack sudo[102012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:36:35 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-51b007d9-7d8e-42d2-b96f-d5caf1c83f97 tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "cinder-827c9ca2-496b-4250-b024-da0b082bc0ae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:36:35 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-51b007d9-7d8e-42d2-b96f-d5caf1c83f97 tempest-VolumesSnapshotTestJSON-1267003830 None] Acquiring lock "cinder-quobyte-39540946-977f-423a-9994-a11302ff0aae" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:36:35 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-51b007d9-7d8e-42d2-b96f-d5caf1c83f97 tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "cinder-quobyte-39540946-977f-423a-9994-a11302ff0aae" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:36:35 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-51b007d9-7d8e-42d2-b96f-d5caf1c83f97 tempest-VolumesSnapshotTestJSON-1267003830 None] Acquiring lock "cinder-quobyte-827c9ca2-496b-4250-b024-da0b082bc0ae" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:36:35 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-51b007d9-7d8e-42d2-b96f-d5caf1c83f97 tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "cinder-quobyte-827c9ca2-496b-4250-b024-da0b082bc0ae" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:36:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-51b007d9-7d8e-42d2-b96f-d5caf1c83f97 tempest-VolumesSnapshotTestJSON-1267003830 None] Deleting offline snapshot 827c9ca2-496b-4250-b024-da0b082bc0ae of volume 39540946-977f-423a-9994-a11302ff0aae {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 16:36:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-51b007d9-7d8e-42d2-b96f-d5caf1c83f97 tempest-VolumesSnapshotTestJSON-1267003830 None] snapshot_file for this snap is: volume-39540946-977f-423a-9994-a11302ff0aae.827c9ca2-496b-4250-b024-da0b082bc0ae {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 16:36:35 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[7062f404-cacd-41e7-aab3-14bf564f5155]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:36:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-51b007d9-7d8e-42d2-b96f-d5caf1c83f97 tempest-VolumesSnapshotTestJSON-1267003830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-39540946-977f-423a-9994-a11302ff0aae.827c9ca2-496b-4250-b024-da0b082bc0ae {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:36:35 devstack sudo[102005]: pam_unix(sudo:session): session closed for user root
Jul 14 16:36:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-96fe22a2-a29d-44b8-a445-c357cafd519e tempest-VolumesSnapshotTestJSON-1267003830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.536s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:36:35 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-96fe22a2-a29d-44b8-a445-c357cafd519e tempest-VolumesSnapshotTestJSON-1267003830 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:36:35 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-96fe22a2-a29d-44b8-a445-c357cafd519e tempest-VolumesSnapshotTestJSON-1267003830 None] Deleted volume successfully.
Jul 14 16:36:35 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-96fe22a2-a29d-44b8-a445-c357cafd519e tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "cinder-2f4de49d-435c-4ff6-be54-08072e6296ad-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:36:35 devstack sudo[102010]: pam_unix(sudo:session): session closed for user root
Jul 14 16:36:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.422s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:36:35 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:36:35 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Running periodic task VolumeManager._thread_info {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 16:36:35 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] thread count: 29 {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 14 16:36:35 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] thread info: [<_MainThread(MainThread, started 128606490927232)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128606415432960)>, <Thread(Thread-3 (stat_writer), started daemon 128606378859328)>, <Thread(Rabbit-heartbeat, started daemon 128606379646144)>, <Thread(Thread-5 (_runner), started daemon 128606377685824)>, <Thread(Thread-7 (_runner), started daemon 128606377701888)>, <Thread(fd_logger, started daemon 128606377091392)>, <Thread(privsep_reader, started daemon 128606375782080)>, <Thread(tpool_thread_0, started daemon 128606365607616)>, <Thread(tpool_thread_1, started daemon 128606357214912)>, <Thread(tpool_thread_2, started daemon 128606348822208)>, <Thread(tpool_thread_3, started daemon 128606340413120)>, <Thread(tpool_thread_4, started daemon 128606332004032)>, <Thread(tpool_thread_5, started daemon 128606323594944)>, <Thread(tpool_thread_6, started daemon 128606315185856)>, <Thread(tpool_thread_7, started daemon 128606306776768)>, <Thread(tpool_thread_8, started daemon 128606298367680)>, <Thread(tpool_thread_9, started daemon 128606289958592)>, <Thread(tpool_thread_10, started daemon 128606281549504)>, <Thread(tpool_thread_11, started daemon 128606273140416)>, <Thread(tpool_thread_12, started daemon 128606264731328)>, <Thread(tpool_thread_13, started daemon 128606256322240)>, <Thread(tpool_thread_14, started daemon 128606247913152)>, <Thread(tpool_thread_15, started daemon 128606239504064)>, <Thread(tpool_thread_16, started daemon 128606231094976)>, <Thread(tpool_thread_17, started daemon 128606222685888)>, <Thread(tpool_thread_18, started daemon 128606214276800)>, <Thread(tpool_thread_19, started daemon 128606205867712)>, <Thread(Rabbit-heartbeat, started daemon 128606368169344)>] {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 14 16:36:35 devstack sudo[102012]: pam_unix(sudo:session): session closed for user root
Jul 14 16:36:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a05beedb-7e87-4572-8129-8a0f92313195 tempest-TestInstancesWithCinderVolumes-233006016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-309b338a-6d5f-432c-b189-9abe7111c154" returned: 0 in 0.506s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:36:35 devstack sudo[102015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-39540946-977f-423a-9994-a11302ff0aae.827c9ca2-496b-4250-b024-da0b082bc0ae
Jul 14 16:36:35 devstack sudo[102015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:36:36 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a05beedb-7e87-4572-8129-8a0f92313195 tempest-TestInstancesWithCinderVolumes-233006016 None] Lock "cinder-quobyte-309b338a-6d5f-432c-b189-9abe7111c154" released by "delete_volume" :: held 1.164s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:36:36 devstack cinder-volume[87166]: WARNING cinder.quota [None req-a05beedb-7e87-4572-8129-8a0f92313195 tempest-TestInstancesWithCinderVolumes-233006016 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-235065767-536410067 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-235065767-536410067, it is now deprecated. Please use the default quota class for default quota.
Jul 14 16:36:36 devstack cinder-volume[87166]: WARNING cinder.quota [None req-a05beedb-7e87-4572-8129-8a0f92313195 tempest-TestInstancesWithCinderVolumes-233006016 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-235065767-536410067 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-235065767-536410067, it is now deprecated. Please use the default quota class for default quota.
Jul 14 16:36:36 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-a05beedb-7e87-4572-8129-8a0f92313195 tempest-TestInstancesWithCinderVolumes-233006016 None] Created reservations ['7afb4b90-0cd7-4365-8402-ca9b009f56ef', '9af99171-3aa2-47bb-bbeb-a8ab5bb8638a', '7f296796-db86-44cb-aba3-98f04b4eb25c', '4eb5d5c2-5112-4456-9558-793d517fed68'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:36:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a05beedb-7e87-4572-8129-8a0f92313195 tempest-TestInstancesWithCinderVolumes-233006016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:36:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a05beedb-7e87-4572-8129-8a0f92313195 tempest-TestInstancesWithCinderVolumes-233006016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:36:36 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a05beedb-7e87-4572-8129-8a0f92313195 tempest-TestInstancesWithCinderVolumes-233006016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:36:36 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a05beedb-7e87-4572-8129-8a0f92313195 tempest-TestInstancesWithCinderVolumes-233006016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:36:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a05beedb-7e87-4572-8129-8a0f92313195 tempest-TestInstancesWithCinderVolumes-233006016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:36:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a05beedb-7e87-4572-8129-8a0f92313195 tempest-TestInstancesWithCinderVolumes-233006016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:36:36 devstack sudo[102019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:36:36 devstack sudo[102019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:36:36 devstack sudo[102015]: pam_unix(sudo:session): session closed for user root
Jul 14 16:36:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-51b007d9-7d8e-42d2-b96f-d5caf1c83f97 tempest-VolumesSnapshotTestJSON-1267003830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-39540946-977f-423a-9994-a11302ff0aae.827c9ca2-496b-4250-b024-da0b082bc0ae" returned: 0 in 0.654s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:36:36 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-51b007d9-7d8e-42d2-b96f-d5caf1c83f97 tempest-VolumesSnapshotTestJSON-1267003830 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-39540946-977f-423a-9994-a11302ff0aae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 16:36:36 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[78353995-730d-47c0-8d64-b3946955969e]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:36:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-51b007d9-7d8e-42d2-b96f-d5caf1c83f97 tempest-VolumesSnapshotTestJSON-1267003830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-39540946-977f-423a-9994-a11302ff0aae {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:36:36 devstack sudo[102019]: pam_unix(sudo:session): session closed for user root
Jul 14 16:36:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a05beedb-7e87-4572-8129-8a0f92313195 tempest-TestInstancesWithCinderVolumes-233006016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.326s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:36:36 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-a05beedb-7e87-4572-8129-8a0f92313195 tempest-TestInstancesWithCinderVolumes-233006016 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:36:36 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-a05beedb-7e87-4572-8129-8a0f92313195 tempest-TestInstancesWithCinderVolumes-233006016 None] Deleted volume successfully.
Jul 14 16:36:36 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a05beedb-7e87-4572-8129-8a0f92313195 tempest-TestInstancesWithCinderVolumes-233006016 None] Lock "cinder-309b338a-6d5f-432c-b189-9abe7111c154-delete_volume" released by "delete_volume" :: held 1.803s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:36:36 devstack sudo[102027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-39540946-977f-423a-9994-a11302ff0aae
Jul 14 16:36:36 devstack sudo[102027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:36:36 devstack sudo[102027]: pam_unix(sudo:session): session closed for user root
Jul 14 16:36:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-51b007d9-7d8e-42d2-b96f-d5caf1c83f97 tempest-VolumesSnapshotTestJSON-1267003830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-39540946-977f-423a-9994-a11302ff0aae" returned: 0 in 0.498s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:36:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-51b007d9-7d8e-42d2-b96f-d5caf1c83f97 tempest-VolumesSnapshotTestJSON-1267003830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-39540946-977f-423a-9994-a11302ff0aae.827c9ca2-496b-4250-b024-da0b082bc0ae {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:36:36 devstack sudo[102034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-39540946-977f-423a-9994-a11302ff0aae.827c9ca2-496b-4250-b024-da0b082bc0ae
Jul 14 16:36:36 devstack sudo[102034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:36:37 devstack sudo[102034]: pam_unix(sudo:session): session closed for user root
Jul 14 16:36:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-51b007d9-7d8e-42d2-b96f-d5caf1c83f97 tempest-VolumesSnapshotTestJSON-1267003830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-39540946-977f-423a-9994-a11302ff0aae.827c9ca2-496b-4250-b024-da0b082bc0ae" returned: 0 in 0.450s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:36:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-51b007d9-7d8e-42d2-b96f-d5caf1c83f97 tempest-VolumesSnapshotTestJSON-1267003830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-39540946-977f-423a-9994-a11302ff0aae.827c9ca2-496b-4250-b024-da0b082bc0ae {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:36:37 devstack sudo[102039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-39540946-977f-423a-9994-a11302ff0aae.827c9ca2-496b-4250-b024-da0b082bc0ae
Jul 14 16:36:37 devstack sudo[102039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:36:37 devstack sudo[102039]: pam_unix(sudo:session): session closed for user root
Jul 14 16:36:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-51b007d9-7d8e-42d2-b96f-d5caf1c83f97 tempest-VolumesSnapshotTestJSON-1267003830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-39540946-977f-423a-9994-a11302ff0aae.827c9ca2-496b-4250-b024-da0b082bc0ae" returned: 0 in 0.270s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:36:37 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-51b007d9-7d8e-42d2-b96f-d5caf1c83f97 tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "cinder-quobyte-827c9ca2-496b-4250-b024-da0b082bc0ae" released by "_delete_snapshot" :: held 2.052s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:36:37 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-51b007d9-7d8e-42d2-b96f-d5caf1c83f97 tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "cinder-quobyte-39540946-977f-423a-9994-a11302ff0aae" released by "delete_snapshot" :: held 2.105s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:36:37 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-51b007d9-7d8e-42d2-b96f-d5caf1c83f97 tempest-VolumesSnapshotTestJSON-1267003830 None] Created reservations ['c8312dd2-226a-4e36-b1f6-74d59b25e136', '840c4b7f-a985-4404-8328-c8e2e0a857ce', '7d880c40-102b-4f8f-b792-ae60e37d40c5', 'a792a7ce-8f6d-4118-a16f-0487f94a82d8'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:36:37 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-51b007d9-7d8e-42d2-b96f-d5caf1c83f97 tempest-VolumesSnapshotTestJSON-1267003830 None] Delete snapshot completed successfully.
Jul 14 16:36:37 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-51b007d9-7d8e-42d2-b96f-d5caf1c83f97 tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "cinder-827c9ca2-496b-4250-b024-da0b082bc0ae-delete_snapshot" released by "delete_snapshot" :: held 2.315s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:36:38 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-68437788-9e6f-4814-998e-dbfa94152b4f tempest-VolumesSnapshotTestJSON-1267003830 None] Acquiring lock "cinder-39540946-977f-423a-9994-a11302ff0aae-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:36:38 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-68437788-9e6f-4814-998e-dbfa94152b4f tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "cinder-39540946-977f-423a-9994-a11302ff0aae-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:36:39 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-68437788-9e6f-4814-998e-dbfa94152b4f tempest-VolumesSnapshotTestJSON-1267003830 None] Acquiring lock "cinder-quobyte-39540946-977f-423a-9994-a11302ff0aae" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:36:39 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-68437788-9e6f-4814-998e-dbfa94152b4f tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "cinder-quobyte-39540946-977f-423a-9994-a11302ff0aae" acquired by "delete_volume" :: waited 0.030s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:36:39 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1485545-3983-45b5-a261-0599732e157c]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:36:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-68437788-9e6f-4814-998e-dbfa94152b4f tempest-VolumesSnapshotTestJSON-1267003830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-39540946-977f-423a-9994-a11302ff0aae {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:36:39 devstack sudo[102065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-39540946-977f-423a-9994-a11302ff0aae
Jul 14 16:36:39 devstack sudo[102065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:36:39 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-8d20e539-3f84-49ef-ab77-270e97e7e221 req-25e8c42f-c9d5-4697-b0ad-be23bb529b20 tempest-TestInstancesWithCinderVolumes-233006016 None] Terminate volume connection completed successfully.
Jul 14 16:36:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-8d20e539-3f84-49ef-ab77-270e97e7e221 req-25e8c42f-c9d5-4697-b0ad-be23bb529b20 tempest-TestInstancesWithCinderVolumes-233006016 None] Deleting attachment f85212bc-77ed-4e9e-8f9c-d323cf8c6b97. {{(pid=87166) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 14 16:36:39 devstack sudo[102065]: pam_unix(sudo:session): session closed for user root
Jul 14 16:36:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-68437788-9e6f-4814-998e-dbfa94152b4f tempest-VolumesSnapshotTestJSON-1267003830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-39540946-977f-423a-9994-a11302ff0aae" returned: 0 in 0.491s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:36:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-68437788-9e6f-4814-998e-dbfa94152b4f tempest-VolumesSnapshotTestJSON-1267003830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-39540946-977f-423a-9994-a11302ff0aae {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:36:39 devstack sudo[102074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-39540946-977f-423a-9994-a11302ff0aae
Jul 14 16:36:39 devstack sudo[102074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:36:39 devstack sudo[102074]: pam_unix(sudo:session): session closed for user root
Jul 14 16:36:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-68437788-9e6f-4814-998e-dbfa94152b4f tempest-VolumesSnapshotTestJSON-1267003830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-39540946-977f-423a-9994-a11302ff0aae" returned: 0 in 0.290s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:36:39 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-68437788-9e6f-4814-998e-dbfa94152b4f tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "cinder-quobyte-39540946-977f-423a-9994-a11302ff0aae" released by "delete_volume" :: held 0.856s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:36:39 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-68437788-9e6f-4814-998e-dbfa94152b4f tempest-VolumesSnapshotTestJSON-1267003830 None] Created reservations ['4852c812-16e4-4d38-8db8-ad5fcb21050c', '74c589ab-4570-4076-8817-752f3e7c23b8', 'e8761181-21cf-4c03-ab43-e378affc7d74', '9b4fbfaa-7827-4ba5-8120-51c446374e7f'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:36:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-68437788-9e6f-4814-998e-dbfa94152b4f tempest-VolumesSnapshotTestJSON-1267003830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:36:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-68437788-9e6f-4814-998e-dbfa94152b4f tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:36:40 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-68437788-9e6f-4814-998e-dbfa94152b4f tempest-VolumesSnapshotTestJSON-1267003830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:36:40 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-68437788-9e6f-4814-998e-dbfa94152b4f tempest-VolumesSnapshotTestJSON-1267003830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:36:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-68437788-9e6f-4814-998e-dbfa94152b4f tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:36:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-68437788-9e6f-4814-998e-dbfa94152b4f tempest-VolumesSnapshotTestJSON-1267003830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:36:40 devstack sudo[102077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:36:40 devstack sudo[102077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:36:40 devstack sudo[102077]: pam_unix(sudo:session): session closed for user root
Jul 14 16:36:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-68437788-9e6f-4814-998e-dbfa94152b4f tempest-VolumesSnapshotTestJSON-1267003830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.274s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:36:40 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-68437788-9e6f-4814-998e-dbfa94152b4f tempest-VolumesSnapshotTestJSON-1267003830 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:36:40 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-68437788-9e6f-4814-998e-dbfa94152b4f tempest-VolumesSnapshotTestJSON-1267003830 None] Deleted volume successfully.
Jul 14 16:36:40 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-68437788-9e6f-4814-998e-dbfa94152b4f tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "cinder-39540946-977f-423a-9994-a11302ff0aae-delete_volume" released by "delete_volume" :: held 1.362s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:36:40 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1140776-20cf-4ac0-a053-29a00000d537 tempest-VolumesSnapshotTestJSON-1267003830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:36:40 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b1140776-20cf-4ac0-a053-29a00000d537 tempest-VolumesSnapshotTestJSON-1267003830 None] Flow 'volume_create_manager' (3cefdedb-b225-4064-abc0-8a17c89d43b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:36:40 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b1140776-20cf-4ac0-a053-29a00000d537 tempest-VolumesSnapshotTestJSON-1267003830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c49a77f-f094-47a6-b3fe-b2e304ad57b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:36:40 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b1140776-20cf-4ac0-a053-29a00000d537 tempest-VolumesSnapshotTestJSON-1267003830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c49a77f-f094-47a6-b3fe-b2e304ad57b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:36:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-606991308',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64ed274b-6644-4c13-ba7e-d9cbd83769a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65194e8f19bb4338a91cd9f0acf1eb0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:36:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:36:41Z,use_quota=True,user_id='48498ac3871c4da88bbb68565031775f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:36:40 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b1140776-20cf-4ac0-a053-29a00000d537 tempest-VolumesSnapshotTestJSON-1267003830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f10d4de8-9235-4f69-872a-9192439cca10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:36:40 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b1140776-20cf-4ac0-a053-29a00000d537 tempest-VolumesSnapshotTestJSON-1267003830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f10d4de8-9235-4f69-872a-9192439cca10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:36:40 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b1140776-20cf-4ac0-a053-29a00000d537 tempest-VolumesSnapshotTestJSON-1267003830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05caa3fe-1d4c-4862-9828-cd5b564caca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:36:40 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b1140776-20cf-4ac0-a053-29a00000d537 tempest-VolumesSnapshotTestJSON-1267003830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05caa3fe-1d4c-4862-9828-cd5b564caca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64ed274b-6644-4c13-ba7e-d9cbd83769a0', 'volume_name': 'volume-64ed274b-6644-4c13-ba7e-d9cbd83769a0', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:36:40 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b1140776-20cf-4ac0-a053-29a00000d537 tempest-VolumesSnapshotTestJSON-1267003830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b854ba7-a4ca-42a4-86a5-a63e191cd05d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:36:40 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b1140776-20cf-4ac0-a053-29a00000d537 tempest-VolumesSnapshotTestJSON-1267003830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b854ba7-a4ca-42a4-86a5-a63e191cd05d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:36:40 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b1140776-20cf-4ac0-a053-29a00000d537 tempest-VolumesSnapshotTestJSON-1267003830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c84d1df0-7a5f-42bf-be76-a6b0217fca8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:36:40 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-b1140776-20cf-4ac0-a053-29a00000d537 tempest-VolumesSnapshotTestJSON-1267003830 None] Volume 64ed274b-6644-4c13-ba7e-d9cbd83769a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64ed274b-6644-4c13-ba7e-d9cbd83769a0', 'volume_size': 1}
Jul 14 16:36:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b1140776-20cf-4ac0-a053-29a00000d537 tempest-VolumesSnapshotTestJSON-1267003830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:36:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b1140776-20cf-4ac0-a053-29a00000d537 tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:36:40 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-b1140776-20cf-4ac0-a053-29a00000d537 tempest-VolumesSnapshotTestJSON-1267003830 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:36:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-606991308',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64ed274b-6644-4c13-ba7e-d9cbd83769a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65194e8f19bb4338a91cd9f0acf1eb0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:36:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:36:41Z,use_quota=True,user_id='48498ac3871c4da88bbb68565031775f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:36:40 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-b1140776-20cf-4ac0-a053-29a00000d537 tempest-VolumesSnapshotTestJSON-1267003830 None] Creating volume 64ed274b-6644-4c13-ba7e-d9cbd83769a0 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:36:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b1140776-20cf-4ac0-a053-29a00000d537 tempest-VolumesSnapshotTestJSON-1267003830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:36:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b1140776-20cf-4ac0-a053-29a00000d537 tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:36:40 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-b1140776-20cf-4ac0-a053-29a00000d537 tempest-VolumesSnapshotTestJSON-1267003830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:36:40 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-b1140776-20cf-4ac0-a053-29a00000d537 tempest-VolumesSnapshotTestJSON-1267003830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:36:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b1140776-20cf-4ac0-a053-29a00000d537 tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:36:40 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-b1140776-20cf-4ac0-a053-29a00000d537 tempest-VolumesSnapshotTestJSON-1267003830 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:36:40 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-b1140776-20cf-4ac0-a053-29a00000d537 tempest-VolumesSnapshotTestJSON-1267003830 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:36:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b1140776-20cf-4ac0-a053-29a00000d537 tempest-VolumesSnapshotTestJSON-1267003830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-64ed274b-6644-4c13-ba7e-d9cbd83769a0 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:36:40 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0bd8df53-14ae-454d-b9b0-10f6f1964260 tempest-TestInstancesWithCinderVolumes-233006016 None] Acquiring lock "cinder-2720fa3b-96fa-4808-a90b-6663750f24d4-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:36:40 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0bd8df53-14ae-454d-b9b0-10f6f1964260 tempest-TestInstancesWithCinderVolumes-233006016 None] Lock "cinder-2720fa3b-96fa-4808-a90b-6663750f24d4-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:36:40 devstack sudo[102080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-64ed274b-6644-4c13-ba7e-d9cbd83769a0 1073741824
Jul 14 16:36:40 devstack sudo[102080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:36:40 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0bd8df53-14ae-454d-b9b0-10f6f1964260 tempest-TestInstancesWithCinderVolumes-233006016 None] Acquiring lock "cinder-quobyte-2720fa3b-96fa-4808-a90b-6663750f24d4" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:36:40 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0bd8df53-14ae-454d-b9b0-10f6f1964260 tempest-TestInstancesWithCinderVolumes-233006016 None] Lock "cinder-quobyte-2720fa3b-96fa-4808-a90b-6663750f24d4" acquired by "delete_volume" :: waited 0.018s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:36:40 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[373aa55f-f617-4088-9f40-69f188fb0a67]: (4, 'raw') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:36:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0bd8df53-14ae-454d-b9b0-10f6f1964260 tempest-TestInstancesWithCinderVolumes-233006016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2720fa3b-96fa-4808-a90b-6663750f24d4 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:36:40 devstack sudo[102082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2720fa3b-96fa-4808-a90b-6663750f24d4
Jul 14 16:36:40 devstack sudo[102082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:36:41 devstack sudo[102080]: pam_unix(sudo:session): session closed for user root
Jul 14 16:36:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b1140776-20cf-4ac0-a053-29a00000d537 tempest-VolumesSnapshotTestJSON-1267003830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-64ed274b-6644-4c13-ba7e-d9cbd83769a0 1073741824" returned: 0 in 0.451s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:36:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b1140776-20cf-4ac0-a053-29a00000d537 tempest-VolumesSnapshotTestJSON-1267003830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-64ed274b-6644-4c13-ba7e-d9cbd83769a0 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:36:41 devstack sudo[102089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-64ed274b-6644-4c13-ba7e-d9cbd83769a0
Jul 14 16:36:41 devstack sudo[102089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:36:41 devstack sudo[102082]: pam_unix(sudo:session): session closed for user root
Jul 14 16:36:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0bd8df53-14ae-454d-b9b0-10f6f1964260 tempest-TestInstancesWithCinderVolumes-233006016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2720fa3b-96fa-4808-a90b-6663750f24d4" returned: 0 in 0.390s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:36:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0bd8df53-14ae-454d-b9b0-10f6f1964260 tempest-TestInstancesWithCinderVolumes-233006016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2720fa3b-96fa-4808-a90b-6663750f24d4 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:36:41 devstack sudo[102091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2720fa3b-96fa-4808-a90b-6663750f24d4
Jul 14 16:36:41 devstack sudo[102091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:36:41 devstack sudo[102089]: pam_unix(sudo:session): session closed for user root
Jul 14 16:36:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b1140776-20cf-4ac0-a053-29a00000d537 tempest-VolumesSnapshotTestJSON-1267003830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-64ed274b-6644-4c13-ba7e-d9cbd83769a0" returned: 0 in 0.252s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:36:41 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-b1140776-20cf-4ac0-a053-29a00000d537 tempest-VolumesSnapshotTestJSON-1267003830 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:36:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b1140776-20cf-4ac0-a053-29a00000d537 tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:36:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b1140776-20cf-4ac0-a053-29a00000d537 tempest-VolumesSnapshotTestJSON-1267003830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c84d1df0-7a5f-42bf-be76-a6b0217fca8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64ed274b-6644-4c13-ba7e-d9cbd83769a0', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:36:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b1140776-20cf-4ac0-a053-29a00000d537 tempest-VolumesSnapshotTestJSON-1267003830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9ef2b9b-d797-4bc3-a610-863e2b54fe30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:36:41 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-b1140776-20cf-4ac0-a053-29a00000d537 tempest-VolumesSnapshotTestJSON-1267003830 None] Volume volume-64ed274b-6644-4c13-ba7e-d9cbd83769a0 (64ed274b-6644-4c13-ba7e-d9cbd83769a0): created successfully
Jul 14 16:36:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b1140776-20cf-4ac0-a053-29a00000d537 tempest-VolumesSnapshotTestJSON-1267003830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9ef2b9b-d797-4bc3-a610-863e2b54fe30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:36:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b1140776-20cf-4ac0-a053-29a00000d537 tempest-VolumesSnapshotTestJSON-1267003830 None] Flow 'volume_create_manager' (3cefdedb-b225-4064-abc0-8a17c89d43b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:36:41 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-b1140776-20cf-4ac0-a053-29a00000d537 tempest-VolumesSnapshotTestJSON-1267003830 None] Created volume successfully.
Jul 14 16:36:41 devstack sudo[102091]: pam_unix(sudo:session): session closed for user root
Jul 14 16:36:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0bd8df53-14ae-454d-b9b0-10f6f1964260 tempest-TestInstancesWithCinderVolumes-233006016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2720fa3b-96fa-4808-a90b-6663750f24d4" returned: 1 in 0.364s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:36:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0bd8df53-14ae-454d-b9b0-10f6f1964260 tempest-TestInstancesWithCinderVolumes-233006016 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2720fa3b-96fa-4808-a90b-6663750f24d4' failed. Not Retrying. {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 16:36:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0bd8df53-14ae-454d-b9b0-10f6f1964260 tempest-TestInstancesWithCinderVolumes-233006016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2720fa3b-96fa-4808-a90b-6663750f24d4 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:36:41 devstack sudo[102097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2720fa3b-96fa-4808-a90b-6663750f24d4
Jul 14 16:36:41 devstack sudo[102097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:36:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9b7d5d4b-2385-4ce2-9bae-8106fe03f9be tempest-VolumesSnapshotTestJSON-1267003830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:36:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9b7d5d4b-2385-4ce2-9bae-8106fe03f9be tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:36:41 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-9b7d5d4b-2385-4ce2-9bae-8106fe03f9be tempest-VolumesSnapshotTestJSON-1267003830 None] Creating offline snapshot 8bc0f848-7a34-4c92-a84e-f310d0a4206d of volume 64ed274b-6644-4c13-ba7e-d9cbd83769a0 {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 16:36:41 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af77b62-039b-462f-a09e-471bd40f6241]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:36:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9b7d5d4b-2385-4ce2-9bae-8106fe03f9be tempest-VolumesSnapshotTestJSON-1267003830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-64ed274b-6644-4c13-ba7e-d9cbd83769a0 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:36:41 devstack sudo[102097]: pam_unix(sudo:session): session closed for user root
Jul 14 16:36:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0bd8df53-14ae-454d-b9b0-10f6f1964260 tempest-TestInstancesWithCinderVolumes-233006016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-2720fa3b-96fa-4808-a90b-6663750f24d4" returned: 0 in 0.298s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:36:41 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0bd8df53-14ae-454d-b9b0-10f6f1964260 tempest-TestInstancesWithCinderVolumes-233006016 None] Lock "cinder-quobyte-2720fa3b-96fa-4808-a90b-6663750f24d4" released by "delete_volume" :: held 1.135s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:36:41 devstack cinder-volume[87166]: WARNING cinder.quota [None req-0bd8df53-14ae-454d-b9b0-10f6f1964260 tempest-TestInstancesWithCinderVolumes-233006016 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1341889676-1354687842 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1341889676-1354687842, it is now deprecated. Please use the default quota class for default quota.
Jul 14 16:36:41 devstack cinder-volume[87166]: WARNING cinder.quota [None req-0bd8df53-14ae-454d-b9b0-10f6f1964260 tempest-TestInstancesWithCinderVolumes-233006016 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1341889676-1354687842 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1341889676-1354687842, it is now deprecated. Please use the default quota class for default quota.
Jul 14 16:36:42 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-0bd8df53-14ae-454d-b9b0-10f6f1964260 tempest-TestInstancesWithCinderVolumes-233006016 None] Created reservations ['67f7fe3e-8670-4844-9942-c7fb903e3878', '607d8210-966d-49b3-8c3a-a96079991f38', '69e84fc1-71d6-46a6-96c4-c992214fcea0', '2449b912-8cc1-49cc-a064-16ba6e5cada4'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:36:42 devstack sudo[102100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-64ed274b-6644-4c13-ba7e-d9cbd83769a0
Jul 14 16:36:42 devstack sudo[102100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:36:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0bd8df53-14ae-454d-b9b0-10f6f1964260 tempest-TestInstancesWithCinderVolumes-233006016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:36:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0bd8df53-14ae-454d-b9b0-10f6f1964260 tempest-TestInstancesWithCinderVolumes-233006016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:36:42 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0bd8df53-14ae-454d-b9b0-10f6f1964260 tempest-TestInstancesWithCinderVolumes-233006016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:36:42 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0bd8df53-14ae-454d-b9b0-10f6f1964260 tempest-TestInstancesWithCinderVolumes-233006016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:36:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0bd8df53-14ae-454d-b9b0-10f6f1964260 tempest-TestInstancesWithCinderVolumes-233006016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:36:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0bd8df53-14ae-454d-b9b0-10f6f1964260 tempest-TestInstancesWithCinderVolumes-233006016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:36:42 devstack sudo[102102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:36:42 devstack sudo[102102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:36:42 devstack sudo[102100]: pam_unix(sudo:session): session closed for user root
Jul 14 16:36:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9b7d5d4b-2385-4ce2-9bae-8106fe03f9be tempest-VolumesSnapshotTestJSON-1267003830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-64ed274b-6644-4c13-ba7e-d9cbd83769a0" returned: 0 in 0.378s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:36:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9b7d5d4b-2385-4ce2-9bae-8106fe03f9be tempest-VolumesSnapshotTestJSON-1267003830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-64ed274b-6644-4c13-ba7e-d9cbd83769a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-64ed274b-6644-4c13-ba7e-d9cbd83769a0.8bc0f848-7a34-4c92-a84e-f310d0a4206d 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:36:42 devstack sudo[102107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-64ed274b-6644-4c13-ba7e-d9cbd83769a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-64ed274b-6644-4c13-ba7e-d9cbd83769a0.8bc0f848-7a34-4c92-a84e-f310d0a4206d 1G
Jul 14 16:36:42 devstack sudo[102107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:36:42 devstack sudo[102102]: pam_unix(sudo:session): session closed for user root
Jul 14 16:36:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0bd8df53-14ae-454d-b9b0-10f6f1964260 tempest-TestInstancesWithCinderVolumes-233006016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.260s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:36:42 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-0bd8df53-14ae-454d-b9b0-10f6f1964260 tempest-TestInstancesWithCinderVolumes-233006016 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:36:42 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-0bd8df53-14ae-454d-b9b0-10f6f1964260 tempest-TestInstancesWithCinderVolumes-233006016 None] Deleted volume successfully.
Jul 14 16:36:42 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0bd8df53-14ae-454d-b9b0-10f6f1964260 tempest-TestInstancesWithCinderVolumes-233006016 None] Lock "cinder-2720fa3b-96fa-4808-a90b-6663750f24d4-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:36:42 devstack sudo[102107]: pam_unix(sudo:session): session closed for user root
Jul 14 16:36:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9b7d5d4b-2385-4ce2-9bae-8106fe03f9be tempest-VolumesSnapshotTestJSON-1267003830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-64ed274b-6644-4c13-ba7e-d9cbd83769a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-64ed274b-6644-4c13-ba7e-d9cbd83769a0.8bc0f848-7a34-4c92-a84e-f310d0a4206d 1G" returned: 0 in 0.390s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:36:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9b7d5d4b-2385-4ce2-9bae-8106fe03f9be tempest-VolumesSnapshotTestJSON-1267003830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64ed274b-6644-4c13-ba7e-d9cbd83769a0 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-64ed274b-6644-4c13-ba7e-d9cbd83769a0.8bc0f848-7a34-4c92-a84e-f310d0a4206d {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:36:42 devstack sudo[102113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64ed274b-6644-4c13-ba7e-d9cbd83769a0 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-64ed274b-6644-4c13-ba7e-d9cbd83769a0.8bc0f848-7a34-4c92-a84e-f310d0a4206d
Jul 14 16:36:42 devstack sudo[102113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:36:42 devstack sudo[102113]: pam_unix(sudo:session): session closed for user root
Jul 14 16:36:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9b7d5d4b-2385-4ce2-9bae-8106fe03f9be tempest-VolumesSnapshotTestJSON-1267003830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64ed274b-6644-4c13-ba7e-d9cbd83769a0 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-64ed274b-6644-4c13-ba7e-d9cbd83769a0.8bc0f848-7a34-4c92-a84e-f310d0a4206d" returned: 0 in 0.303s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:36:42 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-9b7d5d4b-2385-4ce2-9bae-8106fe03f9be tempest-VolumesSnapshotTestJSON-1267003830 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-64ed274b-6644-4c13-ba7e-d9cbd83769a0.8bc0f848-7a34-4c92-a84e-f310d0a4206d is being set with open permissions: ugo+rw
Jul 14 16:36:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9b7d5d4b-2385-4ce2-9bae-8106fe03f9be tempest-VolumesSnapshotTestJSON-1267003830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-64ed274b-6644-4c13-ba7e-d9cbd83769a0.8bc0f848-7a34-4c92-a84e-f310d0a4206d {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:36:42 devstack sudo[102118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-64ed274b-6644-4c13-ba7e-d9cbd83769a0.8bc0f848-7a34-4c92-a84e-f310d0a4206d
Jul 14 16:36:42 devstack sudo[102118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:36:43 devstack sudo[102118]: pam_unix(sudo:session): session closed for user root
Jul 14 16:36:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9b7d5d4b-2385-4ce2-9bae-8106fe03f9be tempest-VolumesSnapshotTestJSON-1267003830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-64ed274b-6644-4c13-ba7e-d9cbd83769a0.8bc0f848-7a34-4c92-a84e-f310d0a4206d" returned: 0 in 0.257s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:36:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9b7d5d4b-2385-4ce2-9bae-8106fe03f9be tempest-VolumesSnapshotTestJSON-1267003830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-64ed274b-6644-4c13-ba7e-d9cbd83769a0.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:36:43 devstack sudo[102121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-64ed274b-6644-4c13-ba7e-d9cbd83769a0.info
Jul 14 16:36:43 devstack sudo[102121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:36:43 devstack sudo[102121]: pam_unix(sudo:session): session closed for user root
Jul 14 16:36:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9b7d5d4b-2385-4ce2-9bae-8106fe03f9be tempest-VolumesSnapshotTestJSON-1267003830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-64ed274b-6644-4c13-ba7e-d9cbd83769a0.info" returned: 0 in 0.258s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:36:43 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-9b7d5d4b-2385-4ce2-9bae-8106fe03f9be tempest-VolumesSnapshotTestJSON-1267003830 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-64ed274b-6644-4c13-ba7e-d9cbd83769a0.info is being set with open permissions: ugo+rw
Jul 14 16:36:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9b7d5d4b-2385-4ce2-9bae-8106fe03f9be tempest-VolumesSnapshotTestJSON-1267003830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-64ed274b-6644-4c13-ba7e-d9cbd83769a0.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:36:43 devstack sudo[102124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-64ed274b-6644-4c13-ba7e-d9cbd83769a0.info
Jul 14 16:36:43 devstack sudo[102124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:36:43 devstack sudo[102124]: pam_unix(sudo:session): session closed for user root
Jul 14 16:36:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9b7d5d4b-2385-4ce2-9bae-8106fe03f9be tempest-VolumesSnapshotTestJSON-1267003830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-64ed274b-6644-4c13-ba7e-d9cbd83769a0.info" returned: 0 in 0.245s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:36:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9b7d5d4b-2385-4ce2-9bae-8106fe03f9be tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.938s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:36:43 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-9b7d5d4b-2385-4ce2-9bae-8106fe03f9be tempest-VolumesSnapshotTestJSON-1267003830 None] Create snapshot completed successfully
Jul 14 16:36:44 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-a98c9f5b-6729-4336-b15d-88da4231330c tempest-VolumesSnapshotTestJSON-1267003830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:36:44 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a98c9f5b-6729-4336-b15d-88da4231330c tempest-VolumesSnapshotTestJSON-1267003830 None] Flow 'volume_create_manager' (1c72c3b9-711e-4f1e-bc89-7ba84498d856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:36:44 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a98c9f5b-6729-4336-b15d-88da4231330c tempest-VolumesSnapshotTestJSON-1267003830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54a5b9ab-3686-4b2d-847d-73481d008cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:36:44 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a98c9f5b-6729-4336-b15d-88da4231330c tempest-VolumesSnapshotTestJSON-1267003830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54a5b9ab-3686-4b2d-847d-73481d008cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:36:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-224917477',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2674174-9c3a-404a-a9e4-6336e4ef3edf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65194e8f19bb4338a91cd9f0acf1eb0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:36:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8bc0f848-7a34-4c92-a84e-f310d0a4206d,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:36:44Z,use_quota=True,user_id='48498ac3871c4da88bbb68565031775f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:36:44 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a98c9f5b-6729-4336-b15d-88da4231330c tempest-VolumesSnapshotTestJSON-1267003830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c29b339c-90b1-4a03-acf0-c2fcd1ee3f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:36:44 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a98c9f5b-6729-4336-b15d-88da4231330c tempest-VolumesSnapshotTestJSON-1267003830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c29b339c-90b1-4a03-acf0-c2fcd1ee3f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:36:44 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a98c9f5b-6729-4336-b15d-88da4231330c tempest-VolumesSnapshotTestJSON-1267003830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fbabc44-0c49-4632-819f-103bca436361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:36:44 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a98c9f5b-6729-4336-b15d-88da4231330c tempest-VolumesSnapshotTestJSON-1267003830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fbabc44-0c49-4632-819f-103bca436361) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c2674174-9c3a-404a-a9e4-6336e4ef3edf', 'volume_name': 'volume-c2674174-9c3a-404a-a9e4-6336e4ef3edf', 'volume_size': 1, 'snapshot_id': '8bc0f848-7a34-4c92-a84e-f310d0a4206d'}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:36:44 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a98c9f5b-6729-4336-b15d-88da4231330c tempest-VolumesSnapshotTestJSON-1267003830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (503c7f6e-8430-46fe-9e69-ddfc3d18da26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:36:44 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a98c9f5b-6729-4336-b15d-88da4231330c tempest-VolumesSnapshotTestJSON-1267003830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (503c7f6e-8430-46fe-9e69-ddfc3d18da26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:36:44 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a98c9f5b-6729-4336-b15d-88da4231330c tempest-VolumesSnapshotTestJSON-1267003830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3074b0fb-4f5d-42c7-b7a2-133fc00de176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:36:44 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-a98c9f5b-6729-4336-b15d-88da4231330c tempest-VolumesSnapshotTestJSON-1267003830 None] Volume c2674174-9c3a-404a-a9e4-6336e4ef3edf: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c2674174-9c3a-404a-a9e4-6336e4ef3edf', 'volume_size': 1, 'snapshot_id': '8bc0f848-7a34-4c92-a84e-f310d0a4206d'}
Jul 14 16:36:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a98c9f5b-6729-4336-b15d-88da4231330c tempest-VolumesSnapshotTestJSON-1267003830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:36:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a98c9f5b-6729-4336-b15d-88da4231330c tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:36:44 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a98c9f5b-6729-4336-b15d-88da4231330c tempest-VolumesSnapshotTestJSON-1267003830 None] Acquiring lock "cinder-quobyte-8bc0f848-7a34-4c92-a84e-f310d0a4206d-c2674174-9c3a-404a-a9e4-6336e4ef3edf" by "_create_volume_from_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:36:44 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a98c9f5b-6729-4336-b15d-88da4231330c tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "cinder-quobyte-8bc0f848-7a34-4c92-a84e-f310d0a4206d-c2674174-9c3a-404a-a9e4-6336e4ef3edf" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:36:44 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a98c9f5b-6729-4336-b15d-88da4231330c tempest-VolumesSnapshotTestJSON-1267003830 None] Creating volume c2674174-9c3a-404a-a9e4-6336e4ef3edf from snapshot 8bc0f848-7a34-4c92-a84e-f310d0a4206d {{(pid=87166) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 14 16:36:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a98c9f5b-6729-4336-b15d-88da4231330c tempest-VolumesSnapshotTestJSON-1267003830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:36:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a98c9f5b-6729-4336-b15d-88da4231330c tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:36:44 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a98c9f5b-6729-4336-b15d-88da4231330c tempest-VolumesSnapshotTestJSON-1267003830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:36:44 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a98c9f5b-6729-4336-b15d-88da4231330c tempest-VolumesSnapshotTestJSON-1267003830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:36:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a98c9f5b-6729-4336-b15d-88da4231330c tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:36:44 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a98c9f5b-6729-4336-b15d-88da4231330c tempest-VolumesSnapshotTestJSON-1267003830 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:36:44 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a98c9f5b-6729-4336-b15d-88da4231330c tempest-VolumesSnapshotTestJSON-1267003830 None] Acquiring lock "cinder-quobyte-c2674174-9c3a-404a-a9e4-6336e4ef3edf" by "_copy_volume_from_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:36:44 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a98c9f5b-6729-4336-b15d-88da4231330c tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "cinder-quobyte-c2674174-9c3a-404a-a9e4-6336e4ef3edf" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:36:44 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a98c9f5b-6729-4336-b15d-88da4231330c tempest-VolumesSnapshotTestJSON-1267003830 None] snapshot: 8bc0f848-7a34-4c92-a84e-f310d0a4206d, volume: c2674174-9c3a-404a-a9e4-6336e4ef3edf,  {{(pid=87166) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 14 16:36:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a98c9f5b-6729-4336-b15d-88da4231330c tempest-VolumesSnapshotTestJSON-1267003830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:36:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a98c9f5b-6729-4336-b15d-88da4231330c tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:36:44 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a98c9f5b-6729-4336-b15d-88da4231330c tempest-VolumesSnapshotTestJSON-1267003830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:36:44 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a98c9f5b-6729-4336-b15d-88da4231330c tempest-VolumesSnapshotTestJSON-1267003830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:36:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a98c9f5b-6729-4336-b15d-88da4231330c tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:36:44 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf545de1-7d8c-4a44-84cc-71a1be5e1697]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:36:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a98c9f5b-6729-4336-b15d-88da4231330c tempest-VolumesSnapshotTestJSON-1267003830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-64ed274b-6644-4c13-ba7e-d9cbd83769a0.8bc0f848-7a34-4c92-a84e-f310d0a4206d {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:36:44 devstack sudo[102127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-64ed274b-6644-4c13-ba7e-d9cbd83769a0.8bc0f848-7a34-4c92-a84e-f310d0a4206d
Jul 14 16:36:44 devstack sudo[102127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:36:45 devstack sudo[102127]: pam_unix(sudo:session): session closed for user root
Jul 14 16:36:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a98c9f5b-6729-4336-b15d-88da4231330c tempest-VolumesSnapshotTestJSON-1267003830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-64ed274b-6644-4c13-ba7e-d9cbd83769a0.8bc0f848-7a34-4c92-a84e-f310d0a4206d" returned: 0 in 0.425s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:36:45 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-a98c9f5b-6729-4336-b15d-88da4231330c tempest-VolumesSnapshotTestJSON-1267003830 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64ed274b-6644-4c13-ba7e-d9cbd83769a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 16:36:45 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a98c9f5b-6729-4336-b15d-88da4231330c tempest-VolumesSnapshotTestJSON-1267003830 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-64ed274b-6644-4c13-ba7e-d9cbd83769a0 {{(pid=87166) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 14 16:36:45 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a98c9f5b-6729-4336-b15d-88da4231330c tempest-VolumesSnapshotTestJSON-1267003830 None] Creating direct copy from snapshot {{(pid=87166) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 14 16:36:45 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c26c59-682e-46fa-abc0-dc2b0b70ab42]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:36:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a98c9f5b-6729-4336-b15d-88da4231330c tempest-VolumesSnapshotTestJSON-1267003830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-64ed274b-6644-4c13-ba7e-d9cbd83769a0 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:36:45 devstack sudo[102134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-64ed274b-6644-4c13-ba7e-d9cbd83769a0
Jul 14 16:36:45 devstack sudo[102134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:36:45 devstack sudo[102134]: pam_unix(sudo:session): session closed for user root
Jul 14 16:36:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a98c9f5b-6729-4336-b15d-88da4231330c tempest-VolumesSnapshotTestJSON-1267003830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-64ed274b-6644-4c13-ba7e-d9cbd83769a0" returned: 0 in 0.444s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:36:45 devstack cinder-volume[87166]: DEBUG cinder.utils [None req-a98c9f5b-6729-4336-b15d-88da4231330c tempest-VolumesSnapshotTestJSON-1267003830 None] Path /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c2674174-9c3a-404a-a9e4-6336e4ef3edf not found in is_blk_device check {{(pid=87166) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 14 16:36:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a98c9f5b-6729-4336-b15d-88da4231330c tempest-VolumesSnapshotTestJSON-1267003830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-64ed274b-6644-4c13-ba7e-d9cbd83769a0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c2674174-9c3a-404a-a9e4-6336e4ef3edf {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:36:45 devstack sudo[102140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-64ed274b-6644-4c13-ba7e-d9cbd83769a0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c2674174-9c3a-404a-a9e4-6336e4ef3edf
Jul 14 16:36:45 devstack sudo[102140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:36:50 devstack sudo[102140]: pam_unix(sudo:session): session closed for user root
Jul 14 16:36:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a98c9f5b-6729-4336-b15d-88da4231330c tempest-VolumesSnapshotTestJSON-1267003830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-64ed274b-6644-4c13-ba7e-d9cbd83769a0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c2674174-9c3a-404a-a9e4-6336e4ef3edf" returned: 0 in 5.064s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:36:50 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[defddc8c-f0d0-405f-82af-4d36534e9032]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:36:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a98c9f5b-6729-4336-b15d-88da4231330c tempest-VolumesSnapshotTestJSON-1267003830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-64ed274b-6644-4c13-ba7e-d9cbd83769a0 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:36:50 devstack sudo[102155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-64ed274b-6644-4c13-ba7e-d9cbd83769a0
Jul 14 16:36:50 devstack sudo[102155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:36:51 devstack sudo[102155]: pam_unix(sudo:session): session closed for user root
Jul 14 16:36:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a98c9f5b-6729-4336-b15d-88da4231330c tempest-VolumesSnapshotTestJSON-1267003830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-64ed274b-6644-4c13-ba7e-d9cbd83769a0" returned: 0 in 0.589s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:36:51 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-a98c9f5b-6729-4336-b15d-88da4231330c tempest-VolumesSnapshotTestJSON-1267003830 None] Image conversion details: src /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-64ed274b-6644-4c13-ba7e-d9cbd83769a0, size 1024.00 MB, duration 5.07 sec, destination /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c2674174-9c3a-404a-a9e4-6336e4ef3edf {{(pid=87166) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 14 16:36:51 devstack cinder-volume[87166]: INFO cinder.image.image_utils [None req-a98c9f5b-6729-4336-b15d-88da4231330c tempest-VolumesSnapshotTestJSON-1267003830 None] Converted 1024.00 MB image at 202.17 MB/s
Jul 14 16:36:51 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-a98c9f5b-6729-4336-b15d-88da4231330c tempest-VolumesSnapshotTestJSON-1267003830 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c2674174-9c3a-404a-a9e4-6336e4ef3edf is being set with open permissions: ugo+rw
Jul 14 16:36:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a98c9f5b-6729-4336-b15d-88da4231330c tempest-VolumesSnapshotTestJSON-1267003830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c2674174-9c3a-404a-a9e4-6336e4ef3edf {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:36:51 devstack sudo[102160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c2674174-9c3a-404a-a9e4-6336e4ef3edf
Jul 14 16:36:51 devstack sudo[102160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:36:51 devstack sudo[102160]: pam_unix(sudo:session): session closed for user root
Jul 14 16:36:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a98c9f5b-6729-4336-b15d-88da4231330c tempest-VolumesSnapshotTestJSON-1267003830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c2674174-9c3a-404a-a9e4-6336e4ef3edf" returned: 0 in 0.263s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:36:51 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a98c9f5b-6729-4336-b15d-88da4231330c tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "cinder-quobyte-c2674174-9c3a-404a-a9e4-6336e4ef3edf" released by "_copy_volume_from_snapshot" :: held 6.904s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:36:51 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a98c9f5b-6729-4336-b15d-88da4231330c tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "cinder-quobyte-8bc0f848-7a34-4c92-a84e-f310d0a4206d-c2674174-9c3a-404a-a9e4-6336e4ef3edf" released by "_create_volume_from_snapshot" :: held 6.936s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:36:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a98c9f5b-6729-4336-b15d-88da4231330c tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.954s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:36:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a98c9f5b-6729-4336-b15d-88da4231330c tempest-VolumesSnapshotTestJSON-1267003830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3074b0fb-4f5d-42c7-b7a2-133fc00de176) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2674174-9c3a-404a-a9e4-6336e4ef3edf', 'volume_size': 1, 'snapshot_id': '8bc0f848-7a34-4c92-a84e-f310d0a4206d'}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:36:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a98c9f5b-6729-4336-b15d-88da4231330c tempest-VolumesSnapshotTestJSON-1267003830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37e89351-a0e1-47c3-9307-3b0d6864078e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:36:51 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-a98c9f5b-6729-4336-b15d-88da4231330c tempest-VolumesSnapshotTestJSON-1267003830 None] Volume volume-c2674174-9c3a-404a-a9e4-6336e4ef3edf (c2674174-9c3a-404a-a9e4-6336e4ef3edf): created successfully
Jul 14 16:36:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a98c9f5b-6729-4336-b15d-88da4231330c tempest-VolumesSnapshotTestJSON-1267003830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37e89351-a0e1-47c3-9307-3b0d6864078e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:36:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a98c9f5b-6729-4336-b15d-88da4231330c tempest-VolumesSnapshotTestJSON-1267003830 None] Flow 'volume_create_manager' (1c72c3b9-711e-4f1e-bc89-7ba84498d856) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:36:51 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-a98c9f5b-6729-4336-b15d-88da4231330c tempest-VolumesSnapshotTestJSON-1267003830 None] Created volume successfully.
Jul 14 16:36:52 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-51400530-367f-4606-93f1-be5efdad2f26 tempest-VolumesSnapshotTestJSON-1267003830 None] Acquiring lock "cinder-c2674174-9c3a-404a-a9e4-6336e4ef3edf-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:36:52 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-51400530-367f-4606-93f1-be5efdad2f26 tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "cinder-c2674174-9c3a-404a-a9e4-6336e4ef3edf-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:36:52 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-51400530-367f-4606-93f1-be5efdad2f26 tempest-VolumesSnapshotTestJSON-1267003830 None] Acquiring lock "cinder-quobyte-c2674174-9c3a-404a-a9e4-6336e4ef3edf" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:36:52 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-51400530-367f-4606-93f1-be5efdad2f26 tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "cinder-quobyte-c2674174-9c3a-404a-a9e4-6336e4ef3edf" acquired by "delete_volume" :: waited 0.022s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:36:52 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf9e549-c93f-40bb-b1ea-bce5df3e22d5]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:36:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-51400530-367f-4606-93f1-be5efdad2f26 tempest-VolumesSnapshotTestJSON-1267003830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c2674174-9c3a-404a-a9e4-6336e4ef3edf {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:36:52 devstack sudo[102164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c2674174-9c3a-404a-a9e4-6336e4ef3edf
Jul 14 16:36:52 devstack sudo[102164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:36:53 devstack sudo[102164]: pam_unix(sudo:session): session closed for user root
Jul 14 16:36:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-51400530-367f-4606-93f1-be5efdad2f26 tempest-VolumesSnapshotTestJSON-1267003830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c2674174-9c3a-404a-a9e4-6336e4ef3edf" returned: 0 in 0.401s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:36:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-51400530-367f-4606-93f1-be5efdad2f26 tempest-VolumesSnapshotTestJSON-1267003830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c2674174-9c3a-404a-a9e4-6336e4ef3edf {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:36:53 devstack sudo[102169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c2674174-9c3a-404a-a9e4-6336e4ef3edf
Jul 14 16:36:53 devstack sudo[102169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:36:53 devstack sudo[102169]: pam_unix(sudo:session): session closed for user root
Jul 14 16:36:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-51400530-367f-4606-93f1-be5efdad2f26 tempest-VolumesSnapshotTestJSON-1267003830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c2674174-9c3a-404a-a9e4-6336e4ef3edf" returned: 0 in 0.259s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:36:53 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-51400530-367f-4606-93f1-be5efdad2f26 tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "cinder-quobyte-c2674174-9c3a-404a-a9e4-6336e4ef3edf" released by "delete_volume" :: held 0.729s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:36:53 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-51400530-367f-4606-93f1-be5efdad2f26 tempest-VolumesSnapshotTestJSON-1267003830 None] Created reservations ['9e12df59-1051-495d-90c8-28c95f578bef', 'ff084a98-977c-47f4-96f1-8d5f58fabb7c', 'ca4106dd-5811-41ce-912d-246717ae9188', '58ee74ab-a93b-49f8-bb23-c9bc9b0a9061'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:36:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-51400530-367f-4606-93f1-be5efdad2f26 tempest-VolumesSnapshotTestJSON-1267003830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:36:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-51400530-367f-4606-93f1-be5efdad2f26 tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:36:53 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-51400530-367f-4606-93f1-be5efdad2f26 tempest-VolumesSnapshotTestJSON-1267003830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:36:53 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-51400530-367f-4606-93f1-be5efdad2f26 tempest-VolumesSnapshotTestJSON-1267003830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:36:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-51400530-367f-4606-93f1-be5efdad2f26 tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:36:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-51400530-367f-4606-93f1-be5efdad2f26 tempest-VolumesSnapshotTestJSON-1267003830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:36:53 devstack sudo[102173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:36:53 devstack sudo[102173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:36:53 devstack sudo[102173]: pam_unix(sudo:session): session closed for user root
Jul 14 16:36:53 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-9f1e974f-7a1c-40c7-aea5-a70d11146d5e tempest-VolumesSnapshotTestJSON-1267003830 None] Acquiring lock "cinder-8bc0f848-7a34-4c92-a84e-f310d0a4206d-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:36:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-51400530-367f-4606-93f1-be5efdad2f26 tempest-VolumesSnapshotTestJSON-1267003830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.305s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:36:53 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-51400530-367f-4606-93f1-be5efdad2f26 tempest-VolumesSnapshotTestJSON-1267003830 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:36:53 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-51400530-367f-4606-93f1-be5efdad2f26 tempest-VolumesSnapshotTestJSON-1267003830 None] Deleted volume successfully.
Jul 14 16:36:53 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-9f1e974f-7a1c-40c7-aea5-a70d11146d5e tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "cinder-8bc0f848-7a34-4c92-a84e-f310d0a4206d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:36:53 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-9f1e974f-7a1c-40c7-aea5-a70d11146d5e tempest-VolumesSnapshotTestJSON-1267003830 None] Acquiring lock "cinder-quobyte-64ed274b-6644-4c13-ba7e-d9cbd83769a0" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:36:53 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-51400530-367f-4606-93f1-be5efdad2f26 tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "cinder-c2674174-9c3a-404a-a9e4-6336e4ef3edf-delete_volume" released by "delete_volume" :: held 1.276s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:36:53 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-9f1e974f-7a1c-40c7-aea5-a70d11146d5e tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "cinder-quobyte-64ed274b-6644-4c13-ba7e-d9cbd83769a0" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:36:53 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-9f1e974f-7a1c-40c7-aea5-a70d11146d5e tempest-VolumesSnapshotTestJSON-1267003830 None] Acquiring lock "cinder-quobyte-8bc0f848-7a34-4c92-a84e-f310d0a4206d" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:36:53 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-9f1e974f-7a1c-40c7-aea5-a70d11146d5e tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "cinder-quobyte-8bc0f848-7a34-4c92-a84e-f310d0a4206d" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:36:53 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-9f1e974f-7a1c-40c7-aea5-a70d11146d5e tempest-VolumesSnapshotTestJSON-1267003830 None] Deleting offline snapshot 8bc0f848-7a34-4c92-a84e-f310d0a4206d of volume 64ed274b-6644-4c13-ba7e-d9cbd83769a0 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 16:36:53 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-9f1e974f-7a1c-40c7-aea5-a70d11146d5e tempest-VolumesSnapshotTestJSON-1267003830 None] snapshot_file for this snap is: volume-64ed274b-6644-4c13-ba7e-d9cbd83769a0.8bc0f848-7a34-4c92-a84e-f310d0a4206d {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 16:36:53 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aeab857-75d4-4e47-9526-b1b52d054f40]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:36:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9f1e974f-7a1c-40c7-aea5-a70d11146d5e tempest-VolumesSnapshotTestJSON-1267003830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-64ed274b-6644-4c13-ba7e-d9cbd83769a0.8bc0f848-7a34-4c92-a84e-f310d0a4206d {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:36:53 devstack sudo[102176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-64ed274b-6644-4c13-ba7e-d9cbd83769a0.8bc0f848-7a34-4c92-a84e-f310d0a4206d
Jul 14 16:36:53 devstack sudo[102176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:36:54 devstack sudo[102176]: pam_unix(sudo:session): session closed for user root
Jul 14 16:36:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9f1e974f-7a1c-40c7-aea5-a70d11146d5e tempest-VolumesSnapshotTestJSON-1267003830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-64ed274b-6644-4c13-ba7e-d9cbd83769a0.8bc0f848-7a34-4c92-a84e-f310d0a4206d" returned: 0 in 0.399s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:36:54 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-9f1e974f-7a1c-40c7-aea5-a70d11146d5e tempest-VolumesSnapshotTestJSON-1267003830 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64ed274b-6644-4c13-ba7e-d9cbd83769a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 16:36:54 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3cab403-37bd-43fb-a5a8-627300e29a8e]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:36:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9f1e974f-7a1c-40c7-aea5-a70d11146d5e tempest-VolumesSnapshotTestJSON-1267003830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-64ed274b-6644-4c13-ba7e-d9cbd83769a0 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:36:54 devstack sudo[102181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-64ed274b-6644-4c13-ba7e-d9cbd83769a0
Jul 14 16:36:54 devstack sudo[102181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:36:54 devstack sudo[102181]: pam_unix(sudo:session): session closed for user root
Jul 14 16:36:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9f1e974f-7a1c-40c7-aea5-a70d11146d5e tempest-VolumesSnapshotTestJSON-1267003830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-64ed274b-6644-4c13-ba7e-d9cbd83769a0" returned: 0 in 0.396s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:36:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9f1e974f-7a1c-40c7-aea5-a70d11146d5e tempest-VolumesSnapshotTestJSON-1267003830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-64ed274b-6644-4c13-ba7e-d9cbd83769a0.8bc0f848-7a34-4c92-a84e-f310d0a4206d {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:36:54 devstack sudo[102186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-64ed274b-6644-4c13-ba7e-d9cbd83769a0.8bc0f848-7a34-4c92-a84e-f310d0a4206d
Jul 14 16:36:54 devstack sudo[102186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:36:55 devstack sudo[102186]: pam_unix(sudo:session): session closed for user root
Jul 14 16:36:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9f1e974f-7a1c-40c7-aea5-a70d11146d5e tempest-VolumesSnapshotTestJSON-1267003830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-64ed274b-6644-4c13-ba7e-d9cbd83769a0.8bc0f848-7a34-4c92-a84e-f310d0a4206d" returned: 0 in 0.383s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:36:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9f1e974f-7a1c-40c7-aea5-a70d11146d5e tempest-VolumesSnapshotTestJSON-1267003830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-64ed274b-6644-4c13-ba7e-d9cbd83769a0.8bc0f848-7a34-4c92-a84e-f310d0a4206d {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:36:55 devstack sudo[102191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-64ed274b-6644-4c13-ba7e-d9cbd83769a0.8bc0f848-7a34-4c92-a84e-f310d0a4206d
Jul 14 16:36:55 devstack sudo[102191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:36:55 devstack sudo[102191]: pam_unix(sudo:session): session closed for user root
Jul 14 16:36:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9f1e974f-7a1c-40c7-aea5-a70d11146d5e tempest-VolumesSnapshotTestJSON-1267003830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-64ed274b-6644-4c13-ba7e-d9cbd83769a0.8bc0f848-7a34-4c92-a84e-f310d0a4206d" returned: 0 in 0.272s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:36:55 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-9f1e974f-7a1c-40c7-aea5-a70d11146d5e tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "cinder-quobyte-8bc0f848-7a34-4c92-a84e-f310d0a4206d" released by "_delete_snapshot" :: held 1.568s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:36:55 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-9f1e974f-7a1c-40c7-aea5-a70d11146d5e tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "cinder-quobyte-64ed274b-6644-4c13-ba7e-d9cbd83769a0" released by "delete_snapshot" :: held 1.599s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:36:55 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-9f1e974f-7a1c-40c7-aea5-a70d11146d5e tempest-VolumesSnapshotTestJSON-1267003830 None] Created reservations ['e66e6611-3b85-4442-8e54-bdf9ab89165e', '1fee6e5d-0926-4a81-8a8c-c54301271de5', '53695533-0ec3-4996-a189-ac7a11a84425', '10ba4d87-d593-446b-a309-8617ef04de1b'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:36:55 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-9f1e974f-7a1c-40c7-aea5-a70d11146d5e tempest-VolumesSnapshotTestJSON-1267003830 None] Delete snapshot completed successfully.
Jul 14 16:36:55 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-9f1e974f-7a1c-40c7-aea5-a70d11146d5e tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "cinder-8bc0f848-7a34-4c92-a84e-f310d0a4206d-delete_snapshot" released by "delete_snapshot" :: held 1.738s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:36:55 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7bb9c5c2-4c39-4f62-a262-a6cddab7fe93 tempest-VolumesSnapshotTestJSON-1267003830 None] Acquiring lock "cinder-64ed274b-6644-4c13-ba7e-d9cbd83769a0-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:36:55 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7bb9c5c2-4c39-4f62-a262-a6cddab7fe93 tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "cinder-64ed274b-6644-4c13-ba7e-d9cbd83769a0-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:36:56 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7bb9c5c2-4c39-4f62-a262-a6cddab7fe93 tempest-VolumesSnapshotTestJSON-1267003830 None] Acquiring lock "cinder-quobyte-64ed274b-6644-4c13-ba7e-d9cbd83769a0" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:36:56 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7bb9c5c2-4c39-4f62-a262-a6cddab7fe93 tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "cinder-quobyte-64ed274b-6644-4c13-ba7e-d9cbd83769a0" acquired by "delete_volume" :: waited 0.014s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:36:56 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ee24c8-cf97-4e15-98a9-af178d87ed77]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:36:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7bb9c5c2-4c39-4f62-a262-a6cddab7fe93 tempest-VolumesSnapshotTestJSON-1267003830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-64ed274b-6644-4c13-ba7e-d9cbd83769a0 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:36:56 devstack sudo[102194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-64ed274b-6644-4c13-ba7e-d9cbd83769a0
Jul 14 16:36:56 devstack sudo[102194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:36:56 devstack sudo[102194]: pam_unix(sudo:session): session closed for user root
Jul 14 16:36:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7bb9c5c2-4c39-4f62-a262-a6cddab7fe93 tempest-VolumesSnapshotTestJSON-1267003830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-64ed274b-6644-4c13-ba7e-d9cbd83769a0" returned: 0 in 0.375s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:36:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7bb9c5c2-4c39-4f62-a262-a6cddab7fe93 tempest-VolumesSnapshotTestJSON-1267003830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-64ed274b-6644-4c13-ba7e-d9cbd83769a0 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:36:56 devstack sudo[102199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-64ed274b-6644-4c13-ba7e-d9cbd83769a0
Jul 14 16:36:56 devstack sudo[102199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:36:56 devstack sudo[102199]: pam_unix(sudo:session): session closed for user root
Jul 14 16:36:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7bb9c5c2-4c39-4f62-a262-a6cddab7fe93 tempest-VolumesSnapshotTestJSON-1267003830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-64ed274b-6644-4c13-ba7e-d9cbd83769a0" returned: 0 in 0.256s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:36:56 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7bb9c5c2-4c39-4f62-a262-a6cddab7fe93 tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "cinder-quobyte-64ed274b-6644-4c13-ba7e-d9cbd83769a0" released by "delete_volume" :: held 0.688s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:36:56 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-7bb9c5c2-4c39-4f62-a262-a6cddab7fe93 tempest-VolumesSnapshotTestJSON-1267003830 None] Created reservations ['f393a79b-b302-460c-bd40-88c2f219596e', '24794460-b9e1-4a22-92ab-f0c4ac643746', '9d115eb6-18a0-42f6-8320-3196facf204e', 'f9388db3-45e0-4b0d-bba1-0f99eae59f5a'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:36:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-7bb9c5c2-4c39-4f62-a262-a6cddab7fe93 tempest-VolumesSnapshotTestJSON-1267003830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:36:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-7bb9c5c2-4c39-4f62-a262-a6cddab7fe93 tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:36:56 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-7bb9c5c2-4c39-4f62-a262-a6cddab7fe93 tempest-VolumesSnapshotTestJSON-1267003830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:36:56 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-7bb9c5c2-4c39-4f62-a262-a6cddab7fe93 tempest-VolumesSnapshotTestJSON-1267003830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:36:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-7bb9c5c2-4c39-4f62-a262-a6cddab7fe93 tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:36:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7bb9c5c2-4c39-4f62-a262-a6cddab7fe93 tempest-VolumesSnapshotTestJSON-1267003830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:36:56 devstack sudo[102202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:36:56 devstack sudo[102202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:36:57 devstack sudo[102202]: pam_unix(sudo:session): session closed for user root
Jul 14 16:36:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7bb9c5c2-4c39-4f62-a262-a6cddab7fe93 tempest-VolumesSnapshotTestJSON-1267003830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.259s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:36:57 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-7bb9c5c2-4c39-4f62-a262-a6cddab7fe93 tempest-VolumesSnapshotTestJSON-1267003830 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:36:57 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-7bb9c5c2-4c39-4f62-a262-a6cddab7fe93 tempest-VolumesSnapshotTestJSON-1267003830 None] Deleted volume successfully.
Jul 14 16:36:57 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7bb9c5c2-4c39-4f62-a262-a6cddab7fe93 tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "cinder-64ed274b-6644-4c13-ba7e-d9cbd83769a0-delete_volume" released by "delete_volume" :: held 1.154s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:36:57 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e16a9794-d6f5-46ca-86eb-872533b948ed tempest-VolumesSnapshotTestJSON-1267003830 None] Acquiring lock "cinder-70abf183-e8d5-4ed8-a35f-fa471663d562-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:36:57 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e16a9794-d6f5-46ca-86eb-872533b948ed tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "cinder-70abf183-e8d5-4ed8-a35f-fa471663d562-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:36:57 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e16a9794-d6f5-46ca-86eb-872533b948ed tempest-VolumesSnapshotTestJSON-1267003830 None] Acquiring lock "cinder-quobyte-70abf183-e8d5-4ed8-a35f-fa471663d562" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:36:57 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e16a9794-d6f5-46ca-86eb-872533b948ed tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "cinder-quobyte-70abf183-e8d5-4ed8-a35f-fa471663d562" acquired by "delete_volume" :: waited 0.016s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:36:57 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d9dd50-840f-4d50-9216-e6717fae29da]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:36:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e16a9794-d6f5-46ca-86eb-872533b948ed tempest-VolumesSnapshotTestJSON-1267003830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-70abf183-e8d5-4ed8-a35f-fa471663d562 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:36:57 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-5241fd7d-45d0-4880-84f4-c93d1d7f6241 tempest-ProjectReaderTests-1026204729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:36:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5241fd7d-45d0-4880-84f4-c93d1d7f6241 tempest-ProjectReaderTests-1026204729 None] Flow 'volume_create_manager' (5741ac41-e31c-4163-9d97-87c172399081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:36:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5241fd7d-45d0-4880-84f4-c93d1d7f6241 tempest-ProjectReaderTests-1026204729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (481bd139-1384-471c-bbe3-c0b91d12e6bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:36:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5241fd7d-45d0-4880-84f4-c93d1d7f6241 tempest-ProjectReaderTests-1026204729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (481bd139-1384-471c-bbe3-c0b91d12e6bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:36:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-584052196',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f1e8c5f-2f5c-4b02-876c-2bbcf9e3434d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33cb089a60ae4f44bbe6d9d50bc53fc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:36:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:36:57Z,use_quota=True,user_id='6019a4ccc77d4c2bb080d19c67df5bea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:36:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5241fd7d-45d0-4880-84f4-c93d1d7f6241 tempest-ProjectReaderTests-1026204729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8506e176-dd54-4cf0-9b5f-d6d78e53c569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:36:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5241fd7d-45d0-4880-84f4-c93d1d7f6241 tempest-ProjectReaderTests-1026204729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8506e176-dd54-4cf0-9b5f-d6d78e53c569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:36:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5241fd7d-45d0-4880-84f4-c93d1d7f6241 tempest-ProjectReaderTests-1026204729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71c7647d-bbe3-4f3a-b5af-6d71dde22206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:36:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5241fd7d-45d0-4880-84f4-c93d1d7f6241 tempest-ProjectReaderTests-1026204729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71c7647d-bbe3-4f3a-b5af-6d71dde22206) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f1e8c5f-2f5c-4b02-876c-2bbcf9e3434d', 'volume_name': 'volume-7f1e8c5f-2f5c-4b02-876c-2bbcf9e3434d', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:36:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5241fd7d-45d0-4880-84f4-c93d1d7f6241 tempest-ProjectReaderTests-1026204729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62f1c2a2-b9eb-49d2-9e46-196fda65de9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:36:57 devstack sudo[102205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-70abf183-e8d5-4ed8-a35f-fa471663d562
Jul 14 16:36:57 devstack sudo[102205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:36:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5241fd7d-45d0-4880-84f4-c93d1d7f6241 tempest-ProjectReaderTests-1026204729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62f1c2a2-b9eb-49d2-9e46-196fda65de9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:36:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5241fd7d-45d0-4880-84f4-c93d1d7f6241 tempest-ProjectReaderTests-1026204729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af97b1bd-50d2-43f6-a6b7-25adc5c4f5fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:36:57 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-5241fd7d-45d0-4880-84f4-c93d1d7f6241 tempest-ProjectReaderTests-1026204729 None] Volume 7f1e8c5f-2f5c-4b02-876c-2bbcf9e3434d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f1e8c5f-2f5c-4b02-876c-2bbcf9e3434d', 'volume_size': 1}
Jul 14 16:36:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5241fd7d-45d0-4880-84f4-c93d1d7f6241 tempest-ProjectReaderTests-1026204729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:36:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5241fd7d-45d0-4880-84f4-c93d1d7f6241 tempest-ProjectReaderTests-1026204729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:36:57 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5241fd7d-45d0-4880-84f4-c93d1d7f6241 tempest-ProjectReaderTests-1026204729 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:36:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-584052196',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f1e8c5f-2f5c-4b02-876c-2bbcf9e3434d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33cb089a60ae4f44bbe6d9d50bc53fc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:36:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:36:57Z,use_quota=True,user_id='6019a4ccc77d4c2bb080d19c67df5bea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:36:57 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-5241fd7d-45d0-4880-84f4-c93d1d7f6241 tempest-ProjectReaderTests-1026204729 None] Creating volume 7f1e8c5f-2f5c-4b02-876c-2bbcf9e3434d {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:36:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5241fd7d-45d0-4880-84f4-c93d1d7f6241 tempest-ProjectReaderTests-1026204729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:36:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5241fd7d-45d0-4880-84f4-c93d1d7f6241 tempest-ProjectReaderTests-1026204729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:36:57 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5241fd7d-45d0-4880-84f4-c93d1d7f6241 tempest-ProjectReaderTests-1026204729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:36:57 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5241fd7d-45d0-4880-84f4-c93d1d7f6241 tempest-ProjectReaderTests-1026204729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:36:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5241fd7d-45d0-4880-84f4-c93d1d7f6241 tempest-ProjectReaderTests-1026204729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:36:57 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5241fd7d-45d0-4880-84f4-c93d1d7f6241 tempest-ProjectReaderTests-1026204729 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:36:57 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-5241fd7d-45d0-4880-84f4-c93d1d7f6241 tempest-ProjectReaderTests-1026204729 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:36:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5241fd7d-45d0-4880-84f4-c93d1d7f6241 tempest-ProjectReaderTests-1026204729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-7f1e8c5f-2f5c-4b02-876c-2bbcf9e3434d 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:36:57 devstack sudo[102207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-7f1e8c5f-2f5c-4b02-876c-2bbcf9e3434d 1073741824
Jul 14 16:36:57 devstack sudo[102207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:36:57 devstack sudo[102205]: pam_unix(sudo:session): session closed for user root
Jul 14 16:36:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e16a9794-d6f5-46ca-86eb-872533b948ed tempest-VolumesSnapshotTestJSON-1267003830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-70abf183-e8d5-4ed8-a35f-fa471663d562" returned: 0 in 0.378s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:36:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e16a9794-d6f5-46ca-86eb-872533b948ed tempest-VolumesSnapshotTestJSON-1267003830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-70abf183-e8d5-4ed8-a35f-fa471663d562 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:36:57 devstack sudo[102214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-70abf183-e8d5-4ed8-a35f-fa471663d562
Jul 14 16:36:57 devstack sudo[102214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:36:57 devstack sudo[102207]: pam_unix(sudo:session): session closed for user root
Jul 14 16:36:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5241fd7d-45d0-4880-84f4-c93d1d7f6241 tempest-ProjectReaderTests-1026204729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-7f1e8c5f-2f5c-4b02-876c-2bbcf9e3434d 1073741824" returned: 0 in 0.437s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:36:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5241fd7d-45d0-4880-84f4-c93d1d7f6241 tempest-ProjectReaderTests-1026204729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-7f1e8c5f-2f5c-4b02-876c-2bbcf9e3434d {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:36:58 devstack sudo[102219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-7f1e8c5f-2f5c-4b02-876c-2bbcf9e3434d
Jul 14 16:36:58 devstack sudo[102214]: pam_unix(sudo:session): session closed for user root
Jul 14 16:36:58 devstack sudo[102219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:36:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e16a9794-d6f5-46ca-86eb-872533b948ed tempest-VolumesSnapshotTestJSON-1267003830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-70abf183-e8d5-4ed8-a35f-fa471663d562" returned: 0 in 0.272s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:36:58 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e16a9794-d6f5-46ca-86eb-872533b948ed tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "cinder-quobyte-70abf183-e8d5-4ed8-a35f-fa471663d562" released by "delete_volume" :: held 0.714s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:36:58 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-e16a9794-d6f5-46ca-86eb-872533b948ed tempest-VolumesSnapshotTestJSON-1267003830 None] Created reservations ['0268192a-2295-4146-ae8c-4e69d4b0a92f', '504f2581-15c6-4a02-90e1-a55551671ef2', '161f57c0-5efb-4cd9-9463-13a557eea5de', '4f973a4a-45c5-4141-9e5d-b86754e78ad9'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:36:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e16a9794-d6f5-46ca-86eb-872533b948ed tempest-VolumesSnapshotTestJSON-1267003830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:36:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e16a9794-d6f5-46ca-86eb-872533b948ed tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:36:58 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-e16a9794-d6f5-46ca-86eb-872533b948ed tempest-VolumesSnapshotTestJSON-1267003830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:36:58 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-e16a9794-d6f5-46ca-86eb-872533b948ed tempest-VolumesSnapshotTestJSON-1267003830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:36:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e16a9794-d6f5-46ca-86eb-872533b948ed tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:36:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e16a9794-d6f5-46ca-86eb-872533b948ed tempest-VolumesSnapshotTestJSON-1267003830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:36:58 devstack sudo[102221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:36:58 devstack sudo[102221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:36:58 devstack sudo[102219]: pam_unix(sudo:session): session closed for user root
Jul 14 16:36:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5241fd7d-45d0-4880-84f4-c93d1d7f6241 tempest-ProjectReaderTests-1026204729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-7f1e8c5f-2f5c-4b02-876c-2bbcf9e3434d" returned: 0 in 0.254s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:36:58 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5241fd7d-45d0-4880-84f4-c93d1d7f6241 tempest-ProjectReaderTests-1026204729 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:36:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5241fd7d-45d0-4880-84f4-c93d1d7f6241 tempest-ProjectReaderTests-1026204729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:36:58 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5241fd7d-45d0-4880-84f4-c93d1d7f6241 tempest-ProjectReaderTests-1026204729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af97b1bd-50d2-43f6-a6b7-25adc5c4f5fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f1e8c5f-2f5c-4b02-876c-2bbcf9e3434d', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:36:58 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5241fd7d-45d0-4880-84f4-c93d1d7f6241 tempest-ProjectReaderTests-1026204729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1ab4374-09a9-4528-aaf5-36608d051386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:36:58 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-5241fd7d-45d0-4880-84f4-c93d1d7f6241 tempest-ProjectReaderTests-1026204729 None] Volume volume-7f1e8c5f-2f5c-4b02-876c-2bbcf9e3434d (7f1e8c5f-2f5c-4b02-876c-2bbcf9e3434d): created successfully
Jul 14 16:36:58 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5241fd7d-45d0-4880-84f4-c93d1d7f6241 tempest-ProjectReaderTests-1026204729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1ab4374-09a9-4528-aaf5-36608d051386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:36:58 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5241fd7d-45d0-4880-84f4-c93d1d7f6241 tempest-ProjectReaderTests-1026204729 None] Flow 'volume_create_manager' (5741ac41-e31c-4163-9d97-87c172399081) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:36:58 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-5241fd7d-45d0-4880-84f4-c93d1d7f6241 tempest-ProjectReaderTests-1026204729 None] Created volume successfully.
Jul 14 16:36:58 devstack sudo[102221]: pam_unix(sudo:session): session closed for user root
Jul 14 16:36:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e16a9794-d6f5-46ca-86eb-872533b948ed tempest-VolumesSnapshotTestJSON-1267003830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.257s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:36:58 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-e16a9794-d6f5-46ca-86eb-872533b948ed tempest-VolumesSnapshotTestJSON-1267003830 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:36:58 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-e16a9794-d6f5-46ca-86eb-872533b948ed tempest-VolumesSnapshotTestJSON-1267003830 None] Deleted volume successfully.
Jul 14 16:36:58 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e16a9794-d6f5-46ca-86eb-872533b948ed tempest-VolumesSnapshotTestJSON-1267003830 None] Lock "cinder-70abf183-e8d5-4ed8-a35f-fa471663d562-delete_volume" released by "delete_volume" :: held 1.189s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:36:58 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-737d724b-6874-464d-996e-954ff72e55d0 tempest-ProjectReaderTests-1026204729 None] Acquiring lock "cinder-7f1e8c5f-2f5c-4b02-876c-2bbcf9e3434d-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:36:58 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-737d724b-6874-464d-996e-954ff72e55d0 tempest-ProjectReaderTests-1026204729 None] Lock "cinder-7f1e8c5f-2f5c-4b02-876c-2bbcf9e3434d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:36:58 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-737d724b-6874-464d-996e-954ff72e55d0 tempest-ProjectReaderTests-1026204729 None] Acquiring lock "cinder-quobyte-7f1e8c5f-2f5c-4b02-876c-2bbcf9e3434d" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:36:58 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-737d724b-6874-464d-996e-954ff72e55d0 tempest-ProjectReaderTests-1026204729 None] Lock "cinder-quobyte-7f1e8c5f-2f5c-4b02-876c-2bbcf9e3434d" acquired by "delete_volume" :: waited 0.017s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:36:58 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87660ae-7992-4236-89b1-9ca9386253e7]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:36:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-737d724b-6874-464d-996e-954ff72e55d0 tempest-ProjectReaderTests-1026204729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-7f1e8c5f-2f5c-4b02-876c-2bbcf9e3434d {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:36:58 devstack sudo[102225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-7f1e8c5f-2f5c-4b02-876c-2bbcf9e3434d
Jul 14 16:36:58 devstack sudo[102225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:36:59 devstack sudo[102225]: pam_unix(sudo:session): session closed for user root
Jul 14 16:36:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-737d724b-6874-464d-996e-954ff72e55d0 tempest-ProjectReaderTests-1026204729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-7f1e8c5f-2f5c-4b02-876c-2bbcf9e3434d" returned: 0 in 0.407s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:36:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-737d724b-6874-464d-996e-954ff72e55d0 tempest-ProjectReaderTests-1026204729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-7f1e8c5f-2f5c-4b02-876c-2bbcf9e3434d {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:36:59 devstack sudo[102230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-7f1e8c5f-2f5c-4b02-876c-2bbcf9e3434d
Jul 14 16:36:59 devstack sudo[102230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:36:59 devstack sudo[102230]: pam_unix(sudo:session): session closed for user root
Jul 14 16:36:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-737d724b-6874-464d-996e-954ff72e55d0 tempest-ProjectReaderTests-1026204729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-7f1e8c5f-2f5c-4b02-876c-2bbcf9e3434d" returned: 0 in 0.270s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:36:59 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-737d724b-6874-464d-996e-954ff72e55d0 tempest-ProjectReaderTests-1026204729 None] Lock "cinder-quobyte-7f1e8c5f-2f5c-4b02-876c-2bbcf9e3434d" released by "delete_volume" :: held 0.717s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:36:59 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-737d724b-6874-464d-996e-954ff72e55d0 tempest-ProjectReaderTests-1026204729 None] Created reservations ['59962e04-3de7-424c-be12-1d726643fa98', '2e24618a-cd72-4d08-85c3-bc0c8c93643f', '59d59be5-c68e-49bd-9905-19014dd0840e', 'fd7a19c8-5921-4a12-9a1b-cde677bc4651'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:36:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-737d724b-6874-464d-996e-954ff72e55d0 tempest-ProjectReaderTests-1026204729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:36:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-737d724b-6874-464d-996e-954ff72e55d0 tempest-ProjectReaderTests-1026204729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:36:59 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-737d724b-6874-464d-996e-954ff72e55d0 tempest-ProjectReaderTests-1026204729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:36:59 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-737d724b-6874-464d-996e-954ff72e55d0 tempest-ProjectReaderTests-1026204729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:36:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-737d724b-6874-464d-996e-954ff72e55d0 tempest-ProjectReaderTests-1026204729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:36:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-737d724b-6874-464d-996e-954ff72e55d0 tempest-ProjectReaderTests-1026204729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:36:59 devstack sudo[102238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:36:59 devstack sudo[102238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:36:59 devstack sudo[102238]: pam_unix(sudo:session): session closed for user root
Jul 14 16:36:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-737d724b-6874-464d-996e-954ff72e55d0 tempest-ProjectReaderTests-1026204729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.286s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:36:59 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-737d724b-6874-464d-996e-954ff72e55d0 tempest-ProjectReaderTests-1026204729 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:36:59 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-737d724b-6874-464d-996e-954ff72e55d0 tempest-ProjectReaderTests-1026204729 None] Deleted volume successfully.
Jul 14 16:36:59 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-737d724b-6874-464d-996e-954ff72e55d0 tempest-ProjectReaderTests-1026204729 None] Lock "cinder-7f1e8c5f-2f5c-4b02-876c-2bbcf9e3434d-delete_volume" released by "delete_volume" :: held 1.258s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:37:00 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-a41111e7-4be4-4b5b-a66a-d67726ee8314 tempest-ProjectReaderTests-1026204729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:37:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a41111e7-4be4-4b5b-a66a-d67726ee8314 tempest-ProjectReaderTests-1026204729 None] Flow 'volume_create_manager' (03a2e4cd-5d55-4783-b6c6-fbb8f3c90422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:37:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a41111e7-4be4-4b5b-a66a-d67726ee8314 tempest-ProjectReaderTests-1026204729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f52604f-2bb4-4a54-9a28-774937b59cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:37:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a41111e7-4be4-4b5b-a66a-d67726ee8314 tempest-ProjectReaderTests-1026204729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f52604f-2bb4-4a54-9a28-774937b59cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-471925814',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a47f3c24-af64-4303-beff-042483dfeea9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33cb089a60ae4f44bbe6d9d50bc53fc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:37:01Z,use_quota=True,user_id='6019a4ccc77d4c2bb080d19c67df5bea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:37:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a41111e7-4be4-4b5b-a66a-d67726ee8314 tempest-ProjectReaderTests-1026204729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10022ee5-bc11-42f3-9a21-1dbcfcdf86ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:37:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a41111e7-4be4-4b5b-a66a-d67726ee8314 tempest-ProjectReaderTests-1026204729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10022ee5-bc11-42f3-9a21-1dbcfcdf86ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:37:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a41111e7-4be4-4b5b-a66a-d67726ee8314 tempest-ProjectReaderTests-1026204729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3bf1637-089a-469d-870d-4a91777389f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:37:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a41111e7-4be4-4b5b-a66a-d67726ee8314 tempest-ProjectReaderTests-1026204729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3bf1637-089a-469d-870d-4a91777389f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a47f3c24-af64-4303-beff-042483dfeea9', 'volume_name': 'volume-a47f3c24-af64-4303-beff-042483dfeea9', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:37:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a41111e7-4be4-4b5b-a66a-d67726ee8314 tempest-ProjectReaderTests-1026204729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10f2dd54-eda2-4a62-ac07-6e861ebbca47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:37:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a41111e7-4be4-4b5b-a66a-d67726ee8314 tempest-ProjectReaderTests-1026204729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10f2dd54-eda2-4a62-ac07-6e861ebbca47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:37:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a41111e7-4be4-4b5b-a66a-d67726ee8314 tempest-ProjectReaderTests-1026204729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a9a0415-8039-43e6-aaa2-ba6c2027cc52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:37:00 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-a41111e7-4be4-4b5b-a66a-d67726ee8314 tempest-ProjectReaderTests-1026204729 None] Volume a47f3c24-af64-4303-beff-042483dfeea9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a47f3c24-af64-4303-beff-042483dfeea9', 'volume_size': 1}
Jul 14 16:37:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a41111e7-4be4-4b5b-a66a-d67726ee8314 tempest-ProjectReaderTests-1026204729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:37:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a41111e7-4be4-4b5b-a66a-d67726ee8314 tempest-ProjectReaderTests-1026204729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:37:00 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a41111e7-4be4-4b5b-a66a-d67726ee8314 tempest-ProjectReaderTests-1026204729 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-471925814',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a47f3c24-af64-4303-beff-042483dfeea9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33cb089a60ae4f44bbe6d9d50bc53fc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:37:01Z,use_quota=True,user_id='6019a4ccc77d4c2bb080d19c67df5bea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:37:00 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-a41111e7-4be4-4b5b-a66a-d67726ee8314 tempest-ProjectReaderTests-1026204729 None] Creating volume a47f3c24-af64-4303-beff-042483dfeea9 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:37:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a41111e7-4be4-4b5b-a66a-d67726ee8314 tempest-ProjectReaderTests-1026204729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:37:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a41111e7-4be4-4b5b-a66a-d67726ee8314 tempest-ProjectReaderTests-1026204729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:37:00 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a41111e7-4be4-4b5b-a66a-d67726ee8314 tempest-ProjectReaderTests-1026204729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:37:00 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a41111e7-4be4-4b5b-a66a-d67726ee8314 tempest-ProjectReaderTests-1026204729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:37:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a41111e7-4be4-4b5b-a66a-d67726ee8314 tempest-ProjectReaderTests-1026204729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:37:00 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a41111e7-4be4-4b5b-a66a-d67726ee8314 tempest-ProjectReaderTests-1026204729 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:37:00 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-a41111e7-4be4-4b5b-a66a-d67726ee8314 tempest-ProjectReaderTests-1026204729 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:37:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a41111e7-4be4-4b5b-a66a-d67726ee8314 tempest-ProjectReaderTests-1026204729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a47f3c24-af64-4303-beff-042483dfeea9 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:37:00 devstack sudo[102244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a47f3c24-af64-4303-beff-042483dfeea9 1073741824
Jul 14 16:37:00 devstack sudo[102244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:37:01 devstack sudo[102244]: pam_unix(sudo:session): session closed for user root
Jul 14 16:37:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a41111e7-4be4-4b5b-a66a-d67726ee8314 tempest-ProjectReaderTests-1026204729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a47f3c24-af64-4303-beff-042483dfeea9 1073741824" returned: 0 in 0.766s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:37:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a41111e7-4be4-4b5b-a66a-d67726ee8314 tempest-ProjectReaderTests-1026204729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a47f3c24-af64-4303-beff-042483dfeea9 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:37:01 devstack sudo[102270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a47f3c24-af64-4303-beff-042483dfeea9
Jul 14 16:37:01 devstack sudo[102270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:37:01 devstack sudo[102270]: pam_unix(sudo:session): session closed for user root
Jul 14 16:37:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a41111e7-4be4-4b5b-a66a-d67726ee8314 tempest-ProjectReaderTests-1026204729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a47f3c24-af64-4303-beff-042483dfeea9" returned: 0 in 0.355s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:37:01 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a41111e7-4be4-4b5b-a66a-d67726ee8314 tempest-ProjectReaderTests-1026204729 None] <== create_volume: return (1187ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:37:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a41111e7-4be4-4b5b-a66a-d67726ee8314 tempest-ProjectReaderTests-1026204729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.194s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:37:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a41111e7-4be4-4b5b-a66a-d67726ee8314 tempest-ProjectReaderTests-1026204729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a9a0415-8039-43e6-aaa2-ba6c2027cc52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a47f3c24-af64-4303-beff-042483dfeea9', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:37:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a41111e7-4be4-4b5b-a66a-d67726ee8314 tempest-ProjectReaderTests-1026204729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65f9dcb1-2bda-41f4-aac5-73dfa0bf6c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:37:02 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-a41111e7-4be4-4b5b-a66a-d67726ee8314 tempest-ProjectReaderTests-1026204729 None] Volume volume-a47f3c24-af64-4303-beff-042483dfeea9 (a47f3c24-af64-4303-beff-042483dfeea9): created successfully
Jul 14 16:37:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a41111e7-4be4-4b5b-a66a-d67726ee8314 tempest-ProjectReaderTests-1026204729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65f9dcb1-2bda-41f4-aac5-73dfa0bf6c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:37:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a41111e7-4be4-4b5b-a66a-d67726ee8314 tempest-ProjectReaderTests-1026204729 None] Flow 'volume_create_manager' (03a2e4cd-5d55-4783-b6c6-fbb8f3c90422) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:37:02 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-a41111e7-4be4-4b5b-a66a-d67726ee8314 tempest-ProjectReaderTests-1026204729 None] Created volume successfully.
Jul 14 16:37:02 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6e1d63b5-03f8-44a1-8076-d3f42f2eacb9 tempest-ProjectReaderTests-1026204729 None] Acquiring lock "cinder-a47f3c24-af64-4303-beff-042483dfeea9-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:37:02 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6e1d63b5-03f8-44a1-8076-d3f42f2eacb9 tempest-ProjectReaderTests-1026204729 None] Lock "cinder-a47f3c24-af64-4303-beff-042483dfeea9-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:37:02 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6e1d63b5-03f8-44a1-8076-d3f42f2eacb9 tempest-ProjectReaderTests-1026204729 None] Acquiring lock "cinder-quobyte-a47f3c24-af64-4303-beff-042483dfeea9" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:37:02 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6e1d63b5-03f8-44a1-8076-d3f42f2eacb9 tempest-ProjectReaderTests-1026204729 None] Lock "cinder-quobyte-a47f3c24-af64-4303-beff-042483dfeea9" acquired by "delete_volume" :: waited 0.038s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:37:02 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-2025ba4e-ac75-4bc6-91e5-d1885d2c2326 req-6ff93875-5ff0-4f52-b405-775db6c14125 tempest-TestShelveInstance-2021071679 None] Terminate volume connection completed successfully.
Jul 14 16:37:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-2025ba4e-ac75-4bc6-91e5-d1885d2c2326 req-6ff93875-5ff0-4f52-b405-775db6c14125 tempest-TestShelveInstance-2021071679 None] Deleting attachment f6e1fde1-facd-4c78-b577-d61f8102ea68. {{(pid=87166) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 14 16:37:02 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[092cd01f-9594-4943-97c7-e7b0a0f27c1a]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:37:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6e1d63b5-03f8-44a1-8076-d3f42f2eacb9 tempest-ProjectReaderTests-1026204729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a47f3c24-af64-4303-beff-042483dfeea9 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:37:03 devstack sudo[102277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a47f3c24-af64-4303-beff-042483dfeea9
Jul 14 16:37:03 devstack sudo[102277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:37:03 devstack cinder-volume[87166]: DEBUG cinder.coordination [req-2025ba4e-ac75-4bc6-91e5-d1885d2c2326 req-6c7d8331-63a0-4036-96d5-40eab0eddb79 tempest-TestShelveInstance-2021071679 None] Acquiring lock "cinder-8cca2447-51d6-4611-8fcd-5f9876a9877e-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:37:03 devstack cinder-volume[87166]: DEBUG cinder.coordination [req-2025ba4e-ac75-4bc6-91e5-d1885d2c2326 req-6c7d8331-63a0-4036-96d5-40eab0eddb79 tempest-TestShelveInstance-2021071679 None] Lock "cinder-8cca2447-51d6-4611-8fcd-5f9876a9877e-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:37:03 devstack cinder-volume[87166]: DEBUG cinder.coordination [req-2025ba4e-ac75-4bc6-91e5-d1885d2c2326 req-6c7d8331-63a0-4036-96d5-40eab0eddb79 tempest-TestShelveInstance-2021071679 None] Acquiring lock "cinder-quobyte-8cca2447-51d6-4611-8fcd-5f9876a9877e" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:37:03 devstack cinder-volume[87166]: DEBUG cinder.coordination [req-2025ba4e-ac75-4bc6-91e5-d1885d2c2326 req-6c7d8331-63a0-4036-96d5-40eab0eddb79 tempest-TestShelveInstance-2021071679 None] Lock "cinder-quobyte-8cca2447-51d6-4611-8fcd-5f9876a9877e" acquired by "delete_volume" :: waited 0.026s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:37:03 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[0526f998-20b9-4370-8923-bdabdeb6f59b]: (4, 'raw') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:37:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-2025ba4e-ac75-4bc6-91e5-d1885d2c2326 req-6c7d8331-63a0-4036-96d5-40eab0eddb79 tempest-TestShelveInstance-2021071679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8cca2447-51d6-4611-8fcd-5f9876a9877e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:37:03 devstack sudo[102281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8cca2447-51d6-4611-8fcd-5f9876a9877e
Jul 14 16:37:03 devstack sudo[102281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:37:03 devstack sudo[102277]: pam_unix(sudo:session): session closed for user root
Jul 14 16:37:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6e1d63b5-03f8-44a1-8076-d3f42f2eacb9 tempest-ProjectReaderTests-1026204729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a47f3c24-af64-4303-beff-042483dfeea9" returned: 0 in 0.645s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:37:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6e1d63b5-03f8-44a1-8076-d3f42f2eacb9 tempest-ProjectReaderTests-1026204729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a47f3c24-af64-4303-beff-042483dfeea9 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:37:03 devstack sudo[102286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a47f3c24-af64-4303-beff-042483dfeea9
Jul 14 16:37:03 devstack sudo[102286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:37:03 devstack sudo[102281]: pam_unix(sudo:session): session closed for user root
Jul 14 16:37:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-2025ba4e-ac75-4bc6-91e5-d1885d2c2326 req-6c7d8331-63a0-4036-96d5-40eab0eddb79 tempest-TestShelveInstance-2021071679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8cca2447-51d6-4611-8fcd-5f9876a9877e" returned: 0 in 0.511s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:37:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-2025ba4e-ac75-4bc6-91e5-d1885d2c2326 req-6c7d8331-63a0-4036-96d5-40eab0eddb79 tempest-TestShelveInstance-2021071679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8cca2447-51d6-4611-8fcd-5f9876a9877e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:37:04 devstack sudo[102290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8cca2447-51d6-4611-8fcd-5f9876a9877e
Jul 14 16:37:04 devstack sudo[102290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:37:04 devstack sudo[102286]: pam_unix(sudo:session): session closed for user root
Jul 14 16:37:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6e1d63b5-03f8-44a1-8076-d3f42f2eacb9 tempest-ProjectReaderTests-1026204729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a47f3c24-af64-4303-beff-042483dfeea9" returned: 0 in 0.417s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:37:04 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6e1d63b5-03f8-44a1-8076-d3f42f2eacb9 tempest-ProjectReaderTests-1026204729 None] Lock "cinder-quobyte-a47f3c24-af64-4303-beff-042483dfeea9" released by "delete_volume" :: held 1.135s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:37:04 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-6e1d63b5-03f8-44a1-8076-d3f42f2eacb9 tempest-ProjectReaderTests-1026204729 None] Created reservations ['b396f23a-74e9-4666-91e7-53fd144341a1', 'b7cd4860-978c-40d2-b5ba-e48f59603f33', '42d7eca0-5fba-42cd-8df7-63187a42f0f2', '4cbb5a21-13f7-44d4-a73d-76176da87410'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:37:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6e1d63b5-03f8-44a1-8076-d3f42f2eacb9 tempest-ProjectReaderTests-1026204729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:37:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6e1d63b5-03f8-44a1-8076-d3f42f2eacb9 tempest-ProjectReaderTests-1026204729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:37:04 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6e1d63b5-03f8-44a1-8076-d3f42f2eacb9 tempest-ProjectReaderTests-1026204729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:37:04 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6e1d63b5-03f8-44a1-8076-d3f42f2eacb9 tempest-ProjectReaderTests-1026204729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:37:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6e1d63b5-03f8-44a1-8076-d3f42f2eacb9 tempest-ProjectReaderTests-1026204729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:37:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6e1d63b5-03f8-44a1-8076-d3f42f2eacb9 tempest-ProjectReaderTests-1026204729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:37:04 devstack sudo[102296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:37:04 devstack sudo[102296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:37:04 devstack sudo[102290]: pam_unix(sudo:session): session closed for user root
Jul 14 16:37:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-2025ba4e-ac75-4bc6-91e5-d1885d2c2326 req-6c7d8331-63a0-4036-96d5-40eab0eddb79 tempest-TestShelveInstance-2021071679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8cca2447-51d6-4611-8fcd-5f9876a9877e" returned: 1 in 0.449s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:37:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-2025ba4e-ac75-4bc6-91e5-d1885d2c2326 req-6c7d8331-63a0-4036-96d5-40eab0eddb79 tempest-TestShelveInstance-2021071679 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8cca2447-51d6-4611-8fcd-5f9876a9877e' failed. Not Retrying. {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 16:37:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-2025ba4e-ac75-4bc6-91e5-d1885d2c2326 req-6c7d8331-63a0-4036-96d5-40eab0eddb79 tempest-TestShelveInstance-2021071679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8cca2447-51d6-4611-8fcd-5f9876a9877e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:37:04 devstack sudo[102299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8cca2447-51d6-4611-8fcd-5f9876a9877e
Jul 14 16:37:04 devstack sudo[102299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:37:04 devstack sudo[102296]: pam_unix(sudo:session): session closed for user root
Jul 14 16:37:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6e1d63b5-03f8-44a1-8076-d3f42f2eacb9 tempest-ProjectReaderTests-1026204729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.335s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:37:04 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-6e1d63b5-03f8-44a1-8076-d3f42f2eacb9 tempest-ProjectReaderTests-1026204729 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:37:04 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-6e1d63b5-03f8-44a1-8076-d3f42f2eacb9 tempest-ProjectReaderTests-1026204729 None] Deleted volume successfully.
Jul 14 16:37:04 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6e1d63b5-03f8-44a1-8076-d3f42f2eacb9 tempest-ProjectReaderTests-1026204729 None] Lock "cinder-a47f3c24-af64-4303-beff-042483dfeea9-delete_volume" released by "delete_volume" :: held 1.802s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:37:04 devstack sudo[102299]: pam_unix(sudo:session): session closed for user root
Jul 14 16:37:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-2025ba4e-ac75-4bc6-91e5-d1885d2c2326 req-6c7d8331-63a0-4036-96d5-40eab0eddb79 tempest-TestShelveInstance-2021071679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8cca2447-51d6-4611-8fcd-5f9876a9877e" returned: 0 in 0.386s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:37:04 devstack cinder-volume[87166]: DEBUG cinder.coordination [req-2025ba4e-ac75-4bc6-91e5-d1885d2c2326 req-6c7d8331-63a0-4036-96d5-40eab0eddb79 tempest-TestShelveInstance-2021071679 None] Lock "cinder-quobyte-8cca2447-51d6-4611-8fcd-5f9876a9877e" released by "delete_volume" :: held 1.438s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:37:04 devstack cinder-volume[87166]: DEBUG cinder.quota [req-2025ba4e-ac75-4bc6-91e5-d1885d2c2326 req-6c7d8331-63a0-4036-96d5-40eab0eddb79 tempest-TestShelveInstance-2021071679 None] Created reservations ['08608bfc-49c0-4568-bc2d-0bea671e4d47', '58407e27-d505-4413-abb7-2cb531b36a7e', '0e9d54c8-84ee-40b9-8c9e-55233222d8d5', '5006b00a-42db-4c20-8794-6b24682634eb'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:37:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-2025ba4e-ac75-4bc6-91e5-d1885d2c2326 req-6c7d8331-63a0-4036-96d5-40eab0eddb79 tempest-TestShelveInstance-2021071679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:37:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-2025ba4e-ac75-4bc6-91e5-d1885d2c2326 req-6c7d8331-63a0-4036-96d5-40eab0eddb79 tempest-TestShelveInstance-2021071679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:37:04 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [req-2025ba4e-ac75-4bc6-91e5-d1885d2c2326 req-6c7d8331-63a0-4036-96d5-40eab0eddb79 tempest-TestShelveInstance-2021071679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:37:04 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [req-2025ba4e-ac75-4bc6-91e5-d1885d2c2326 req-6c7d8331-63a0-4036-96d5-40eab0eddb79 tempest-TestShelveInstance-2021071679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:37:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-2025ba4e-ac75-4bc6-91e5-d1885d2c2326 req-6c7d8331-63a0-4036-96d5-40eab0eddb79 tempest-TestShelveInstance-2021071679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:37:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-2025ba4e-ac75-4bc6-91e5-d1885d2c2326 req-6c7d8331-63a0-4036-96d5-40eab0eddb79 tempest-TestShelveInstance-2021071679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:37:04 devstack sudo[102303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:37:04 devstack sudo[102303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:37:05 devstack sudo[102303]: pam_unix(sudo:session): session closed for user root
Jul 14 16:37:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-2025ba4e-ac75-4bc6-91e5-d1885d2c2326 req-6c7d8331-63a0-4036-96d5-40eab0eddb79 tempest-TestShelveInstance-2021071679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.334s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:37:05 devstack cinder-volume[87166]: DEBUG cinder.manager [req-2025ba4e-ac75-4bc6-91e5-d1885d2c2326 req-6c7d8331-63a0-4036-96d5-40eab0eddb79 tempest-TestShelveInstance-2021071679 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:37:05 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-2025ba4e-ac75-4bc6-91e5-d1885d2c2326 req-6c7d8331-63a0-4036-96d5-40eab0eddb79 tempest-TestShelveInstance-2021071679 None] Deleted volume successfully.
Jul 14 16:37:05 devstack cinder-volume[87166]: DEBUG cinder.coordination [req-2025ba4e-ac75-4bc6-91e5-d1885d2c2326 req-6c7d8331-63a0-4036-96d5-40eab0eddb79 tempest-TestShelveInstance-2021071679 None] Lock "cinder-8cca2447-51d6-4611-8fcd-5f9876a9877e-delete_volume" released by "delete_volume" :: held 2.041s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:37:14 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:SELECT=126,cinder:UPDATE=140,cinder:INSERT=31,cinder:DELETE=8 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 16:37:15 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:UPDATE=126,cinder:SELECT=123,cinder:INSERT=33,cinder:DELETE=13 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 16:37:31 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-b80ed7af-496e-4caf-b510-a94af9a83977 tempest-TestStampPattern-1631901009 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:37:31 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b80ed7af-496e-4caf-b510-a94af9a83977 tempest-TestStampPattern-1631901009 None] Flow 'volume_create_manager' (0d40b116-4063-4a29-bd01-c563e926c275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:37:31 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b80ed7af-496e-4caf-b510-a94af9a83977 tempest-TestStampPattern-1631901009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ba89c16-64a5-45d8-8708-ef1dfba40709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:37:31 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b80ed7af-496e-4caf-b510-a94af9a83977 tempest-TestStampPattern-1631901009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ba89c16-64a5-45d8-8708-ef1dfba40709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:37:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1910344084',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=193630ff-b6f9-4539-9ac6-ff135adde62a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94db136c65d04a08a9fae21cb5c665da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:37:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:37:31Z,use_quota=True,user_id='0f9f67f3c19043d190dc7e83a72295c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:37:31 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b80ed7af-496e-4caf-b510-a94af9a83977 tempest-TestStampPattern-1631901009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b26ecf5-9e1c-4dc0-bd17-9a293da8b7e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:37:31 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b80ed7af-496e-4caf-b510-a94af9a83977 tempest-TestStampPattern-1631901009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b26ecf5-9e1c-4dc0-bd17-9a293da8b7e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:37:31 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b80ed7af-496e-4caf-b510-a94af9a83977 tempest-TestStampPattern-1631901009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edbb4800-b847-47c2-8b1f-1e73c00ef1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:37:31 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b80ed7af-496e-4caf-b510-a94af9a83977 tempest-TestStampPattern-1631901009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edbb4800-b847-47c2-8b1f-1e73c00ef1ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '193630ff-b6f9-4539-9ac6-ff135adde62a', 'volume_name': 'volume-193630ff-b6f9-4539-9ac6-ff135adde62a', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:37:31 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b80ed7af-496e-4caf-b510-a94af9a83977 tempest-TestStampPattern-1631901009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba019726-c805-41ec-81a8-43afcfb474dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:37:31 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b80ed7af-496e-4caf-b510-a94af9a83977 tempest-TestStampPattern-1631901009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba019726-c805-41ec-81a8-43afcfb474dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:37:31 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b80ed7af-496e-4caf-b510-a94af9a83977 tempest-TestStampPattern-1631901009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cd68fe6-09d4-4988-a829-19cd9b52c680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:37:31 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-b80ed7af-496e-4caf-b510-a94af9a83977 tempest-TestStampPattern-1631901009 None] Volume 193630ff-b6f9-4539-9ac6-ff135adde62a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-193630ff-b6f9-4539-9ac6-ff135adde62a', 'volume_size': 1}
Jul 14 16:37:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b80ed7af-496e-4caf-b510-a94af9a83977 tempest-TestStampPattern-1631901009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:37:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b80ed7af-496e-4caf-b510-a94af9a83977 tempest-TestStampPattern-1631901009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:37:31 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-b80ed7af-496e-4caf-b510-a94af9a83977 tempest-TestStampPattern-1631901009 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:37:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1910344084',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=193630ff-b6f9-4539-9ac6-ff135adde62a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94db136c65d04a08a9fae21cb5c665da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:37:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:37:31Z,use_quota=True,user_id='0f9f67f3c19043d190dc7e83a72295c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:37:31 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-b80ed7af-496e-4caf-b510-a94af9a83977 tempest-TestStampPattern-1631901009 None] Creating volume 193630ff-b6f9-4539-9ac6-ff135adde62a {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:37:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b80ed7af-496e-4caf-b510-a94af9a83977 tempest-TestStampPattern-1631901009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:37:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b80ed7af-496e-4caf-b510-a94af9a83977 tempest-TestStampPattern-1631901009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:37:31 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-b80ed7af-496e-4caf-b510-a94af9a83977 tempest-TestStampPattern-1631901009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:37:31 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-b80ed7af-496e-4caf-b510-a94af9a83977 tempest-TestStampPattern-1631901009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:37:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b80ed7af-496e-4caf-b510-a94af9a83977 tempest-TestStampPattern-1631901009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:37:31 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-b80ed7af-496e-4caf-b510-a94af9a83977 tempest-TestStampPattern-1631901009 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:37:31 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-b80ed7af-496e-4caf-b510-a94af9a83977 tempest-TestStampPattern-1631901009 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:37:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b80ed7af-496e-4caf-b510-a94af9a83977 tempest-TestStampPattern-1631901009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-193630ff-b6f9-4539-9ac6-ff135adde62a 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:37:31 devstack sudo[102356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-193630ff-b6f9-4539-9ac6-ff135adde62a 1073741824
Jul 14 16:37:31 devstack sudo[102356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:37:31 devstack sudo[102356]: pam_unix(sudo:session): session closed for user root
Jul 14 16:37:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b80ed7af-496e-4caf-b510-a94af9a83977 tempest-TestStampPattern-1631901009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-193630ff-b6f9-4539-9ac6-ff135adde62a 1073741824" returned: 0 in 0.613s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:37:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b80ed7af-496e-4caf-b510-a94af9a83977 tempest-TestStampPattern-1631901009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-193630ff-b6f9-4539-9ac6-ff135adde62a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:37:31 devstack sudo[102361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-193630ff-b6f9-4539-9ac6-ff135adde62a
Jul 14 16:37:31 devstack sudo[102361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:37:32 devstack sudo[102361]: pam_unix(sudo:session): session closed for user root
Jul 14 16:37:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b80ed7af-496e-4caf-b510-a94af9a83977 tempest-TestStampPattern-1631901009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-193630ff-b6f9-4539-9ac6-ff135adde62a" returned: 0 in 0.284s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:37:32 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-b80ed7af-496e-4caf-b510-a94af9a83977 tempest-TestStampPattern-1631901009 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:37:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b80ed7af-496e-4caf-b510-a94af9a83977 tempest-TestStampPattern-1631901009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:37:32 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b80ed7af-496e-4caf-b510-a94af9a83977 tempest-TestStampPattern-1631901009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cd68fe6-09d4-4988-a829-19cd9b52c680) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-193630ff-b6f9-4539-9ac6-ff135adde62a', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:37:32 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b80ed7af-496e-4caf-b510-a94af9a83977 tempest-TestStampPattern-1631901009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bab144cf-122f-4d93-81bf-6c498480449c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:37:32 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-b80ed7af-496e-4caf-b510-a94af9a83977 tempest-TestStampPattern-1631901009 None] Volume volume-193630ff-b6f9-4539-9ac6-ff135adde62a (193630ff-b6f9-4539-9ac6-ff135adde62a): created successfully
Jul 14 16:37:32 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b80ed7af-496e-4caf-b510-a94af9a83977 tempest-TestStampPattern-1631901009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bab144cf-122f-4d93-81bf-6c498480449c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:37:32 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b80ed7af-496e-4caf-b510-a94af9a83977 tempest-TestStampPattern-1631901009 None] Flow 'volume_create_manager' (0d40b116-4063-4a29-bd01-c563e926c275) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:37:32 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-b80ed7af-496e-4caf-b510-a94af9a83977 tempest-TestStampPattern-1631901009 None] Created volume successfully.
Jul 14 16:37:35 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 16:37:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:37:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:37:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:37:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:37:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:37:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:37:35 devstack sudo[102368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:37:35 devstack sudo[102368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:37:35 devstack sudo[102368]: pam_unix(sudo:session): session closed for user root
Jul 14 16:37:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.309s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:37:35 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:37:35 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Running periodic task VolumeManager._thread_info {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 16:37:35 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] thread count: 29 {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 14 16:37:35 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] thread info: [<_MainThread(MainThread, started 128606490927232)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128606415432960)>, <Thread(Thread-3 (stat_writer), started daemon 128606378859328)>, <Thread(Rabbit-heartbeat, started daemon 128606379646144)>, <Thread(Thread-5 (_runner), started daemon 128606377685824)>, <Thread(Thread-7 (_runner), started daemon 128606377701888)>, <Thread(fd_logger, started daemon 128606377091392)>, <Thread(privsep_reader, started daemon 128606375782080)>, <Thread(tpool_thread_0, started daemon 128606365607616)>, <Thread(tpool_thread_1, started daemon 128606357214912)>, <Thread(tpool_thread_2, started daemon 128606348822208)>, <Thread(tpool_thread_3, started daemon 128606340413120)>, <Thread(tpool_thread_4, started daemon 128606332004032)>, <Thread(tpool_thread_5, started daemon 128606323594944)>, <Thread(tpool_thread_6, started daemon 128606315185856)>, <Thread(tpool_thread_7, started daemon 128606306776768)>, <Thread(tpool_thread_8, started daemon 128606298367680)>, <Thread(tpool_thread_9, started daemon 128606289958592)>, <Thread(tpool_thread_10, started daemon 128606281549504)>, <Thread(tpool_thread_11, started daemon 128606273140416)>, <Thread(tpool_thread_12, started daemon 128606264731328)>, <Thread(tpool_thread_13, started daemon 128606256322240)>, <Thread(tpool_thread_14, started daemon 128606247913152)>, <Thread(tpool_thread_15, started daemon 128606239504064)>, <Thread(tpool_thread_16, started daemon 128606231094976)>, <Thread(tpool_thread_17, started daemon 128606222685888)>, <Thread(tpool_thread_18, started daemon 128606214276800)>, <Thread(tpool_thread_19, started daemon 128606205867712)>, <Thread(Rabbit-heartbeat, started daemon 128606368169344)>] {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 14 16:37:37 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-0139a1d6-c596-4314-aac6-edfd957d75fe tempest-SnapshotDependencyTests-1774280606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:37:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0139a1d6-c596-4314-aac6-edfd957d75fe tempest-SnapshotDependencyTests-1774280606 None] Flow 'volume_create_manager' (d0ae3dd8-fd50-40e6-af30-6726cdae877a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:37:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0139a1d6-c596-4314-aac6-edfd957d75fe tempest-SnapshotDependencyTests-1774280606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa4b805a-1abb-480e-8e7b-6f0b7e243ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:37:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0139a1d6-c596-4314-aac6-edfd957d75fe tempest-SnapshotDependencyTests-1774280606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa4b805a-1abb-480e-8e7b-6f0b7e243ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:37:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-483580240',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6c684e4-1a2e-4c99-8d37-faae92b62e14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5ff5609d3524ff3b108ad86f29e3f02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:37:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:37:38Z,use_quota=True,user_id='0b0ec9f6ffed45b88b242e1cfbc8b1f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:37:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0139a1d6-c596-4314-aac6-edfd957d75fe tempest-SnapshotDependencyTests-1774280606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (982e0ae0-02ab-4aab-825a-42a76b74e318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:37:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0139a1d6-c596-4314-aac6-edfd957d75fe tempest-SnapshotDependencyTests-1774280606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (982e0ae0-02ab-4aab-825a-42a76b74e318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:37:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0139a1d6-c596-4314-aac6-edfd957d75fe tempest-SnapshotDependencyTests-1774280606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b19921f-67c3-4349-87f8-9d74f384cc9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:37:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0139a1d6-c596-4314-aac6-edfd957d75fe tempest-SnapshotDependencyTests-1774280606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b19921f-67c3-4349-87f8-9d74f384cc9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6c684e4-1a2e-4c99-8d37-faae92b62e14', 'volume_name': 'volume-a6c684e4-1a2e-4c99-8d37-faae92b62e14', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:37:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0139a1d6-c596-4314-aac6-edfd957d75fe tempest-SnapshotDependencyTests-1774280606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b118c9ab-fa46-4074-b47f-65f73c94ca04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:37:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0139a1d6-c596-4314-aac6-edfd957d75fe tempest-SnapshotDependencyTests-1774280606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b118c9ab-fa46-4074-b47f-65f73c94ca04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:37:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0139a1d6-c596-4314-aac6-edfd957d75fe tempest-SnapshotDependencyTests-1774280606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c16143f-e260-43a2-b0c0-b29395e87240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:37:37 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-0139a1d6-c596-4314-aac6-edfd957d75fe tempest-SnapshotDependencyTests-1774280606 None] Volume a6c684e4-1a2e-4c99-8d37-faae92b62e14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6c684e4-1a2e-4c99-8d37-faae92b62e14', 'volume_size': 1}
Jul 14 16:37:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0139a1d6-c596-4314-aac6-edfd957d75fe tempest-SnapshotDependencyTests-1774280606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:37:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0139a1d6-c596-4314-aac6-edfd957d75fe tempest-SnapshotDependencyTests-1774280606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:37:37 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0139a1d6-c596-4314-aac6-edfd957d75fe tempest-SnapshotDependencyTests-1774280606 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:37:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-483580240',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6c684e4-1a2e-4c99-8d37-faae92b62e14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5ff5609d3524ff3b108ad86f29e3f02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:37:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:37:38Z,use_quota=True,user_id='0b0ec9f6ffed45b88b242e1cfbc8b1f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:37:37 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-0139a1d6-c596-4314-aac6-edfd957d75fe tempest-SnapshotDependencyTests-1774280606 None] Creating volume a6c684e4-1a2e-4c99-8d37-faae92b62e14 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:37:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0139a1d6-c596-4314-aac6-edfd957d75fe tempest-SnapshotDependencyTests-1774280606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:37:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0139a1d6-c596-4314-aac6-edfd957d75fe tempest-SnapshotDependencyTests-1774280606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:37:37 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0139a1d6-c596-4314-aac6-edfd957d75fe tempest-SnapshotDependencyTests-1774280606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:37:37 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0139a1d6-c596-4314-aac6-edfd957d75fe tempest-SnapshotDependencyTests-1774280606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:37:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0139a1d6-c596-4314-aac6-edfd957d75fe tempest-SnapshotDependencyTests-1774280606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:37:37 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0139a1d6-c596-4314-aac6-edfd957d75fe tempest-SnapshotDependencyTests-1774280606 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:37:37 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-0139a1d6-c596-4314-aac6-edfd957d75fe tempest-SnapshotDependencyTests-1774280606 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:37:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0139a1d6-c596-4314-aac6-edfd957d75fe tempest-SnapshotDependencyTests-1774280606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a6c684e4-1a2e-4c99-8d37-faae92b62e14 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:37:37 devstack sudo[102389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a6c684e4-1a2e-4c99-8d37-faae92b62e14 1073741824
Jul 14 16:37:37 devstack sudo[102389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:37:38 devstack sudo[102389]: pam_unix(sudo:session): session closed for user root
Jul 14 16:37:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0139a1d6-c596-4314-aac6-edfd957d75fe tempest-SnapshotDependencyTests-1774280606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a6c684e4-1a2e-4c99-8d37-faae92b62e14 1073741824" returned: 0 in 0.566s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:37:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0139a1d6-c596-4314-aac6-edfd957d75fe tempest-SnapshotDependencyTests-1774280606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a6c684e4-1a2e-4c99-8d37-faae92b62e14 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:37:38 devstack sudo[102395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a6c684e4-1a2e-4c99-8d37-faae92b62e14
Jul 14 16:37:38 devstack sudo[102395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:37:38 devstack sudo[102395]: pam_unix(sudo:session): session closed for user root
Jul 14 16:37:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0139a1d6-c596-4314-aac6-edfd957d75fe tempest-SnapshotDependencyTests-1774280606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a6c684e4-1a2e-4c99-8d37-faae92b62e14" returned: 0 in 0.257s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:37:38 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0139a1d6-c596-4314-aac6-edfd957d75fe tempest-SnapshotDependencyTests-1774280606 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:37:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0139a1d6-c596-4314-aac6-edfd957d75fe tempest-SnapshotDependencyTests-1774280606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:37:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0139a1d6-c596-4314-aac6-edfd957d75fe tempest-SnapshotDependencyTests-1774280606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c16143f-e260-43a2-b0c0-b29395e87240) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6c684e4-1a2e-4c99-8d37-faae92b62e14', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:37:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0139a1d6-c596-4314-aac6-edfd957d75fe tempest-SnapshotDependencyTests-1774280606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20ae8f25-e7a9-40eb-b248-06fe05b5adb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:37:38 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-0139a1d6-c596-4314-aac6-edfd957d75fe tempest-SnapshotDependencyTests-1774280606 None] Volume volume-a6c684e4-1a2e-4c99-8d37-faae92b62e14 (a6c684e4-1a2e-4c99-8d37-faae92b62e14): created successfully
Jul 14 16:37:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0139a1d6-c596-4314-aac6-edfd957d75fe tempest-SnapshotDependencyTests-1774280606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20ae8f25-e7a9-40eb-b248-06fe05b5adb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:37:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0139a1d6-c596-4314-aac6-edfd957d75fe tempest-SnapshotDependencyTests-1774280606 None] Flow 'volume_create_manager' (d0ae3dd8-fd50-40e6-af30-6726cdae877a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:37:38 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-0139a1d6-c596-4314-aac6-edfd957d75fe tempest-SnapshotDependencyTests-1774280606 None] Created volume successfully.
Jul 14 16:37:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d8ec7b25-346b-423f-9812-c609f030992c tempest-SnapshotDependencyTests-1774280606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:37:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d8ec7b25-346b-423f-9812-c609f030992c tempest-SnapshotDependencyTests-1774280606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:37:40 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-d8ec7b25-346b-423f-9812-c609f030992c tempest-SnapshotDependencyTests-1774280606 None] Creating offline snapshot 52de3b31-e7bf-4500-b156-3355e9e84870 of volume a6c684e4-1a2e-4c99-8d37-faae92b62e14 {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 16:37:40 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[048f3675-b8a8-48c1-9623-7e6f8c8964b5]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:37:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d8ec7b25-346b-423f-9812-c609f030992c tempest-SnapshotDependencyTests-1774280606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a6c684e4-1a2e-4c99-8d37-faae92b62e14 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:37:40 devstack sudo[102400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a6c684e4-1a2e-4c99-8d37-faae92b62e14
Jul 14 16:37:40 devstack sudo[102400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:37:40 devstack sudo[102400]: pam_unix(sudo:session): session closed for user root
Jul 14 16:37:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d8ec7b25-346b-423f-9812-c609f030992c tempest-SnapshotDependencyTests-1774280606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a6c684e4-1a2e-4c99-8d37-faae92b62e14" returned: 0 in 0.610s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:37:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d8ec7b25-346b-423f-9812-c609f030992c tempest-SnapshotDependencyTests-1774280606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a6c684e4-1a2e-4c99-8d37-faae92b62e14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a6c684e4-1a2e-4c99-8d37-faae92b62e14.52de3b31-e7bf-4500-b156-3355e9e84870 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:37:40 devstack sudo[102443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a6c684e4-1a2e-4c99-8d37-faae92b62e14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a6c684e4-1a2e-4c99-8d37-faae92b62e14.52de3b31-e7bf-4500-b156-3355e9e84870 1G
Jul 14 16:37:40 devstack sudo[102443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:37:41 devstack sudo[102443]: pam_unix(sudo:session): session closed for user root
Jul 14 16:37:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d8ec7b25-346b-423f-9812-c609f030992c tempest-SnapshotDependencyTests-1774280606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a6c684e4-1a2e-4c99-8d37-faae92b62e14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a6c684e4-1a2e-4c99-8d37-faae92b62e14.52de3b31-e7bf-4500-b156-3355e9e84870 1G" returned: 0 in 0.644s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:37:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d8ec7b25-346b-423f-9812-c609f030992c tempest-SnapshotDependencyTests-1774280606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6c684e4-1a2e-4c99-8d37-faae92b62e14 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a6c684e4-1a2e-4c99-8d37-faae92b62e14.52de3b31-e7bf-4500-b156-3355e9e84870 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:37:41 devstack sudo[102475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6c684e4-1a2e-4c99-8d37-faae92b62e14 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a6c684e4-1a2e-4c99-8d37-faae92b62e14.52de3b31-e7bf-4500-b156-3355e9e84870
Jul 14 16:37:41 devstack sudo[102475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:37:41 devstack sudo[102475]: pam_unix(sudo:session): session closed for user root
Jul 14 16:37:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d8ec7b25-346b-423f-9812-c609f030992c tempest-SnapshotDependencyTests-1774280606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6c684e4-1a2e-4c99-8d37-faae92b62e14 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a6c684e4-1a2e-4c99-8d37-faae92b62e14.52de3b31-e7bf-4500-b156-3355e9e84870" returned: 0 in 0.329s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:37:41 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-d8ec7b25-346b-423f-9812-c609f030992c tempest-SnapshotDependencyTests-1774280606 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a6c684e4-1a2e-4c99-8d37-faae92b62e14.52de3b31-e7bf-4500-b156-3355e9e84870 is being set with open permissions: ugo+rw
Jul 14 16:37:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d8ec7b25-346b-423f-9812-c609f030992c tempest-SnapshotDependencyTests-1774280606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a6c684e4-1a2e-4c99-8d37-faae92b62e14.52de3b31-e7bf-4500-b156-3355e9e84870 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:37:41 devstack sudo[102483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a6c684e4-1a2e-4c99-8d37-faae92b62e14.52de3b31-e7bf-4500-b156-3355e9e84870
Jul 14 16:37:41 devstack sudo[102483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:37:41 devstack sudo[102483]: pam_unix(sudo:session): session closed for user root
Jul 14 16:37:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d8ec7b25-346b-423f-9812-c609f030992c tempest-SnapshotDependencyTests-1774280606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a6c684e4-1a2e-4c99-8d37-faae92b62e14.52de3b31-e7bf-4500-b156-3355e9e84870" returned: 0 in 0.322s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:37:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d8ec7b25-346b-423f-9812-c609f030992c tempest-SnapshotDependencyTests-1774280606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a6c684e4-1a2e-4c99-8d37-faae92b62e14.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:37:42 devstack sudo[102488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a6c684e4-1a2e-4c99-8d37-faae92b62e14.info
Jul 14 16:37:42 devstack sudo[102488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:37:42 devstack sudo[102488]: pam_unix(sudo:session): session closed for user root
Jul 14 16:37:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d8ec7b25-346b-423f-9812-c609f030992c tempest-SnapshotDependencyTests-1774280606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a6c684e4-1a2e-4c99-8d37-faae92b62e14.info" returned: 0 in 0.327s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:37:42 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-d8ec7b25-346b-423f-9812-c609f030992c tempest-SnapshotDependencyTests-1774280606 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a6c684e4-1a2e-4c99-8d37-faae92b62e14.info is being set with open permissions: ugo+rw
Jul 14 16:37:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d8ec7b25-346b-423f-9812-c609f030992c tempest-SnapshotDependencyTests-1774280606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a6c684e4-1a2e-4c99-8d37-faae92b62e14.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:37:42 devstack sudo[102491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a6c684e4-1a2e-4c99-8d37-faae92b62e14.info
Jul 14 16:37:42 devstack sudo[102491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:37:42 devstack sudo[102491]: pam_unix(sudo:session): session closed for user root
Jul 14 16:37:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d8ec7b25-346b-423f-9812-c609f030992c tempest-SnapshotDependencyTests-1774280606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a6c684e4-1a2e-4c99-8d37-faae92b62e14.info" returned: 0 in 0.248s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:37:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d8ec7b25-346b-423f-9812-c609f030992c tempest-SnapshotDependencyTests-1774280606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.588s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:37:42 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-d8ec7b25-346b-423f-9812-c609f030992c tempest-SnapshotDependencyTests-1774280606 None] Create snapshot completed successfully
Jul 14 16:37:43 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-23138c50-4161-4993-8b77-dd182fd654cc tempest-SnapshotDependencyTests-1774280606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:37:43 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-23138c50-4161-4993-8b77-dd182fd654cc tempest-SnapshotDependencyTests-1774280606 None] Flow 'volume_create_manager' (1807afc1-bdbe-4b87-9549-b977171065ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:37:43 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-23138c50-4161-4993-8b77-dd182fd654cc tempest-SnapshotDependencyTests-1774280606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9eb1094d-de3a-4e7d-8f9c-ffb96dde50ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:37:43 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-23138c50-4161-4993-8b77-dd182fd654cc tempest-SnapshotDependencyTests-1774280606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9eb1094d-de3a-4e7d-8f9c-ffb96dde50ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:37:43Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d64ddc2-e8e3-4de8-88b1-074e19b8f136,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5ff5609d3524ff3b108ad86f29e3f02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:37:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=52de3b31-e7bf-4500-b156-3355e9e84870,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:37:44Z,use_quota=True,user_id='0b0ec9f6ffed45b88b242e1cfbc8b1f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:37:43 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-23138c50-4161-4993-8b77-dd182fd654cc tempest-SnapshotDependencyTests-1774280606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb77c1be-65f5-40ed-99fa-fee22a602936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:37:43 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-23138c50-4161-4993-8b77-dd182fd654cc tempest-SnapshotDependencyTests-1774280606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb77c1be-65f5-40ed-99fa-fee22a602936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:37:43 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-23138c50-4161-4993-8b77-dd182fd654cc tempest-SnapshotDependencyTests-1774280606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d6cb0b0-ba7b-4624-bec7-637d6bdf1eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:37:43 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-23138c50-4161-4993-8b77-dd182fd654cc tempest-SnapshotDependencyTests-1774280606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d6cb0b0-ba7b-4624-bec7-637d6bdf1eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7d64ddc2-e8e3-4de8-88b1-074e19b8f136', 'volume_name': 'volume-7d64ddc2-e8e3-4de8-88b1-074e19b8f136', 'volume_size': 1, 'snapshot_id': '52de3b31-e7bf-4500-b156-3355e9e84870'}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:37:43 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-23138c50-4161-4993-8b77-dd182fd654cc tempest-SnapshotDependencyTests-1774280606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22fb6264-475c-4106-9f7f-4c4992ca8bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:37:43 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-23138c50-4161-4993-8b77-dd182fd654cc tempest-SnapshotDependencyTests-1774280606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22fb6264-475c-4106-9f7f-4c4992ca8bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:37:43 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-23138c50-4161-4993-8b77-dd182fd654cc tempest-SnapshotDependencyTests-1774280606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1699b671-55f2-45c8-904a-0a91c89231c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:37:43 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-23138c50-4161-4993-8b77-dd182fd654cc tempest-SnapshotDependencyTests-1774280606 None] Volume 7d64ddc2-e8e3-4de8-88b1-074e19b8f136: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7d64ddc2-e8e3-4de8-88b1-074e19b8f136', 'volume_size': 1, 'snapshot_id': '52de3b31-e7bf-4500-b156-3355e9e84870'}
Jul 14 16:37:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-23138c50-4161-4993-8b77-dd182fd654cc tempest-SnapshotDependencyTests-1774280606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:37:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-23138c50-4161-4993-8b77-dd182fd654cc tempest-SnapshotDependencyTests-1774280606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:37:43 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-23138c50-4161-4993-8b77-dd182fd654cc tempest-SnapshotDependencyTests-1774280606 None] Acquiring lock "cinder-quobyte-52de3b31-e7bf-4500-b156-3355e9e84870-7d64ddc2-e8e3-4de8-88b1-074e19b8f136" by "_create_volume_from_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:37:43 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-23138c50-4161-4993-8b77-dd182fd654cc tempest-SnapshotDependencyTests-1774280606 None] Lock "cinder-quobyte-52de3b31-e7bf-4500-b156-3355e9e84870-7d64ddc2-e8e3-4de8-88b1-074e19b8f136" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:37:43 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-23138c50-4161-4993-8b77-dd182fd654cc tempest-SnapshotDependencyTests-1774280606 None] Creating volume 7d64ddc2-e8e3-4de8-88b1-074e19b8f136 from snapshot 52de3b31-e7bf-4500-b156-3355e9e84870 {{(pid=87166) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 14 16:37:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-23138c50-4161-4993-8b77-dd182fd654cc tempest-SnapshotDependencyTests-1774280606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:37:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-23138c50-4161-4993-8b77-dd182fd654cc tempest-SnapshotDependencyTests-1774280606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:37:43 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-23138c50-4161-4993-8b77-dd182fd654cc tempest-SnapshotDependencyTests-1774280606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:37:44 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-23138c50-4161-4993-8b77-dd182fd654cc tempest-SnapshotDependencyTests-1774280606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:37:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-23138c50-4161-4993-8b77-dd182fd654cc tempest-SnapshotDependencyTests-1774280606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:37:44 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-23138c50-4161-4993-8b77-dd182fd654cc tempest-SnapshotDependencyTests-1774280606 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:37:44 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-23138c50-4161-4993-8b77-dd182fd654cc tempest-SnapshotDependencyTests-1774280606 None] Acquiring lock "cinder-quobyte-7d64ddc2-e8e3-4de8-88b1-074e19b8f136" by "_copy_volume_from_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:37:44 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-23138c50-4161-4993-8b77-dd182fd654cc tempest-SnapshotDependencyTests-1774280606 None] Lock "cinder-quobyte-7d64ddc2-e8e3-4de8-88b1-074e19b8f136" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:37:44 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-23138c50-4161-4993-8b77-dd182fd654cc tempest-SnapshotDependencyTests-1774280606 None] snapshot: 52de3b31-e7bf-4500-b156-3355e9e84870, volume: 7d64ddc2-e8e3-4de8-88b1-074e19b8f136,  {{(pid=87166) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 14 16:37:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-23138c50-4161-4993-8b77-dd182fd654cc tempest-SnapshotDependencyTests-1774280606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:37:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-23138c50-4161-4993-8b77-dd182fd654cc tempest-SnapshotDependencyTests-1774280606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:37:44 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-23138c50-4161-4993-8b77-dd182fd654cc tempest-SnapshotDependencyTests-1774280606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:37:44 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-23138c50-4161-4993-8b77-dd182fd654cc tempest-SnapshotDependencyTests-1774280606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:37:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-23138c50-4161-4993-8b77-dd182fd654cc tempest-SnapshotDependencyTests-1774280606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:37:44 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[635aacd8-35eb-4ef4-849d-fed764f95c78]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:37:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-23138c50-4161-4993-8b77-dd182fd654cc tempest-SnapshotDependencyTests-1774280606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a6c684e4-1a2e-4c99-8d37-faae92b62e14.52de3b31-e7bf-4500-b156-3355e9e84870 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:37:44 devstack sudo[102495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a6c684e4-1a2e-4c99-8d37-faae92b62e14.52de3b31-e7bf-4500-b156-3355e9e84870
Jul 14 16:37:44 devstack sudo[102495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:37:44 devstack sudo[102495]: pam_unix(sudo:session): session closed for user root
Jul 14 16:37:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-23138c50-4161-4993-8b77-dd182fd654cc tempest-SnapshotDependencyTests-1774280606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a6c684e4-1a2e-4c99-8d37-faae92b62e14.52de3b31-e7bf-4500-b156-3355e9e84870" returned: 0 in 0.465s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:37:44 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-23138c50-4161-4993-8b77-dd182fd654cc tempest-SnapshotDependencyTests-1774280606 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a6c684e4-1a2e-4c99-8d37-faae92b62e14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 16:37:44 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-23138c50-4161-4993-8b77-dd182fd654cc tempest-SnapshotDependencyTests-1774280606 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a6c684e4-1a2e-4c99-8d37-faae92b62e14 {{(pid=87166) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 14 16:37:44 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-23138c50-4161-4993-8b77-dd182fd654cc tempest-SnapshotDependencyTests-1774280606 None] Creating direct copy from snapshot {{(pid=87166) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 14 16:37:44 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[67768129-9181-4399-9141-e4f53df9cd90]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:37:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-23138c50-4161-4993-8b77-dd182fd654cc tempest-SnapshotDependencyTests-1774280606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a6c684e4-1a2e-4c99-8d37-faae92b62e14 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:37:44 devstack sudo[102500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a6c684e4-1a2e-4c99-8d37-faae92b62e14
Jul 14 16:37:44 devstack sudo[102500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:37:44 devstack sudo[102500]: pam_unix(sudo:session): session closed for user root
Jul 14 16:37:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-23138c50-4161-4993-8b77-dd182fd654cc tempest-SnapshotDependencyTests-1774280606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a6c684e4-1a2e-4c99-8d37-faae92b62e14" returned: 0 in 0.399s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:37:45 devstack cinder-volume[87166]: DEBUG cinder.utils [None req-23138c50-4161-4993-8b77-dd182fd654cc tempest-SnapshotDependencyTests-1774280606 None] Path /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-7d64ddc2-e8e3-4de8-88b1-074e19b8f136 not found in is_blk_device check {{(pid=87166) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 14 16:37:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-23138c50-4161-4993-8b77-dd182fd654cc tempest-SnapshotDependencyTests-1774280606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a6c684e4-1a2e-4c99-8d37-faae92b62e14 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-7d64ddc2-e8e3-4de8-88b1-074e19b8f136 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:37:45 devstack sudo[102505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a6c684e4-1a2e-4c99-8d37-faae92b62e14 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-7d64ddc2-e8e3-4de8-88b1-074e19b8f136
Jul 14 16:37:45 devstack sudo[102505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:37:50 devstack sudo[102505]: pam_unix(sudo:session): session closed for user root
Jul 14 16:37:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-23138c50-4161-4993-8b77-dd182fd654cc tempest-SnapshotDependencyTests-1774280606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a6c684e4-1a2e-4c99-8d37-faae92b62e14 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-7d64ddc2-e8e3-4de8-88b1-074e19b8f136" returned: 0 in 5.665s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:37:50 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f51fd2-3418-4622-b739-fc326b606b98]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:37:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-23138c50-4161-4993-8b77-dd182fd654cc tempest-SnapshotDependencyTests-1774280606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a6c684e4-1a2e-4c99-8d37-faae92b62e14 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:37:50 devstack sudo[102521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a6c684e4-1a2e-4c99-8d37-faae92b62e14
Jul 14 16:37:50 devstack sudo[102521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:37:51 devstack sudo[102521]: pam_unix(sudo:session): session closed for user root
Jul 14 16:37:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-23138c50-4161-4993-8b77-dd182fd654cc tempest-SnapshotDependencyTests-1774280606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a6c684e4-1a2e-4c99-8d37-faae92b62e14" returned: 0 in 0.566s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:37:51 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-23138c50-4161-4993-8b77-dd182fd654cc tempest-SnapshotDependencyTests-1774280606 None] Image conversion details: src /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a6c684e4-1a2e-4c99-8d37-faae92b62e14, size 1024.00 MB, duration 5.67 sec, destination /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-7d64ddc2-e8e3-4de8-88b1-074e19b8f136 {{(pid=87166) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 14 16:37:51 devstack cinder-volume[87166]: INFO cinder.image.image_utils [None req-23138c50-4161-4993-8b77-dd182fd654cc tempest-SnapshotDependencyTests-1774280606 None] Converted 1024.00 MB image at 180.74 MB/s
Jul 14 16:37:51 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-23138c50-4161-4993-8b77-dd182fd654cc tempest-SnapshotDependencyTests-1774280606 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-7d64ddc2-e8e3-4de8-88b1-074e19b8f136 is being set with open permissions: ugo+rw
Jul 14 16:37:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-23138c50-4161-4993-8b77-dd182fd654cc tempest-SnapshotDependencyTests-1774280606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-7d64ddc2-e8e3-4de8-88b1-074e19b8f136 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:37:51 devstack sudo[102526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-7d64ddc2-e8e3-4de8-88b1-074e19b8f136
Jul 14 16:37:51 devstack sudo[102526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:37:51 devstack sudo[102526]: pam_unix(sudo:session): session closed for user root
Jul 14 16:37:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-23138c50-4161-4993-8b77-dd182fd654cc tempest-SnapshotDependencyTests-1774280606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-7d64ddc2-e8e3-4de8-88b1-074e19b8f136" returned: 0 in 0.242s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:37:51 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-23138c50-4161-4993-8b77-dd182fd654cc tempest-SnapshotDependencyTests-1774280606 None] Lock "cinder-quobyte-7d64ddc2-e8e3-4de8-88b1-074e19b8f136" released by "_copy_volume_from_snapshot" :: held 7.474s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:37:51 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-23138c50-4161-4993-8b77-dd182fd654cc tempest-SnapshotDependencyTests-1774280606 None] Lock "cinder-quobyte-52de3b31-e7bf-4500-b156-3355e9e84870-7d64ddc2-e8e3-4de8-88b1-074e19b8f136" released by "_create_volume_from_snapshot" :: held 7.518s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:37:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-23138c50-4161-4993-8b77-dd182fd654cc tempest-SnapshotDependencyTests-1774280606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.541s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:37:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-23138c50-4161-4993-8b77-dd182fd654cc tempest-SnapshotDependencyTests-1774280606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1699b671-55f2-45c8-904a-0a91c89231c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d64ddc2-e8e3-4de8-88b1-074e19b8f136', 'volume_size': 1, 'snapshot_id': '52de3b31-e7bf-4500-b156-3355e9e84870'}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:37:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-23138c50-4161-4993-8b77-dd182fd654cc tempest-SnapshotDependencyTests-1774280606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82bc2f72-ce68-4a9f-9f6a-e2c403ffae9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:37:51 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-23138c50-4161-4993-8b77-dd182fd654cc tempest-SnapshotDependencyTests-1774280606 None] Volume volume-7d64ddc2-e8e3-4de8-88b1-074e19b8f136 (7d64ddc2-e8e3-4de8-88b1-074e19b8f136): created successfully
Jul 14 16:37:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-23138c50-4161-4993-8b77-dd182fd654cc tempest-SnapshotDependencyTests-1774280606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82bc2f72-ce68-4a9f-9f6a-e2c403ffae9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:37:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-23138c50-4161-4993-8b77-dd182fd654cc tempest-SnapshotDependencyTests-1774280606 None] Flow 'volume_create_manager' (1807afc1-bdbe-4b87-9549-b977171065ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:37:51 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-23138c50-4161-4993-8b77-dd182fd654cc tempest-SnapshotDependencyTests-1774280606 None] Created volume successfully.
Jul 14 16:37:51 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b7258e55-91a8-400c-af73-4e62960b589a tempest-SnapshotDependencyTests-1774280606 None] Acquiring lock "cinder-52de3b31-e7bf-4500-b156-3355e9e84870-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:37:51 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b7258e55-91a8-400c-af73-4e62960b589a tempest-SnapshotDependencyTests-1774280606 None] Lock "cinder-52de3b31-e7bf-4500-b156-3355e9e84870-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:37:51 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b7258e55-91a8-400c-af73-4e62960b589a tempest-SnapshotDependencyTests-1774280606 None] Acquiring lock "cinder-quobyte-a6c684e4-1a2e-4c99-8d37-faae92b62e14" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:37:51 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b7258e55-91a8-400c-af73-4e62960b589a tempest-SnapshotDependencyTests-1774280606 None] Lock "cinder-quobyte-a6c684e4-1a2e-4c99-8d37-faae92b62e14" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:37:51 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b7258e55-91a8-400c-af73-4e62960b589a tempest-SnapshotDependencyTests-1774280606 None] Acquiring lock "cinder-quobyte-52de3b31-e7bf-4500-b156-3355e9e84870" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:37:51 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b7258e55-91a8-400c-af73-4e62960b589a tempest-SnapshotDependencyTests-1774280606 None] Lock "cinder-quobyte-52de3b31-e7bf-4500-b156-3355e9e84870" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:37:51 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-b7258e55-91a8-400c-af73-4e62960b589a tempest-SnapshotDependencyTests-1774280606 None] Deleting offline snapshot 52de3b31-e7bf-4500-b156-3355e9e84870 of volume a6c684e4-1a2e-4c99-8d37-faae92b62e14 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 16:37:51 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-b7258e55-91a8-400c-af73-4e62960b589a tempest-SnapshotDependencyTests-1774280606 None] snapshot_file for this snap is: volume-a6c684e4-1a2e-4c99-8d37-faae92b62e14.52de3b31-e7bf-4500-b156-3355e9e84870 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 16:37:51 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[811e20c7-26df-4fe4-bd72-dac2d24c52b8]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:37:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b7258e55-91a8-400c-af73-4e62960b589a tempest-SnapshotDependencyTests-1774280606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a6c684e4-1a2e-4c99-8d37-faae92b62e14.52de3b31-e7bf-4500-b156-3355e9e84870 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:37:52 devstack sudo[102529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a6c684e4-1a2e-4c99-8d37-faae92b62e14.52de3b31-e7bf-4500-b156-3355e9e84870
Jul 14 16:37:52 devstack sudo[102529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:37:52 devstack sudo[102529]: pam_unix(sudo:session): session closed for user root
Jul 14 16:37:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b7258e55-91a8-400c-af73-4e62960b589a tempest-SnapshotDependencyTests-1774280606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a6c684e4-1a2e-4c99-8d37-faae92b62e14.52de3b31-e7bf-4500-b156-3355e9e84870" returned: 0 in 0.395s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:37:52 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-b7258e55-91a8-400c-af73-4e62960b589a tempest-SnapshotDependencyTests-1774280606 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a6c684e4-1a2e-4c99-8d37-faae92b62e14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 16:37:52 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[0677ce31-1e27-484a-8413-6bc515a06881]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:37:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b7258e55-91a8-400c-af73-4e62960b589a tempest-SnapshotDependencyTests-1774280606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a6c684e4-1a2e-4c99-8d37-faae92b62e14 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:37:52 devstack sudo[102534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a6c684e4-1a2e-4c99-8d37-faae92b62e14
Jul 14 16:37:52 devstack sudo[102534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:37:52 devstack sudo[102534]: pam_unix(sudo:session): session closed for user root
Jul 14 16:37:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b7258e55-91a8-400c-af73-4e62960b589a tempest-SnapshotDependencyTests-1774280606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a6c684e4-1a2e-4c99-8d37-faae92b62e14" returned: 0 in 0.374s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:37:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b7258e55-91a8-400c-af73-4e62960b589a tempest-SnapshotDependencyTests-1774280606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a6c684e4-1a2e-4c99-8d37-faae92b62e14.52de3b31-e7bf-4500-b156-3355e9e84870 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:37:52 devstack sudo[102539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a6c684e4-1a2e-4c99-8d37-faae92b62e14.52de3b31-e7bf-4500-b156-3355e9e84870
Jul 14 16:37:52 devstack sudo[102539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:37:53 devstack sudo[102539]: pam_unix(sudo:session): session closed for user root
Jul 14 16:37:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b7258e55-91a8-400c-af73-4e62960b589a tempest-SnapshotDependencyTests-1774280606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a6c684e4-1a2e-4c99-8d37-faae92b62e14.52de3b31-e7bf-4500-b156-3355e9e84870" returned: 0 in 0.349s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:37:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b7258e55-91a8-400c-af73-4e62960b589a tempest-SnapshotDependencyTests-1774280606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a6c684e4-1a2e-4c99-8d37-faae92b62e14.52de3b31-e7bf-4500-b156-3355e9e84870 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:37:53 devstack sudo[102544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a6c684e4-1a2e-4c99-8d37-faae92b62e14.52de3b31-e7bf-4500-b156-3355e9e84870
Jul 14 16:37:53 devstack sudo[102544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:37:53 devstack sudo[102544]: pam_unix(sudo:session): session closed for user root
Jul 14 16:37:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b7258e55-91a8-400c-af73-4e62960b589a tempest-SnapshotDependencyTests-1774280606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a6c684e4-1a2e-4c99-8d37-faae92b62e14.52de3b31-e7bf-4500-b156-3355e9e84870" returned: 0 in 0.242s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:37:53 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b7258e55-91a8-400c-af73-4e62960b589a tempest-SnapshotDependencyTests-1774280606 None] Lock "cinder-quobyte-52de3b31-e7bf-4500-b156-3355e9e84870" released by "_delete_snapshot" :: held 1.452s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:37:53 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b7258e55-91a8-400c-af73-4e62960b589a tempest-SnapshotDependencyTests-1774280606 None] Lock "cinder-quobyte-a6c684e4-1a2e-4c99-8d37-faae92b62e14" released by "delete_snapshot" :: held 1.475s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:37:53 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-b7258e55-91a8-400c-af73-4e62960b589a tempest-SnapshotDependencyTests-1774280606 None] Created reservations ['f9c61b56-e8dd-4de5-ae52-080747bd4b39', 'aa002bea-04cc-417d-b429-62b4d178c345', 'fa7bb84b-e778-4f4a-85c0-73d073728155', 'e2b4b72b-8cae-4122-be2d-1e8d46abac1b'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:37:53 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-b7258e55-91a8-400c-af73-4e62960b589a tempest-SnapshotDependencyTests-1774280606 None] Delete snapshot completed successfully.
Jul 14 16:37:53 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b7258e55-91a8-400c-af73-4e62960b589a tempest-SnapshotDependencyTests-1774280606 None] Lock "cinder-52de3b31-e7bf-4500-b156-3355e9e84870-delete_snapshot" released by "delete_snapshot" :: held 1.614s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:37:54 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2c83e4f9-c9b1-41c6-990e-e4cc356e246a tempest-SnapshotDependencyTests-1774280606 None] Acquiring lock "cinder-a6c684e4-1a2e-4c99-8d37-faae92b62e14-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:37:54 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2c83e4f9-c9b1-41c6-990e-e4cc356e246a tempest-SnapshotDependencyTests-1774280606 None] Lock "cinder-a6c684e4-1a2e-4c99-8d37-faae92b62e14-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:37:54 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2c83e4f9-c9b1-41c6-990e-e4cc356e246a tempest-SnapshotDependencyTests-1774280606 None] Acquiring lock "cinder-quobyte-a6c684e4-1a2e-4c99-8d37-faae92b62e14" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:37:54 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2c83e4f9-c9b1-41c6-990e-e4cc356e246a tempest-SnapshotDependencyTests-1774280606 None] Lock "cinder-quobyte-a6c684e4-1a2e-4c99-8d37-faae92b62e14" acquired by "delete_volume" :: waited 0.018s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:37:54 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dce8aed-186d-48a2-be19-9bdaeb07a897]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:37:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2c83e4f9-c9b1-41c6-990e-e4cc356e246a tempest-SnapshotDependencyTests-1774280606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a6c684e4-1a2e-4c99-8d37-faae92b62e14 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:37:54 devstack sudo[102547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a6c684e4-1a2e-4c99-8d37-faae92b62e14
Jul 14 16:37:54 devstack sudo[102547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:37:54 devstack sudo[102547]: pam_unix(sudo:session): session closed for user root
Jul 14 16:37:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2c83e4f9-c9b1-41c6-990e-e4cc356e246a tempest-SnapshotDependencyTests-1774280606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a6c684e4-1a2e-4c99-8d37-faae92b62e14" returned: 0 in 0.388s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:37:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2c83e4f9-c9b1-41c6-990e-e4cc356e246a tempest-SnapshotDependencyTests-1774280606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a6c684e4-1a2e-4c99-8d37-faae92b62e14 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:37:54 devstack sudo[102564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a6c684e4-1a2e-4c99-8d37-faae92b62e14
Jul 14 16:37:54 devstack sudo[102564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:37:54 devstack sudo[102564]: pam_unix(sudo:session): session closed for user root
Jul 14 16:37:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2c83e4f9-c9b1-41c6-990e-e4cc356e246a tempest-SnapshotDependencyTests-1774280606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a6c684e4-1a2e-4c99-8d37-faae92b62e14" returned: 0 in 0.247s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:37:54 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2c83e4f9-c9b1-41c6-990e-e4cc356e246a tempest-SnapshotDependencyTests-1774280606 None] Lock "cinder-quobyte-a6c684e4-1a2e-4c99-8d37-faae92b62e14" released by "delete_volume" :: held 0.690s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:37:54 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-2c83e4f9-c9b1-41c6-990e-e4cc356e246a tempest-SnapshotDependencyTests-1774280606 None] Created reservations ['7983be9d-1c4d-403a-a60e-3306179872ce', '18caa00b-d41d-41ab-bbf1-98f5f0045145', '52b4a361-b8af-47d0-a29d-1c160dd9f6f3', '919a97b4-e274-411d-a821-24332ad8547d'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:37:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2c83e4f9-c9b1-41c6-990e-e4cc356e246a tempest-SnapshotDependencyTests-1774280606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:37:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2c83e4f9-c9b1-41c6-990e-e4cc356e246a tempest-SnapshotDependencyTests-1774280606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:37:54 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2c83e4f9-c9b1-41c6-990e-e4cc356e246a tempest-SnapshotDependencyTests-1774280606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:37:54 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2c83e4f9-c9b1-41c6-990e-e4cc356e246a tempest-SnapshotDependencyTests-1774280606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:37:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2c83e4f9-c9b1-41c6-990e-e4cc356e246a tempest-SnapshotDependencyTests-1774280606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:37:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2c83e4f9-c9b1-41c6-990e-e4cc356e246a tempest-SnapshotDependencyTests-1774280606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:37:55 devstack sudo[102567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:37:55 devstack sudo[102567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:37:55 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-66f3b4eb-7436-4505-9976-78d35206e555 tempest-SnapshotDependencyTests-1774280606 None] Acquiring lock "cinder-7d64ddc2-e8e3-4de8-88b1-074e19b8f136-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:37:55 devstack sudo[102567]: pam_unix(sudo:session): session closed for user root
Jul 14 16:37:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2c83e4f9-c9b1-41c6-990e-e4cc356e246a tempest-SnapshotDependencyTests-1774280606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.263s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:37:55 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-2c83e4f9-c9b1-41c6-990e-e4cc356e246a tempest-SnapshotDependencyTests-1774280606 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:37:55 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-66f3b4eb-7436-4505-9976-78d35206e555 tempest-SnapshotDependencyTests-1774280606 None] Lock "cinder-7d64ddc2-e8e3-4de8-88b1-074e19b8f136-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:37:55 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-2c83e4f9-c9b1-41c6-990e-e4cc356e246a tempest-SnapshotDependencyTests-1774280606 None] Deleted volume successfully.
Jul 14 16:37:55 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2c83e4f9-c9b1-41c6-990e-e4cc356e246a tempest-SnapshotDependencyTests-1774280606 None] Lock "cinder-a6c684e4-1a2e-4c99-8d37-faae92b62e14-delete_volume" released by "delete_volume" :: held 1.226s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:37:55 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-66f3b4eb-7436-4505-9976-78d35206e555 tempest-SnapshotDependencyTests-1774280606 None] Acquiring lock "cinder-quobyte-7d64ddc2-e8e3-4de8-88b1-074e19b8f136" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:37:55 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-66f3b4eb-7436-4505-9976-78d35206e555 tempest-SnapshotDependencyTests-1774280606 None] Lock "cinder-quobyte-7d64ddc2-e8e3-4de8-88b1-074e19b8f136" acquired by "delete_volume" :: waited 0.018s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:37:55 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9c03d5-e136-4635-96e1-eb6b9cdc4e8c]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:37:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-66f3b4eb-7436-4505-9976-78d35206e555 tempest-SnapshotDependencyTests-1774280606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-7d64ddc2-e8e3-4de8-88b1-074e19b8f136 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:37:55 devstack sudo[102570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-7d64ddc2-e8e3-4de8-88b1-074e19b8f136
Jul 14 16:37:55 devstack sudo[102570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:37:55 devstack sudo[102570]: pam_unix(sudo:session): session closed for user root
Jul 14 16:37:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-66f3b4eb-7436-4505-9976-78d35206e555 tempest-SnapshotDependencyTests-1774280606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-7d64ddc2-e8e3-4de8-88b1-074e19b8f136" returned: 0 in 0.365s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:37:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-66f3b4eb-7436-4505-9976-78d35206e555 tempest-SnapshotDependencyTests-1774280606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-7d64ddc2-e8e3-4de8-88b1-074e19b8f136 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:37:55 devstack sudo[102575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-7d64ddc2-e8e3-4de8-88b1-074e19b8f136
Jul 14 16:37:55 devstack sudo[102575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:37:55 devstack sudo[102575]: pam_unix(sudo:session): session closed for user root
Jul 14 16:37:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-66f3b4eb-7436-4505-9976-78d35206e555 tempest-SnapshotDependencyTests-1774280606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-7d64ddc2-e8e3-4de8-88b1-074e19b8f136" returned: 0 in 0.253s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:37:55 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-66f3b4eb-7436-4505-9976-78d35206e555 tempest-SnapshotDependencyTests-1774280606 None] Lock "cinder-quobyte-7d64ddc2-e8e3-4de8-88b1-074e19b8f136" released by "delete_volume" :: held 0.657s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:37:56 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-66f3b4eb-7436-4505-9976-78d35206e555 tempest-SnapshotDependencyTests-1774280606 None] Created reservations ['2a370f25-9800-41de-8ac6-d2101e3c860b', 'a3f26dfe-61f0-45c3-86ea-140776073b8b', '0301013c-087c-4844-b502-36880fd5a4c9', '2afae144-8591-48c9-b70e-587b5185abe7'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:37:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-66f3b4eb-7436-4505-9976-78d35206e555 tempest-SnapshotDependencyTests-1774280606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:37:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-66f3b4eb-7436-4505-9976-78d35206e555 tempest-SnapshotDependencyTests-1774280606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:37:56 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-66f3b4eb-7436-4505-9976-78d35206e555 tempest-SnapshotDependencyTests-1774280606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:37:56 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-66f3b4eb-7436-4505-9976-78d35206e555 tempest-SnapshotDependencyTests-1774280606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:37:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-66f3b4eb-7436-4505-9976-78d35206e555 tempest-SnapshotDependencyTests-1774280606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:37:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-66f3b4eb-7436-4505-9976-78d35206e555 tempest-SnapshotDependencyTests-1774280606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:37:56 devstack sudo[102578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:37:56 devstack sudo[102578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:37:56 devstack sudo[102578]: pam_unix(sudo:session): session closed for user root
Jul 14 16:37:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-66f3b4eb-7436-4505-9976-78d35206e555 tempest-SnapshotDependencyTests-1774280606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.247s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:37:56 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-66f3b4eb-7436-4505-9976-78d35206e555 tempest-SnapshotDependencyTests-1774280606 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:37:56 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-66f3b4eb-7436-4505-9976-78d35206e555 tempest-SnapshotDependencyTests-1774280606 None] Deleted volume successfully.
Jul 14 16:37:56 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-66f3b4eb-7436-4505-9976-78d35206e555 tempest-SnapshotDependencyTests-1774280606 None] Lock "cinder-7d64ddc2-e8e3-4de8-88b1-074e19b8f136-delete_volume" released by "delete_volume" :: held 1.116s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:38:07 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:SELECT=28,cinder:UPDATE=27,cinder:DELETE=2,cinder:INSERT=8 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 16:38:07 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:UPDATE=36,cinder:INSERT=7,cinder:SELECT=24,cinder:DELETE=4 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 16:38:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-49922048-6f32-450e-973f-0c48bf3bdb52 req-b629836c-1889-4563-bf20-38b668bc7ee3 tempest-TestStampPattern-1631901009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:38:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-49922048-6f32-450e-973f-0c48bf3bdb52 req-b629836c-1889-4563-bf20-38b668bc7ee3 tempest-TestStampPattern-1631901009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:38:08 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bff1b98-13df-4dda-8c47-716e6c152300]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:38:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-49922048-6f32-450e-973f-0c48bf3bdb52 req-b629836c-1889-4563-bf20-38b668bc7ee3 tempest-TestStampPattern-1631901009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-193630ff-b6f9-4539-9ac6-ff135adde62a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:38:08 devstack sudo[102646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-193630ff-b6f9-4539-9ac6-ff135adde62a
Jul 14 16:38:08 devstack sudo[102646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:38:08 devstack sudo[102646]: pam_unix(sudo:session): session closed for user root
Jul 14 16:38:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-49922048-6f32-450e-973f-0c48bf3bdb52 req-b629836c-1889-4563-bf20-38b668bc7ee3 tempest-TestStampPattern-1631901009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-193630ff-b6f9-4539-9ac6-ff135adde62a" returned: 0 in 0.364s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:38:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-49922048-6f32-450e-973f-0c48bf3bdb52 req-b629836c-1889-4563-bf20-38b668bc7ee3 tempest-TestStampPattern-1631901009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.381s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:38:08 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-49922048-6f32-450e-973f-0c48bf3bdb52 req-b629836c-1889-4563-bf20-38b668bc7ee3 tempest-TestStampPattern-1631901009 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052', 'name': 'volume-193630ff-b6f9-4539-9ac6-ff135adde62a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4957fb1f-b660-4b85-86ce-ae1d8a3b69a2', 'enforce_multipath': True} {{(pid=87166) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 14 16:38:08 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-49922048-6f32-450e-973f-0c48bf3bdb52 req-b629836c-1889-4563-bf20-38b668bc7ee3 tempest-TestStampPattern-1631901009 None] attachment_update completed successfully.
Jul 14 16:38:12 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-1fe3b582-de78-4e52-8d8f-9c038115b1e0 req-cc2489b4-d6ef-4b6a-9856-5c88a889aed6 tempest-TestStampPattern-1631901009 None] Terminate volume connection completed successfully.
Jul 14 16:38:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-1fe3b582-de78-4e52-8d8f-9c038115b1e0 req-cc2489b4-d6ef-4b6a-9856-5c88a889aed6 tempest-TestStampPattern-1631901009 None] Deleting attachment 4957fb1f-b660-4b85-86ce-ae1d8a3b69a2. {{(pid=87166) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 14 16:38:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-bf452668-b889-4ce1-ad84-16f8c1ff7bf8 tempest-TestStampPattern-1631901009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:38:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-bf452668-b889-4ce1-ad84-16f8c1ff7bf8 tempest-TestStampPattern-1631901009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:38:13 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-bf452668-b889-4ce1-ad84-16f8c1ff7bf8 tempest-TestStampPattern-1631901009 None] Creating offline snapshot 7364aaab-1c0e-4bfe-b76d-bf4cd249f780 of volume 193630ff-b6f9-4539-9ac6-ff135adde62a {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 16:38:14 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[e95c559a-c41c-4cae-a188-6f07bb2eb455]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:38:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bf452668-b889-4ce1-ad84-16f8c1ff7bf8 tempest-TestStampPattern-1631901009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-193630ff-b6f9-4539-9ac6-ff135adde62a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:38:14 devstack sudo[103090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-193630ff-b6f9-4539-9ac6-ff135adde62a
Jul 14 16:38:14 devstack sudo[103090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:38:14 devstack sudo[103090]: pam_unix(sudo:session): session closed for user root
Jul 14 16:38:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bf452668-b889-4ce1-ad84-16f8c1ff7bf8 tempest-TestStampPattern-1631901009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-193630ff-b6f9-4539-9ac6-ff135adde62a" returned: 0 in 0.362s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:38:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bf452668-b889-4ce1-ad84-16f8c1ff7bf8 tempest-TestStampPattern-1631901009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-193630ff-b6f9-4539-9ac6-ff135adde62a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-193630ff-b6f9-4539-9ac6-ff135adde62a.7364aaab-1c0e-4bfe-b76d-bf4cd249f780 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:38:14 devstack sudo[103095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-193630ff-b6f9-4539-9ac6-ff135adde62a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-193630ff-b6f9-4539-9ac6-ff135adde62a.7364aaab-1c0e-4bfe-b76d-bf4cd249f780 1G
Jul 14 16:38:14 devstack sudo[103095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:38:14 devstack sudo[103095]: pam_unix(sudo:session): session closed for user root
Jul 14 16:38:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bf452668-b889-4ce1-ad84-16f8c1ff7bf8 tempest-TestStampPattern-1631901009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-193630ff-b6f9-4539-9ac6-ff135adde62a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-193630ff-b6f9-4539-9ac6-ff135adde62a.7364aaab-1c0e-4bfe-b76d-bf4cd249f780 1G" returned: 0 in 0.378s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:38:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bf452668-b889-4ce1-ad84-16f8c1ff7bf8 tempest-TestStampPattern-1631901009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-193630ff-b6f9-4539-9ac6-ff135adde62a -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-193630ff-b6f9-4539-9ac6-ff135adde62a.7364aaab-1c0e-4bfe-b76d-bf4cd249f780 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:38:14 devstack sudo[103100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-193630ff-b6f9-4539-9ac6-ff135adde62a -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-193630ff-b6f9-4539-9ac6-ff135adde62a.7364aaab-1c0e-4bfe-b76d-bf4cd249f780
Jul 14 16:38:14 devstack sudo[103100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:38:15 devstack sudo[103100]: pam_unix(sudo:session): session closed for user root
Jul 14 16:38:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bf452668-b889-4ce1-ad84-16f8c1ff7bf8 tempest-TestStampPattern-1631901009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-193630ff-b6f9-4539-9ac6-ff135adde62a -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-193630ff-b6f9-4539-9ac6-ff135adde62a.7364aaab-1c0e-4bfe-b76d-bf4cd249f780" returned: 0 in 0.285s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:38:15 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-bf452668-b889-4ce1-ad84-16f8c1ff7bf8 tempest-TestStampPattern-1631901009 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-193630ff-b6f9-4539-9ac6-ff135adde62a.7364aaab-1c0e-4bfe-b76d-bf4cd249f780 is being set with open permissions: ugo+rw
Jul 14 16:38:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bf452668-b889-4ce1-ad84-16f8c1ff7bf8 tempest-TestStampPattern-1631901009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-193630ff-b6f9-4539-9ac6-ff135adde62a.7364aaab-1c0e-4bfe-b76d-bf4cd249f780 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:38:15 devstack sudo[103105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-193630ff-b6f9-4539-9ac6-ff135adde62a.7364aaab-1c0e-4bfe-b76d-bf4cd249f780
Jul 14 16:38:15 devstack sudo[103105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:38:15 devstack sudo[103105]: pam_unix(sudo:session): session closed for user root
Jul 14 16:38:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bf452668-b889-4ce1-ad84-16f8c1ff7bf8 tempest-TestStampPattern-1631901009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-193630ff-b6f9-4539-9ac6-ff135adde62a.7364aaab-1c0e-4bfe-b76d-bf4cd249f780" returned: 0 in 0.240s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:38:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bf452668-b889-4ce1-ad84-16f8c1ff7bf8 tempest-TestStampPattern-1631901009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-193630ff-b6f9-4539-9ac6-ff135adde62a.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:38:15 devstack sudo[103108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-193630ff-b6f9-4539-9ac6-ff135adde62a.info
Jul 14 16:38:15 devstack sudo[103108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:38:15 devstack sudo[103108]: pam_unix(sudo:session): session closed for user root
Jul 14 16:38:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bf452668-b889-4ce1-ad84-16f8c1ff7bf8 tempest-TestStampPattern-1631901009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-193630ff-b6f9-4539-9ac6-ff135adde62a.info" returned: 0 in 0.257s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:38:15 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-bf452668-b889-4ce1-ad84-16f8c1ff7bf8 tempest-TestStampPattern-1631901009 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-193630ff-b6f9-4539-9ac6-ff135adde62a.info is being set with open permissions: ugo+rw
Jul 14 16:38:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bf452668-b889-4ce1-ad84-16f8c1ff7bf8 tempest-TestStampPattern-1631901009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-193630ff-b6f9-4539-9ac6-ff135adde62a.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:38:15 devstack sudo[103111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-193630ff-b6f9-4539-9ac6-ff135adde62a.info
Jul 14 16:38:15 devstack sudo[103111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:38:15 devstack sudo[103111]: pam_unix(sudo:session): session closed for user root
Jul 14 16:38:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bf452668-b889-4ce1-ad84-16f8c1ff7bf8 tempest-TestStampPattern-1631901009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-193630ff-b6f9-4539-9ac6-ff135adde62a.info" returned: 0 in 0.241s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:38:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-bf452668-b889-4ce1-ad84-16f8c1ff7bf8 tempest-TestStampPattern-1631901009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.844s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:38:15 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-bf452668-b889-4ce1-ad84-16f8c1ff7bf8 tempest-TestStampPattern-1631901009 None] Create snapshot completed successfully
Jul 14 16:38:22 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bd5f656-b5e1-42cf-8c05-6baf4feb891c tempest-TestStampPattern-1631901009 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:38:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2bd5f656-b5e1-42cf-8c05-6baf4feb891c tempest-TestStampPattern-1631901009 None] Flow 'volume_create_manager' (0931de81-16a4-4a55-9425-50c4a21b4555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:38:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2bd5f656-b5e1-42cf-8c05-6baf4feb891c tempest-TestStampPattern-1631901009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d510a67-a225-49f0-95e1-6175011c1781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:38:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2bd5f656-b5e1-42cf-8c05-6baf4feb891c tempest-TestStampPattern-1631901009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d510a67-a225-49f0-95e1-6175011c1781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:38:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-547506263',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b203a45-3d01-4843-9d9e-9284016296f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94db136c65d04a08a9fae21cb5c665da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:38:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7364aaab-1c0e-4bfe-b76d-bf4cd249f780,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:38:23Z,use_quota=True,user_id='0f9f67f3c19043d190dc7e83a72295c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:38:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2bd5f656-b5e1-42cf-8c05-6baf4feb891c tempest-TestStampPattern-1631901009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88b456b2-076f-49c7-b2a3-e68377779341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:38:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2bd5f656-b5e1-42cf-8c05-6baf4feb891c tempest-TestStampPattern-1631901009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88b456b2-076f-49c7-b2a3-e68377779341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:38:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2bd5f656-b5e1-42cf-8c05-6baf4feb891c tempest-TestStampPattern-1631901009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dd8dc7d-cac5-4c7b-9cad-2802a67b8b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:38:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2bd5f656-b5e1-42cf-8c05-6baf4feb891c tempest-TestStampPattern-1631901009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dd8dc7d-cac5-4c7b-9cad-2802a67b8b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6b203a45-3d01-4843-9d9e-9284016296f4', 'volume_name': 'volume-6b203a45-3d01-4843-9d9e-9284016296f4', 'volume_size': 1, 'snapshot_id': '7364aaab-1c0e-4bfe-b76d-bf4cd249f780'}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:38:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2bd5f656-b5e1-42cf-8c05-6baf4feb891c tempest-TestStampPattern-1631901009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fa8fb0c-7cb6-4658-b3b8-c389f2105716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:38:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2bd5f656-b5e1-42cf-8c05-6baf4feb891c tempest-TestStampPattern-1631901009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fa8fb0c-7cb6-4658-b3b8-c389f2105716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:38:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2bd5f656-b5e1-42cf-8c05-6baf4feb891c tempest-TestStampPattern-1631901009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (542af8a3-7eea-4e89-ad98-a9a9237d104f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:38:22 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-2bd5f656-b5e1-42cf-8c05-6baf4feb891c tempest-TestStampPattern-1631901009 None] Volume 6b203a45-3d01-4843-9d9e-9284016296f4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6b203a45-3d01-4843-9d9e-9284016296f4', 'volume_size': 1, 'snapshot_id': '7364aaab-1c0e-4bfe-b76d-bf4cd249f780'}
Jul 14 16:38:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2bd5f656-b5e1-42cf-8c05-6baf4feb891c tempest-TestStampPattern-1631901009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:38:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2bd5f656-b5e1-42cf-8c05-6baf4feb891c tempest-TestStampPattern-1631901009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:38:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2bd5f656-b5e1-42cf-8c05-6baf4feb891c tempest-TestStampPattern-1631901009 None] Acquiring lock "cinder-quobyte-7364aaab-1c0e-4bfe-b76d-bf4cd249f780-6b203a45-3d01-4843-9d9e-9284016296f4" by "_create_volume_from_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:38:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2bd5f656-b5e1-42cf-8c05-6baf4feb891c tempest-TestStampPattern-1631901009 None] Lock "cinder-quobyte-7364aaab-1c0e-4bfe-b76d-bf4cd249f780-6b203a45-3d01-4843-9d9e-9284016296f4" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:38:22 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2bd5f656-b5e1-42cf-8c05-6baf4feb891c tempest-TestStampPattern-1631901009 None] Creating volume 6b203a45-3d01-4843-9d9e-9284016296f4 from snapshot 7364aaab-1c0e-4bfe-b76d-bf4cd249f780 {{(pid=87166) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 14 16:38:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2bd5f656-b5e1-42cf-8c05-6baf4feb891c tempest-TestStampPattern-1631901009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:38:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2bd5f656-b5e1-42cf-8c05-6baf4feb891c tempest-TestStampPattern-1631901009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:38:22 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2bd5f656-b5e1-42cf-8c05-6baf4feb891c tempest-TestStampPattern-1631901009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:38:22 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2bd5f656-b5e1-42cf-8c05-6baf4feb891c tempest-TestStampPattern-1631901009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:38:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2bd5f656-b5e1-42cf-8c05-6baf4feb891c tempest-TestStampPattern-1631901009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:38:22 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2bd5f656-b5e1-42cf-8c05-6baf4feb891c tempest-TestStampPattern-1631901009 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:38:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2bd5f656-b5e1-42cf-8c05-6baf4feb891c tempest-TestStampPattern-1631901009 None] Acquiring lock "cinder-quobyte-6b203a45-3d01-4843-9d9e-9284016296f4" by "_copy_volume_from_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:38:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2bd5f656-b5e1-42cf-8c05-6baf4feb891c tempest-TestStampPattern-1631901009 None] Lock "cinder-quobyte-6b203a45-3d01-4843-9d9e-9284016296f4" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:38:22 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2bd5f656-b5e1-42cf-8c05-6baf4feb891c tempest-TestStampPattern-1631901009 None] snapshot: 7364aaab-1c0e-4bfe-b76d-bf4cd249f780, volume: 6b203a45-3d01-4843-9d9e-9284016296f4,  {{(pid=87166) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 14 16:38:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2bd5f656-b5e1-42cf-8c05-6baf4feb891c tempest-TestStampPattern-1631901009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:38:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2bd5f656-b5e1-42cf-8c05-6baf4feb891c tempest-TestStampPattern-1631901009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:38:22 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2bd5f656-b5e1-42cf-8c05-6baf4feb891c tempest-TestStampPattern-1631901009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:38:22 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2bd5f656-b5e1-42cf-8c05-6baf4feb891c tempest-TestStampPattern-1631901009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:38:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2bd5f656-b5e1-42cf-8c05-6baf4feb891c tempest-TestStampPattern-1631901009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:38:22 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb27d72-5a1a-4a37-8fc9-73738720db8d]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:38:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2bd5f656-b5e1-42cf-8c05-6baf4feb891c tempest-TestStampPattern-1631901009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-193630ff-b6f9-4539-9ac6-ff135adde62a.7364aaab-1c0e-4bfe-b76d-bf4cd249f780 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:38:22 devstack sudo[103141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-193630ff-b6f9-4539-9ac6-ff135adde62a.7364aaab-1c0e-4bfe-b76d-bf4cd249f780
Jul 14 16:38:22 devstack sudo[103141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:38:23 devstack sudo[103141]: pam_unix(sudo:session): session closed for user root
Jul 14 16:38:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2bd5f656-b5e1-42cf-8c05-6baf4feb891c tempest-TestStampPattern-1631901009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-193630ff-b6f9-4539-9ac6-ff135adde62a.7364aaab-1c0e-4bfe-b76d-bf4cd249f780" returned: 0 in 0.384s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:38:23 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-2bd5f656-b5e1-42cf-8c05-6baf4feb891c tempest-TestStampPattern-1631901009 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-193630ff-b6f9-4539-9ac6-ff135adde62a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 16:38:23 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2bd5f656-b5e1-42cf-8c05-6baf4feb891c tempest-TestStampPattern-1631901009 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-193630ff-b6f9-4539-9ac6-ff135adde62a {{(pid=87166) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 14 16:38:23 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2bd5f656-b5e1-42cf-8c05-6baf4feb891c tempest-TestStampPattern-1631901009 None] Creating direct copy from snapshot {{(pid=87166) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 14 16:38:23 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bda35b0-55da-4a0d-9894-8c7f0cbc5b10]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:38:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2bd5f656-b5e1-42cf-8c05-6baf4feb891c tempest-TestStampPattern-1631901009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-193630ff-b6f9-4539-9ac6-ff135adde62a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:38:23 devstack sudo[103146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-193630ff-b6f9-4539-9ac6-ff135adde62a
Jul 14 16:38:23 devstack sudo[103146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:38:23 devstack sudo[103146]: pam_unix(sudo:session): session closed for user root
Jul 14 16:38:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2bd5f656-b5e1-42cf-8c05-6baf4feb891c tempest-TestStampPattern-1631901009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-193630ff-b6f9-4539-9ac6-ff135adde62a" returned: 0 in 0.389s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:38:23 devstack cinder-volume[87166]: DEBUG cinder.utils [None req-2bd5f656-b5e1-42cf-8c05-6baf4feb891c tempest-TestStampPattern-1631901009 None] Path /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6b203a45-3d01-4843-9d9e-9284016296f4 not found in is_blk_device check {{(pid=87166) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 14 16:38:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2bd5f656-b5e1-42cf-8c05-6baf4feb891c tempest-TestStampPattern-1631901009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-193630ff-b6f9-4539-9ac6-ff135adde62a /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6b203a45-3d01-4843-9d9e-9284016296f4 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:38:23 devstack sudo[103154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-193630ff-b6f9-4539-9ac6-ff135adde62a /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6b203a45-3d01-4843-9d9e-9284016296f4
Jul 14 16:38:23 devstack sudo[103154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:38:29 devstack sudo[103154]: pam_unix(sudo:session): session closed for user root
Jul 14 16:38:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2bd5f656-b5e1-42cf-8c05-6baf4feb891c tempest-TestStampPattern-1631901009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-193630ff-b6f9-4539-9ac6-ff135adde62a /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6b203a45-3d01-4843-9d9e-9284016296f4" returned: 0 in 5.377s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:38:29 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c0640d8-24fc-46d5-a449-9109c44279ea]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:38:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2bd5f656-b5e1-42cf-8c05-6baf4feb891c tempest-TestStampPattern-1631901009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-193630ff-b6f9-4539-9ac6-ff135adde62a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:38:29 devstack sudo[103167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-193630ff-b6f9-4539-9ac6-ff135adde62a
Jul 14 16:38:29 devstack sudo[103167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:38:29 devstack sudo[103167]: pam_unix(sudo:session): session closed for user root
Jul 14 16:38:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2bd5f656-b5e1-42cf-8c05-6baf4feb891c tempest-TestStampPattern-1631901009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-193630ff-b6f9-4539-9ac6-ff135adde62a" returned: 0 in 0.628s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:38:29 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-2bd5f656-b5e1-42cf-8c05-6baf4feb891c tempest-TestStampPattern-1631901009 None] Image conversion details: src /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-193630ff-b6f9-4539-9ac6-ff135adde62a, size 1024.00 MB, duration 5.38 sec, destination /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6b203a45-3d01-4843-9d9e-9284016296f4 {{(pid=87166) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 14 16:38:29 devstack cinder-volume[87166]: INFO cinder.image.image_utils [None req-2bd5f656-b5e1-42cf-8c05-6baf4feb891c tempest-TestStampPattern-1631901009 None] Converted 1024.00 MB image at 190.39 MB/s
Jul 14 16:38:29 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-2bd5f656-b5e1-42cf-8c05-6baf4feb891c tempest-TestStampPattern-1631901009 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6b203a45-3d01-4843-9d9e-9284016296f4 is being set with open permissions: ugo+rw
Jul 14 16:38:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2bd5f656-b5e1-42cf-8c05-6baf4feb891c tempest-TestStampPattern-1631901009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6b203a45-3d01-4843-9d9e-9284016296f4 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:38:29 devstack sudo[103183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6b203a45-3d01-4843-9d9e-9284016296f4
Jul 14 16:38:29 devstack sudo[103183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:38:29 devstack sudo[103183]: pam_unix(sudo:session): session closed for user root
Jul 14 16:38:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2bd5f656-b5e1-42cf-8c05-6baf4feb891c tempest-TestStampPattern-1631901009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6b203a45-3d01-4843-9d9e-9284016296f4" returned: 0 in 0.295s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:38:29 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2bd5f656-b5e1-42cf-8c05-6baf4feb891c tempest-TestStampPattern-1631901009 None] Lock "cinder-quobyte-6b203a45-3d01-4843-9d9e-9284016296f4" released by "_copy_volume_from_snapshot" :: held 7.177s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:38:29 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2bd5f656-b5e1-42cf-8c05-6baf4feb891c tempest-TestStampPattern-1631901009 None] Lock "cinder-quobyte-7364aaab-1c0e-4bfe-b76d-bf4cd249f780-6b203a45-3d01-4843-9d9e-9284016296f4" released by "_create_volume_from_snapshot" :: held 7.209s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:38:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2bd5f656-b5e1-42cf-8c05-6baf4feb891c tempest-TestStampPattern-1631901009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.228s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:38:30 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2bd5f656-b5e1-42cf-8c05-6baf4feb891c tempest-TestStampPattern-1631901009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (542af8a3-7eea-4e89-ad98-a9a9237d104f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b203a45-3d01-4843-9d9e-9284016296f4', 'volume_size': 1, 'snapshot_id': '7364aaab-1c0e-4bfe-b76d-bf4cd249f780'}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:38:30 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2bd5f656-b5e1-42cf-8c05-6baf4feb891c tempest-TestStampPattern-1631901009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50a563dc-ea81-4094-9a4c-981f3d199d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:38:30 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-2bd5f656-b5e1-42cf-8c05-6baf4feb891c tempest-TestStampPattern-1631901009 None] Volume volume-6b203a45-3d01-4843-9d9e-9284016296f4 (6b203a45-3d01-4843-9d9e-9284016296f4): created successfully
Jul 14 16:38:30 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2bd5f656-b5e1-42cf-8c05-6baf4feb891c tempest-TestStampPattern-1631901009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50a563dc-ea81-4094-9a4c-981f3d199d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:38:30 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2bd5f656-b5e1-42cf-8c05-6baf4feb891c tempest-TestStampPattern-1631901009 None] Flow 'volume_create_manager' (0931de81-16a4-4a55-9425-50c4a21b4555) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:38:30 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-2bd5f656-b5e1-42cf-8c05-6baf4feb891c tempest-TestStampPattern-1631901009 None] Created volume successfully.
Jul 14 16:38:35 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 16:38:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:38:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:38:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:38:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:38:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:38:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:38:35 devstack sudo[103247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:38:35 devstack sudo[103247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:38:35 devstack sudo[103247]: pam_unix(sudo:session): session closed for user root
Jul 14 16:38:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.265s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:38:35 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:38:35 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Running periodic task VolumeManager._thread_info {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 16:38:35 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] thread count: 29 {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 14 16:38:35 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] thread info: [<_MainThread(MainThread, started 128606490927232)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128606415432960)>, <Thread(Thread-3 (stat_writer), started daemon 128606378859328)>, <Thread(Rabbit-heartbeat, started daemon 128606379646144)>, <Thread(Thread-5 (_runner), started daemon 128606377685824)>, <Thread(Thread-7 (_runner), started daemon 128606377701888)>, <Thread(fd_logger, started daemon 128606377091392)>, <Thread(privsep_reader, started daemon 128606375782080)>, <Thread(tpool_thread_0, started daemon 128606365607616)>, <Thread(tpool_thread_1, started daemon 128606357214912)>, <Thread(tpool_thread_2, started daemon 128606348822208)>, <Thread(tpool_thread_3, started daemon 128606340413120)>, <Thread(tpool_thread_4, started daemon 128606332004032)>, <Thread(tpool_thread_5, started daemon 128606323594944)>, <Thread(tpool_thread_6, started daemon 128606315185856)>, <Thread(tpool_thread_7, started daemon 128606306776768)>, <Thread(tpool_thread_8, started daemon 128606298367680)>, <Thread(tpool_thread_9, started daemon 128606289958592)>, <Thread(tpool_thread_10, started daemon 128606281549504)>, <Thread(tpool_thread_11, started daemon 128606273140416)>, <Thread(tpool_thread_12, started daemon 128606264731328)>, <Thread(tpool_thread_13, started daemon 128606256322240)>, <Thread(tpool_thread_14, started daemon 128606247913152)>, <Thread(tpool_thread_15, started daemon 128606239504064)>, <Thread(tpool_thread_16, started daemon 128606231094976)>, <Thread(tpool_thread_17, started daemon 128606222685888)>, <Thread(tpool_thread_18, started daemon 128606214276800)>, <Thread(tpool_thread_19, started daemon 128606205867712)>, <Thread(Rabbit-heartbeat, started daemon 128606368169344)>] {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 14 16:38:40 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:SELECT=11,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 16:38:40 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:SELECT=14,cinder:UPDATE=6,cinder:DELETE=2 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 16:39:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-0ace2d04-65b0-47a5-9c9b-4a0f8677795a req-46e9ef6f-1e58-45cd-a1f3-2f2444397825 tempest-TestStampPattern-1631901009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:39:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-0ace2d04-65b0-47a5-9c9b-4a0f8677795a req-46e9ef6f-1e58-45cd-a1f3-2f2444397825 tempest-TestStampPattern-1631901009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:39:12 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f39811-bc1e-4643-b8a2-754d76cb86c2]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:39:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-0ace2d04-65b0-47a5-9c9b-4a0f8677795a req-46e9ef6f-1e58-45cd-a1f3-2f2444397825 tempest-TestStampPattern-1631901009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6b203a45-3d01-4843-9d9e-9284016296f4 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:39:12 devstack sudo[103334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6b203a45-3d01-4843-9d9e-9284016296f4
Jul 14 16:39:12 devstack sudo[103334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:39:12 devstack sudo[103334]: pam_unix(sudo:session): session closed for user root
Jul 14 16:39:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-0ace2d04-65b0-47a5-9c9b-4a0f8677795a req-46e9ef6f-1e58-45cd-a1f3-2f2444397825 tempest-TestStampPattern-1631901009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6b203a45-3d01-4843-9d9e-9284016296f4" returned: 0 in 0.361s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:39:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-0ace2d04-65b0-47a5-9c9b-4a0f8677795a req-46e9ef6f-1e58-45cd-a1f3-2f2444397825 tempest-TestStampPattern-1631901009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.378s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:39:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-0ace2d04-65b0-47a5-9c9b-4a0f8677795a req-46e9ef6f-1e58-45cd-a1f3-2f2444397825 tempest-TestStampPattern-1631901009 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052', 'name': 'volume-6b203a45-3d01-4843-9d9e-9284016296f4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0d8a0037-c5e5-4a17-8e22-39e2abdb5829', 'enforce_multipath': True} {{(pid=87166) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 14 16:39:12 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-0ace2d04-65b0-47a5-9c9b-4a0f8677795a req-46e9ef6f-1e58-45cd-a1f3-2f2444397825 tempest-TestStampPattern-1631901009 None] attachment_update completed successfully.
Jul 14 16:39:15 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-55f4bf1d-c902-4d6a-9d5a-ba940f3083f3 req-64f013b6-9fd6-49df-b6da-b39415ba8abf tempest-TestStampPattern-1631901009 None] Terminate volume connection completed successfully.
Jul 14 16:39:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-55f4bf1d-c902-4d6a-9d5a-ba940f3083f3 req-64f013b6-9fd6-49df-b6da-b39415ba8abf tempest-TestStampPattern-1631901009 None] Deleting attachment 0d8a0037-c5e5-4a17-8e22-39e2abdb5829. {{(pid=87166) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 14 16:39:20 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7fc1753f-3470-4e07-bd15-f8bf6476a640 tempest-TestStampPattern-1631901009 None] Acquiring lock "cinder-6b203a45-3d01-4843-9d9e-9284016296f4-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:39:20 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7fc1753f-3470-4e07-bd15-f8bf6476a640 tempest-TestStampPattern-1631901009 None] Lock "cinder-6b203a45-3d01-4843-9d9e-9284016296f4-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:39:20 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7fc1753f-3470-4e07-bd15-f8bf6476a640 tempest-TestStampPattern-1631901009 None] Acquiring lock "cinder-quobyte-6b203a45-3d01-4843-9d9e-9284016296f4" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:39:20 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7fc1753f-3470-4e07-bd15-f8bf6476a640 tempest-TestStampPattern-1631901009 None] Lock "cinder-quobyte-6b203a45-3d01-4843-9d9e-9284016296f4" acquired by "delete_volume" :: waited 0.016s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:39:20 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[6066c0d6-bd7d-466d-a8a7-3e8c8e96d216]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:39:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7fc1753f-3470-4e07-bd15-f8bf6476a640 tempest-TestStampPattern-1631901009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6b203a45-3d01-4843-9d9e-9284016296f4 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:39:20 devstack sudo[103795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6b203a45-3d01-4843-9d9e-9284016296f4
Jul 14 16:39:20 devstack sudo[103795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:39:20 devstack sudo[103795]: pam_unix(sudo:session): session closed for user root
Jul 14 16:39:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7fc1753f-3470-4e07-bd15-f8bf6476a640 tempest-TestStampPattern-1631901009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6b203a45-3d01-4843-9d9e-9284016296f4" returned: 0 in 0.360s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:39:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7fc1753f-3470-4e07-bd15-f8bf6476a640 tempest-TestStampPattern-1631901009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6b203a45-3d01-4843-9d9e-9284016296f4 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:39:20 devstack sudo[103800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6b203a45-3d01-4843-9d9e-9284016296f4
Jul 14 16:39:20 devstack sudo[103800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:39:20 devstack sudo[103800]: pam_unix(sudo:session): session closed for user root
Jul 14 16:39:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7fc1753f-3470-4e07-bd15-f8bf6476a640 tempest-TestStampPattern-1631901009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6b203a45-3d01-4843-9d9e-9284016296f4" returned: 0 in 0.236s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:39:20 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7fc1753f-3470-4e07-bd15-f8bf6476a640 tempest-TestStampPattern-1631901009 None] Lock "cinder-quobyte-6b203a45-3d01-4843-9d9e-9284016296f4" released by "delete_volume" :: held 0.636s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:39:20 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-7fc1753f-3470-4e07-bd15-f8bf6476a640 tempest-TestStampPattern-1631901009 None] Created reservations ['b226bdeb-36cc-4cb3-9113-ec26fd54ba4e', '8644dbe0-98d7-4e0e-b7b9-955dc07dd2ac', 'a11026be-a2b7-4720-8ffd-b78acfc80b64', '9322f0b2-871e-4b50-9d9e-70197a473985'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:39:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-7fc1753f-3470-4e07-bd15-f8bf6476a640 tempest-TestStampPattern-1631901009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:39:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-7fc1753f-3470-4e07-bd15-f8bf6476a640 tempest-TestStampPattern-1631901009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:39:20 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-7fc1753f-3470-4e07-bd15-f8bf6476a640 tempest-TestStampPattern-1631901009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:39:20 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-7fc1753f-3470-4e07-bd15-f8bf6476a640 tempest-TestStampPattern-1631901009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:39:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-7fc1753f-3470-4e07-bd15-f8bf6476a640 tempest-TestStampPattern-1631901009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:39:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7fc1753f-3470-4e07-bd15-f8bf6476a640 tempest-TestStampPattern-1631901009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:39:20 devstack sudo[103803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:39:20 devstack sudo[103803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:39:21 devstack sudo[103803]: pam_unix(sudo:session): session closed for user root
Jul 14 16:39:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7fc1753f-3470-4e07-bd15-f8bf6476a640 tempest-TestStampPattern-1631901009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.243s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:39:21 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-7fc1753f-3470-4e07-bd15-f8bf6476a640 tempest-TestStampPattern-1631901009 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:39:21 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-7fc1753f-3470-4e07-bd15-f8bf6476a640 tempest-TestStampPattern-1631901009 None] Deleted volume successfully.
Jul 14 16:39:21 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7fc1753f-3470-4e07-bd15-f8bf6476a640 tempest-TestStampPattern-1631901009 None] Lock "cinder-6b203a45-3d01-4843-9d9e-9284016296f4-delete_volume" released by "delete_volume" :: held 1.080s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:39:21 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d0aa9d93-887e-4901-9e97-4a440da69308 tempest-TestStampPattern-1631901009 None] Acquiring lock "cinder-7364aaab-1c0e-4bfe-b76d-bf4cd249f780-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:39:21 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d0aa9d93-887e-4901-9e97-4a440da69308 tempest-TestStampPattern-1631901009 None] Lock "cinder-7364aaab-1c0e-4bfe-b76d-bf4cd249f780-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:39:21 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d0aa9d93-887e-4901-9e97-4a440da69308 tempest-TestStampPattern-1631901009 None] Acquiring lock "cinder-quobyte-193630ff-b6f9-4539-9ac6-ff135adde62a" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:39:21 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d0aa9d93-887e-4901-9e97-4a440da69308 tempest-TestStampPattern-1631901009 None] Lock "cinder-quobyte-193630ff-b6f9-4539-9ac6-ff135adde62a" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:39:21 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d0aa9d93-887e-4901-9e97-4a440da69308 tempest-TestStampPattern-1631901009 None] Acquiring lock "cinder-quobyte-7364aaab-1c0e-4bfe-b76d-bf4cd249f780" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:39:21 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d0aa9d93-887e-4901-9e97-4a440da69308 tempest-TestStampPattern-1631901009 None] Lock "cinder-quobyte-7364aaab-1c0e-4bfe-b76d-bf4cd249f780" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:39:21 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-d0aa9d93-887e-4901-9e97-4a440da69308 tempest-TestStampPattern-1631901009 None] Deleting offline snapshot 7364aaab-1c0e-4bfe-b76d-bf4cd249f780 of volume 193630ff-b6f9-4539-9ac6-ff135adde62a {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 16:39:21 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-d0aa9d93-887e-4901-9e97-4a440da69308 tempest-TestStampPattern-1631901009 None] snapshot_file for this snap is: volume-193630ff-b6f9-4539-9ac6-ff135adde62a.7364aaab-1c0e-4bfe-b76d-bf4cd249f780 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 16:39:21 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c16bde-369c-4863-91c5-4910e5c08cbf]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:39:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d0aa9d93-887e-4901-9e97-4a440da69308 tempest-TestStampPattern-1631901009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-193630ff-b6f9-4539-9ac6-ff135adde62a.7364aaab-1c0e-4bfe-b76d-bf4cd249f780 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:39:21 devstack sudo[103806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-193630ff-b6f9-4539-9ac6-ff135adde62a.7364aaab-1c0e-4bfe-b76d-bf4cd249f780
Jul 14 16:39:21 devstack sudo[103806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:39:21 devstack sudo[103806]: pam_unix(sudo:session): session closed for user root
Jul 14 16:39:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d0aa9d93-887e-4901-9e97-4a440da69308 tempest-TestStampPattern-1631901009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-193630ff-b6f9-4539-9ac6-ff135adde62a.7364aaab-1c0e-4bfe-b76d-bf4cd249f780" returned: 0 in 0.385s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:39:21 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-d0aa9d93-887e-4901-9e97-4a440da69308 tempest-TestStampPattern-1631901009 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-193630ff-b6f9-4539-9ac6-ff135adde62a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 16:39:21 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd315567-5705-4130-aa2e-57da77c011d7]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:39:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d0aa9d93-887e-4901-9e97-4a440da69308 tempest-TestStampPattern-1631901009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-193630ff-b6f9-4539-9ac6-ff135adde62a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:39:22 devstack sudo[103811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-193630ff-b6f9-4539-9ac6-ff135adde62a
Jul 14 16:39:22 devstack sudo[103811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:39:22 devstack sudo[103811]: pam_unix(sudo:session): session closed for user root
Jul 14 16:39:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d0aa9d93-887e-4901-9e97-4a440da69308 tempest-TestStampPattern-1631901009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-193630ff-b6f9-4539-9ac6-ff135adde62a" returned: 0 in 0.355s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:39:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d0aa9d93-887e-4901-9e97-4a440da69308 tempest-TestStampPattern-1631901009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-193630ff-b6f9-4539-9ac6-ff135adde62a.7364aaab-1c0e-4bfe-b76d-bf4cd249f780 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:39:22 devstack sudo[103817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-193630ff-b6f9-4539-9ac6-ff135adde62a.7364aaab-1c0e-4bfe-b76d-bf4cd249f780
Jul 14 16:39:22 devstack sudo[103817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:39:22 devstack sudo[103817]: pam_unix(sudo:session): session closed for user root
Jul 14 16:39:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d0aa9d93-887e-4901-9e97-4a440da69308 tempest-TestStampPattern-1631901009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-193630ff-b6f9-4539-9ac6-ff135adde62a.7364aaab-1c0e-4bfe-b76d-bf4cd249f780" returned: 0 in 0.325s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:39:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d0aa9d93-887e-4901-9e97-4a440da69308 tempest-TestStampPattern-1631901009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-193630ff-b6f9-4539-9ac6-ff135adde62a.7364aaab-1c0e-4bfe-b76d-bf4cd249f780 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:39:22 devstack sudo[103822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-193630ff-b6f9-4539-9ac6-ff135adde62a.7364aaab-1c0e-4bfe-b76d-bf4cd249f780
Jul 14 16:39:22 devstack sudo[103822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:39:22 devstack sudo[103822]: pam_unix(sudo:session): session closed for user root
Jul 14 16:39:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d0aa9d93-887e-4901-9e97-4a440da69308 tempest-TestStampPattern-1631901009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-193630ff-b6f9-4539-9ac6-ff135adde62a.7364aaab-1c0e-4bfe-b76d-bf4cd249f780" returned: 0 in 0.243s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:39:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d0aa9d93-887e-4901-9e97-4a440da69308 tempest-TestStampPattern-1631901009 None] Lock "cinder-quobyte-7364aaab-1c0e-4bfe-b76d-bf4cd249f780" released by "_delete_snapshot" :: held 1.400s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:39:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d0aa9d93-887e-4901-9e97-4a440da69308 tempest-TestStampPattern-1631901009 None] Lock "cinder-quobyte-193630ff-b6f9-4539-9ac6-ff135adde62a" released by "delete_snapshot" :: held 1.420s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:39:22 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-d0aa9d93-887e-4901-9e97-4a440da69308 tempest-TestStampPattern-1631901009 None] Created reservations ['60a7ef56-632d-4b1c-97c2-aa0eb0fd7c87', '441663c3-4e52-4fa9-9ae4-232f2aa023c0', 'bb4e8b49-0e36-465d-9c0a-a91317a07506', '60271a75-53bc-43fd-b467-e30608852df0'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:39:23 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-d0aa9d93-887e-4901-9e97-4a440da69308 tempest-TestStampPattern-1631901009 None] Delete snapshot completed successfully.
Jul 14 16:39:23 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d0aa9d93-887e-4901-9e97-4a440da69308 tempest-TestStampPattern-1631901009 None] Lock "cinder-7364aaab-1c0e-4bfe-b76d-bf4cd249f780-delete_snapshot" released by "delete_snapshot" :: held 1.549s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:39:27 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2a7f575b-ab84-4897-8cf1-9f6900e7405a tempest-TestStampPattern-1631901009 None] Acquiring lock "cinder-193630ff-b6f9-4539-9ac6-ff135adde62a-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:39:27 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2a7f575b-ab84-4897-8cf1-9f6900e7405a tempest-TestStampPattern-1631901009 None] Lock "cinder-193630ff-b6f9-4539-9ac6-ff135adde62a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:39:27 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2a7f575b-ab84-4897-8cf1-9f6900e7405a tempest-TestStampPattern-1631901009 None] Acquiring lock "cinder-quobyte-193630ff-b6f9-4539-9ac6-ff135adde62a" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:39:27 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2a7f575b-ab84-4897-8cf1-9f6900e7405a tempest-TestStampPattern-1631901009 None] Lock "cinder-quobyte-193630ff-b6f9-4539-9ac6-ff135adde62a" acquired by "delete_volume" :: waited 0.014s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:39:27 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf4627e-5e7f-426c-8238-3ee898b60716]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:39:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2a7f575b-ab84-4897-8cf1-9f6900e7405a tempest-TestStampPattern-1631901009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-193630ff-b6f9-4539-9ac6-ff135adde62a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:39:27 devstack sudo[103852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-193630ff-b6f9-4539-9ac6-ff135adde62a
Jul 14 16:39:27 devstack sudo[103852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:39:27 devstack sudo[103852]: pam_unix(sudo:session): session closed for user root
Jul 14 16:39:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2a7f575b-ab84-4897-8cf1-9f6900e7405a tempest-TestStampPattern-1631901009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-193630ff-b6f9-4539-9ac6-ff135adde62a" returned: 0 in 0.346s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:39:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2a7f575b-ab84-4897-8cf1-9f6900e7405a tempest-TestStampPattern-1631901009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-193630ff-b6f9-4539-9ac6-ff135adde62a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:39:27 devstack sudo[103857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-193630ff-b6f9-4539-9ac6-ff135adde62a
Jul 14 16:39:27 devstack sudo[103857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:39:27 devstack sudo[103857]: pam_unix(sudo:session): session closed for user root
Jul 14 16:39:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2a7f575b-ab84-4897-8cf1-9f6900e7405a tempest-TestStampPattern-1631901009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-193630ff-b6f9-4539-9ac6-ff135adde62a" returned: 0 in 0.238s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:39:27 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2a7f575b-ab84-4897-8cf1-9f6900e7405a tempest-TestStampPattern-1631901009 None] Lock "cinder-quobyte-193630ff-b6f9-4539-9ac6-ff135adde62a" released by "delete_volume" :: held 0.639s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:39:27 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-2a7f575b-ab84-4897-8cf1-9f6900e7405a tempest-TestStampPattern-1631901009 None] Created reservations ['e2ce9998-3fc0-4e78-b23f-ebb8df152e89', '29f6d058-e0cc-46aa-a04e-09e2d80aa000', '63104723-af94-4343-a9f6-cce032601633', '11a8cc56-2b84-442e-914a-43bcbbc83d4d'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:39:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2a7f575b-ab84-4897-8cf1-9f6900e7405a tempest-TestStampPattern-1631901009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:39:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2a7f575b-ab84-4897-8cf1-9f6900e7405a tempest-TestStampPattern-1631901009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:39:27 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2a7f575b-ab84-4897-8cf1-9f6900e7405a tempest-TestStampPattern-1631901009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:39:27 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2a7f575b-ab84-4897-8cf1-9f6900e7405a tempest-TestStampPattern-1631901009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:39:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2a7f575b-ab84-4897-8cf1-9f6900e7405a tempest-TestStampPattern-1631901009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:39:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2a7f575b-ab84-4897-8cf1-9f6900e7405a tempest-TestStampPattern-1631901009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:39:27 devstack sudo[103860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:39:27 devstack sudo[103860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:39:28 devstack sudo[103860]: pam_unix(sudo:session): session closed for user root
Jul 14 16:39:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2a7f575b-ab84-4897-8cf1-9f6900e7405a tempest-TestStampPattern-1631901009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.245s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:39:28 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-2a7f575b-ab84-4897-8cf1-9f6900e7405a tempest-TestStampPattern-1631901009 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:39:28 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-2a7f575b-ab84-4897-8cf1-9f6900e7405a tempest-TestStampPattern-1631901009 None] Deleted volume successfully.
Jul 14 16:39:28 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2a7f575b-ab84-4897-8cf1-9f6900e7405a tempest-TestStampPattern-1631901009 None] Lock "cinder-193630ff-b6f9-4539-9ac6-ff135adde62a-delete_volume" released by "delete_volume" :: held 1.064s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:39:35 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 16:39:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:39:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:39:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:39:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:39:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:39:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:39:35 devstack sudo[103869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:39:35 devstack sudo[103869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:39:35 devstack sudo[103869]: pam_unix(sudo:session): session closed for user root
Jul 14 16:39:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.270s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:39:35 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:39:35 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Running periodic task VolumeManager._thread_info {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 16:39:35 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] thread count: 29 {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 14 16:39:35 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] thread info: [<_MainThread(MainThread, started 128606490927232)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128606415432960)>, <Thread(Thread-3 (stat_writer), started daemon 128606378859328)>, <Thread(Rabbit-heartbeat, started daemon 128606379646144)>, <Thread(Thread-5 (_runner), started daemon 128606377685824)>, <Thread(Thread-7 (_runner), started daemon 128606377701888)>, <Thread(fd_logger, started daemon 128606377091392)>, <Thread(privsep_reader, started daemon 128606375782080)>, <Thread(tpool_thread_0, started daemon 128606365607616)>, <Thread(tpool_thread_1, started daemon 128606357214912)>, <Thread(tpool_thread_2, started daemon 128606348822208)>, <Thread(tpool_thread_3, started daemon 128606340413120)>, <Thread(tpool_thread_4, started daemon 128606332004032)>, <Thread(tpool_thread_5, started daemon 128606323594944)>, <Thread(tpool_thread_6, started daemon 128606315185856)>, <Thread(tpool_thread_7, started daemon 128606306776768)>, <Thread(tpool_thread_8, started daemon 128606298367680)>, <Thread(tpool_thread_9, started daemon 128606289958592)>, <Thread(tpool_thread_10, started daemon 128606281549504)>, <Thread(tpool_thread_11, started daemon 128606273140416)>, <Thread(tpool_thread_12, started daemon 128606264731328)>, <Thread(tpool_thread_13, started daemon 128606256322240)>, <Thread(tpool_thread_14, started daemon 128606247913152)>, <Thread(tpool_thread_15, started daemon 128606239504064)>, <Thread(tpool_thread_16, started daemon 128606231094976)>, <Thread(tpool_thread_17, started daemon 128606222685888)>, <Thread(tpool_thread_18, started daemon 128606214276800)>, <Thread(tpool_thread_19, started daemon 128606205867712)>, <Thread(Rabbit-heartbeat, started daemon 128606368169344)>] {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 14 16:39:37 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-57681ca9-4822-4336-86f0-efd171c2b470 tempest-CreateVolumesFromSnapshotTest-212894485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:39:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-57681ca9-4822-4336-86f0-efd171c2b470 tempest-CreateVolumesFromSnapshotTest-212894485 None] Flow 'volume_create_manager' (87c6d4f8-e76b-48ca-89a1-c2799bebdd4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:39:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-57681ca9-4822-4336-86f0-efd171c2b470 tempest-CreateVolumesFromSnapshotTest-212894485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36589107-a128-4fe8-b429-2539f45a6fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:39:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-57681ca9-4822-4336-86f0-efd171c2b470 tempest-CreateVolumesFromSnapshotTest-212894485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36589107-a128-4fe8-b429-2539f45a6fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:39:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-635918826',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab6f08f4-41bf-49ac-996b-c125e6ee91f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='607c03e856984681b9ee383fbb094fa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:39:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:39:38Z,use_quota=True,user_id='7f38dc0d335f45468f24538abb1c271c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:39:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-57681ca9-4822-4336-86f0-efd171c2b470 tempest-CreateVolumesFromSnapshotTest-212894485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (256c4fca-251c-42c6-94da-d77eca4d6aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:39:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-57681ca9-4822-4336-86f0-efd171c2b470 tempest-CreateVolumesFromSnapshotTest-212894485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (256c4fca-251c-42c6-94da-d77eca4d6aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:39:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-57681ca9-4822-4336-86f0-efd171c2b470 tempest-CreateVolumesFromSnapshotTest-212894485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96b44e8a-ed6c-41a6-84df-0eec5f539dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:39:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-57681ca9-4822-4336-86f0-efd171c2b470 tempest-CreateVolumesFromSnapshotTest-212894485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96b44e8a-ed6c-41a6-84df-0eec5f539dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab6f08f4-41bf-49ac-996b-c125e6ee91f2', 'volume_name': 'volume-ab6f08f4-41bf-49ac-996b-c125e6ee91f2', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:39:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-57681ca9-4822-4336-86f0-efd171c2b470 tempest-CreateVolumesFromSnapshotTest-212894485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab9e3453-f13c-4911-bc45-43a6a0795855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:39:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-57681ca9-4822-4336-86f0-efd171c2b470 tempest-CreateVolumesFromSnapshotTest-212894485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab9e3453-f13c-4911-bc45-43a6a0795855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:39:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-57681ca9-4822-4336-86f0-efd171c2b470 tempest-CreateVolumesFromSnapshotTest-212894485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ded8c75-d7de-4ad2-9f26-f2c053424ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:39:37 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-57681ca9-4822-4336-86f0-efd171c2b470 tempest-CreateVolumesFromSnapshotTest-212894485 None] Volume ab6f08f4-41bf-49ac-996b-c125e6ee91f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab6f08f4-41bf-49ac-996b-c125e6ee91f2', 'volume_size': 1}
Jul 14 16:39:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-57681ca9-4822-4336-86f0-efd171c2b470 tempest-CreateVolumesFromSnapshotTest-212894485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:39:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-57681ca9-4822-4336-86f0-efd171c2b470 tempest-CreateVolumesFromSnapshotTest-212894485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:39:37 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-57681ca9-4822-4336-86f0-efd171c2b470 tempest-CreateVolumesFromSnapshotTest-212894485 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:39:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-635918826',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab6f08f4-41bf-49ac-996b-c125e6ee91f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='607c03e856984681b9ee383fbb094fa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:39:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:39:38Z,use_quota=True,user_id='7f38dc0d335f45468f24538abb1c271c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:39:37 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-57681ca9-4822-4336-86f0-efd171c2b470 tempest-CreateVolumesFromSnapshotTest-212894485 None] Creating volume ab6f08f4-41bf-49ac-996b-c125e6ee91f2 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:39:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-57681ca9-4822-4336-86f0-efd171c2b470 tempest-CreateVolumesFromSnapshotTest-212894485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:39:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-57681ca9-4822-4336-86f0-efd171c2b470 tempest-CreateVolumesFromSnapshotTest-212894485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:39:37 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-57681ca9-4822-4336-86f0-efd171c2b470 tempest-CreateVolumesFromSnapshotTest-212894485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:39:37 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-57681ca9-4822-4336-86f0-efd171c2b470 tempest-CreateVolumesFromSnapshotTest-212894485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:39:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-57681ca9-4822-4336-86f0-efd171c2b470 tempest-CreateVolumesFromSnapshotTest-212894485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:39:37 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-57681ca9-4822-4336-86f0-efd171c2b470 tempest-CreateVolumesFromSnapshotTest-212894485 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:39:37 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-57681ca9-4822-4336-86f0-efd171c2b470 tempest-CreateVolumesFromSnapshotTest-212894485 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:39:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-57681ca9-4822-4336-86f0-efd171c2b470 tempest-CreateVolumesFromSnapshotTest-212894485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ab6f08f4-41bf-49ac-996b-c125e6ee91f2 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:39:37 devstack sudo[103874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ab6f08f4-41bf-49ac-996b-c125e6ee91f2 1073741824
Jul 14 16:39:37 devstack sudo[103874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:39:38 devstack sudo[103874]: pam_unix(sudo:session): session closed for user root
Jul 14 16:39:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-57681ca9-4822-4336-86f0-efd171c2b470 tempest-CreateVolumesFromSnapshotTest-212894485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ab6f08f4-41bf-49ac-996b-c125e6ee91f2 1073741824" returned: 0 in 0.407s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:39:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-57681ca9-4822-4336-86f0-efd171c2b470 tempest-CreateVolumesFromSnapshotTest-212894485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ab6f08f4-41bf-49ac-996b-c125e6ee91f2 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:39:38 devstack sudo[103880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ab6f08f4-41bf-49ac-996b-c125e6ee91f2
Jul 14 16:39:38 devstack sudo[103880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:39:38 devstack sudo[103880]: pam_unix(sudo:session): session closed for user root
Jul 14 16:39:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-57681ca9-4822-4336-86f0-efd171c2b470 tempest-CreateVolumesFromSnapshotTest-212894485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ab6f08f4-41bf-49ac-996b-c125e6ee91f2" returned: 0 in 0.246s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:39:38 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-57681ca9-4822-4336-86f0-efd171c2b470 tempest-CreateVolumesFromSnapshotTest-212894485 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:39:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-57681ca9-4822-4336-86f0-efd171c2b470 tempest-CreateVolumesFromSnapshotTest-212894485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.698s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:39:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-57681ca9-4822-4336-86f0-efd171c2b470 tempest-CreateVolumesFromSnapshotTest-212894485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ded8c75-d7de-4ad2-9f26-f2c053424ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab6f08f4-41bf-49ac-996b-c125e6ee91f2', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:39:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-57681ca9-4822-4336-86f0-efd171c2b470 tempest-CreateVolumesFromSnapshotTest-212894485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f016b103-c928-4343-af05-9ef26e361ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:39:38 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-57681ca9-4822-4336-86f0-efd171c2b470 tempest-CreateVolumesFromSnapshotTest-212894485 None] Volume volume-ab6f08f4-41bf-49ac-996b-c125e6ee91f2 (ab6f08f4-41bf-49ac-996b-c125e6ee91f2): created successfully
Jul 14 16:39:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-57681ca9-4822-4336-86f0-efd171c2b470 tempest-CreateVolumesFromSnapshotTest-212894485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f016b103-c928-4343-af05-9ef26e361ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:39:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-57681ca9-4822-4336-86f0-efd171c2b470 tempest-CreateVolumesFromSnapshotTest-212894485 None] Flow 'volume_create_manager' (87c6d4f8-e76b-48ca-89a1-c2799bebdd4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:39:38 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-57681ca9-4822-4336-86f0-efd171c2b470 tempest-CreateVolumesFromSnapshotTest-212894485 None] Created volume successfully.
Jul 14 16:39:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-57608741-a8fd-4599-80ff-ed1404fe7f47 tempest-CreateVolumesFromSnapshotTest-212894485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:39:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-57608741-a8fd-4599-80ff-ed1404fe7f47 tempest-CreateVolumesFromSnapshotTest-212894485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:39:38 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-57608741-a8fd-4599-80ff-ed1404fe7f47 tempest-CreateVolumesFromSnapshotTest-212894485 None] Creating offline snapshot 27b3224a-2b51-4ec7-a811-8055a9de806d of volume ab6f08f4-41bf-49ac-996b-c125e6ee91f2 {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 16:39:38 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c078916-88ca-40dc-b852-eb5e3b3c1d15]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:39:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-57608741-a8fd-4599-80ff-ed1404fe7f47 tempest-CreateVolumesFromSnapshotTest-212894485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ab6f08f4-41bf-49ac-996b-c125e6ee91f2 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:39:39 devstack sudo[103883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ab6f08f4-41bf-49ac-996b-c125e6ee91f2
Jul 14 16:39:39 devstack sudo[103883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:39:39 devstack sudo[103883]: pam_unix(sudo:session): session closed for user root
Jul 14 16:39:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-57608741-a8fd-4599-80ff-ed1404fe7f47 tempest-CreateVolumesFromSnapshotTest-212894485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ab6f08f4-41bf-49ac-996b-c125e6ee91f2" returned: 0 in 0.351s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:39:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-57608741-a8fd-4599-80ff-ed1404fe7f47 tempest-CreateVolumesFromSnapshotTest-212894485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ab6f08f4-41bf-49ac-996b-c125e6ee91f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ab6f08f4-41bf-49ac-996b-c125e6ee91f2.27b3224a-2b51-4ec7-a811-8055a9de806d 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:39:39 devstack sudo[103888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ab6f08f4-41bf-49ac-996b-c125e6ee91f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ab6f08f4-41bf-49ac-996b-c125e6ee91f2.27b3224a-2b51-4ec7-a811-8055a9de806d 1G
Jul 14 16:39:39 devstack sudo[103888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:39:39 devstack sudo[103888]: pam_unix(sudo:session): session closed for user root
Jul 14 16:39:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-57608741-a8fd-4599-80ff-ed1404fe7f47 tempest-CreateVolumesFromSnapshotTest-212894485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ab6f08f4-41bf-49ac-996b-c125e6ee91f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ab6f08f4-41bf-49ac-996b-c125e6ee91f2.27b3224a-2b51-4ec7-a811-8055a9de806d 1G" returned: 0 in 0.388s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:39:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-57608741-a8fd-4599-80ff-ed1404fe7f47 tempest-CreateVolumesFromSnapshotTest-212894485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab6f08f4-41bf-49ac-996b-c125e6ee91f2 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ab6f08f4-41bf-49ac-996b-c125e6ee91f2.27b3224a-2b51-4ec7-a811-8055a9de806d {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:39:39 devstack sudo[103895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab6f08f4-41bf-49ac-996b-c125e6ee91f2 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ab6f08f4-41bf-49ac-996b-c125e6ee91f2.27b3224a-2b51-4ec7-a811-8055a9de806d
Jul 14 16:39:39 devstack sudo[103895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:39:39 devstack sudo[103895]: pam_unix(sudo:session): session closed for user root
Jul 14 16:39:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-57608741-a8fd-4599-80ff-ed1404fe7f47 tempest-CreateVolumesFromSnapshotTest-212894485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab6f08f4-41bf-49ac-996b-c125e6ee91f2 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ab6f08f4-41bf-49ac-996b-c125e6ee91f2.27b3224a-2b51-4ec7-a811-8055a9de806d" returned: 0 in 0.291s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:39:39 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-57608741-a8fd-4599-80ff-ed1404fe7f47 tempest-CreateVolumesFromSnapshotTest-212894485 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ab6f08f4-41bf-49ac-996b-c125e6ee91f2.27b3224a-2b51-4ec7-a811-8055a9de806d is being set with open permissions: ugo+rw
Jul 14 16:39:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-57608741-a8fd-4599-80ff-ed1404fe7f47 tempest-CreateVolumesFromSnapshotTest-212894485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ab6f08f4-41bf-49ac-996b-c125e6ee91f2.27b3224a-2b51-4ec7-a811-8055a9de806d {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:39:39 devstack sudo[103901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ab6f08f4-41bf-49ac-996b-c125e6ee91f2.27b3224a-2b51-4ec7-a811-8055a9de806d
Jul 14 16:39:39 devstack sudo[103901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:39:40 devstack sudo[103901]: pam_unix(sudo:session): session closed for user root
Jul 14 16:39:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-57608741-a8fd-4599-80ff-ed1404fe7f47 tempest-CreateVolumesFromSnapshotTest-212894485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ab6f08f4-41bf-49ac-996b-c125e6ee91f2.27b3224a-2b51-4ec7-a811-8055a9de806d" returned: 0 in 0.243s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:39:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-57608741-a8fd-4599-80ff-ed1404fe7f47 tempest-CreateVolumesFromSnapshotTest-212894485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ab6f08f4-41bf-49ac-996b-c125e6ee91f2.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:39:40 devstack sudo[103904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ab6f08f4-41bf-49ac-996b-c125e6ee91f2.info
Jul 14 16:39:40 devstack sudo[103904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:39:40 devstack sudo[103904]: pam_unix(sudo:session): session closed for user root
Jul 14 16:39:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-57608741-a8fd-4599-80ff-ed1404fe7f47 tempest-CreateVolumesFromSnapshotTest-212894485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ab6f08f4-41bf-49ac-996b-c125e6ee91f2.info" returned: 0 in 0.248s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:39:40 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-57608741-a8fd-4599-80ff-ed1404fe7f47 tempest-CreateVolumesFromSnapshotTest-212894485 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ab6f08f4-41bf-49ac-996b-c125e6ee91f2.info is being set with open permissions: ugo+rw
Jul 14 16:39:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-57608741-a8fd-4599-80ff-ed1404fe7f47 tempest-CreateVolumesFromSnapshotTest-212894485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ab6f08f4-41bf-49ac-996b-c125e6ee91f2.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:39:40 devstack sudo[103907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ab6f08f4-41bf-49ac-996b-c125e6ee91f2.info
Jul 14 16:39:40 devstack sudo[103907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:39:40 devstack sudo[103907]: pam_unix(sudo:session): session closed for user root
Jul 14 16:39:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-57608741-a8fd-4599-80ff-ed1404fe7f47 tempest-CreateVolumesFromSnapshotTest-212894485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ab6f08f4-41bf-49ac-996b-c125e6ee91f2.info" returned: 0 in 0.243s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:39:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-57608741-a8fd-4599-80ff-ed1404fe7f47 tempest-CreateVolumesFromSnapshotTest-212894485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.847s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:39:40 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-57608741-a8fd-4599-80ff-ed1404fe7f47 tempest-CreateVolumesFromSnapshotTest-212894485 None] Create snapshot completed successfully
Jul 14 16:39:41 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-11101042-f5a4-4e86-8530-3248de72ba87 tempest-CreateVolumesFromSnapshotTest-212894485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:39:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-11101042-f5a4-4e86-8530-3248de72ba87 tempest-CreateVolumesFromSnapshotTest-212894485 None] Flow 'volume_create_manager' (137c35fd-2c69-49cf-b22e-7b048b4b6b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:39:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-11101042-f5a4-4e86-8530-3248de72ba87 tempest-CreateVolumesFromSnapshotTest-212894485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e4b0814-7351-4bda-adc5-a87ff0ae7b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:39:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-11101042-f5a4-4e86-8530-3248de72ba87 tempest-CreateVolumesFromSnapshotTest-212894485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e4b0814-7351-4bda-adc5-a87ff0ae7b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:39:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1874011578',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd9f63bd-89c1-4af3-84cd-6a0020b453e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='607c03e856984681b9ee383fbb094fa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:39:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:39:41Z,use_quota=True,user_id='7f38dc0d335f45468f24538abb1c271c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:39:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-11101042-f5a4-4e86-8530-3248de72ba87 tempest-CreateVolumesFromSnapshotTest-212894485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (742a4e4e-731c-40bf-a209-4d631ede6b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:39:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-11101042-f5a4-4e86-8530-3248de72ba87 tempest-CreateVolumesFromSnapshotTest-212894485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (742a4e4e-731c-40bf-a209-4d631ede6b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:39:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-11101042-f5a4-4e86-8530-3248de72ba87 tempest-CreateVolumesFromSnapshotTest-212894485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (369bc5fa-6967-4495-9943-0c57cdfce9c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:39:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-11101042-f5a4-4e86-8530-3248de72ba87 tempest-CreateVolumesFromSnapshotTest-212894485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (369bc5fa-6967-4495-9943-0c57cdfce9c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd9f63bd-89c1-4af3-84cd-6a0020b453e3', 'volume_name': 'volume-fd9f63bd-89c1-4af3-84cd-6a0020b453e3', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:39:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-11101042-f5a4-4e86-8530-3248de72ba87 tempest-CreateVolumesFromSnapshotTest-212894485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad3d8858-3a73-43fb-8438-c2bd97e0eb10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:39:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-11101042-f5a4-4e86-8530-3248de72ba87 tempest-CreateVolumesFromSnapshotTest-212894485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad3d8858-3a73-43fb-8438-c2bd97e0eb10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:39:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-11101042-f5a4-4e86-8530-3248de72ba87 tempest-CreateVolumesFromSnapshotTest-212894485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cda38655-185a-4902-ba56-a005ad21f55e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:39:41 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-11101042-f5a4-4e86-8530-3248de72ba87 tempest-CreateVolumesFromSnapshotTest-212894485 None] Volume fd9f63bd-89c1-4af3-84cd-6a0020b453e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd9f63bd-89c1-4af3-84cd-6a0020b453e3', 'volume_size': 1}
Jul 14 16:39:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-11101042-f5a4-4e86-8530-3248de72ba87 tempest-CreateVolumesFromSnapshotTest-212894485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:39:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-11101042-f5a4-4e86-8530-3248de72ba87 tempest-CreateVolumesFromSnapshotTest-212894485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:39:41 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-11101042-f5a4-4e86-8530-3248de72ba87 tempest-CreateVolumesFromSnapshotTest-212894485 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:39:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1874011578',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd9f63bd-89c1-4af3-84cd-6a0020b453e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='607c03e856984681b9ee383fbb094fa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:39:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:39:41Z,use_quota=True,user_id='7f38dc0d335f45468f24538abb1c271c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:39:41 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-11101042-f5a4-4e86-8530-3248de72ba87 tempest-CreateVolumesFromSnapshotTest-212894485 None] Creating volume fd9f63bd-89c1-4af3-84cd-6a0020b453e3 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:39:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-11101042-f5a4-4e86-8530-3248de72ba87 tempest-CreateVolumesFromSnapshotTest-212894485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:39:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-11101042-f5a4-4e86-8530-3248de72ba87 tempest-CreateVolumesFromSnapshotTest-212894485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:39:41 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-11101042-f5a4-4e86-8530-3248de72ba87 tempest-CreateVolumesFromSnapshotTest-212894485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:39:41 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-11101042-f5a4-4e86-8530-3248de72ba87 tempest-CreateVolumesFromSnapshotTest-212894485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:39:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-11101042-f5a4-4e86-8530-3248de72ba87 tempest-CreateVolumesFromSnapshotTest-212894485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:39:41 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-11101042-f5a4-4e86-8530-3248de72ba87 tempest-CreateVolumesFromSnapshotTest-212894485 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:39:41 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-11101042-f5a4-4e86-8530-3248de72ba87 tempest-CreateVolumesFromSnapshotTest-212894485 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:39:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-11101042-f5a4-4e86-8530-3248de72ba87 tempest-CreateVolumesFromSnapshotTest-212894485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fd9f63bd-89c1-4af3-84cd-6a0020b453e3 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:39:41 devstack sudo[103910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fd9f63bd-89c1-4af3-84cd-6a0020b453e3 1073741824
Jul 14 16:39:41 devstack sudo[103910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:39:41 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-79ac795d-e90f-4e77-bda6-9522be21d84b tempest-CreateVolumesFromSnapshotTest-212894485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:39:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-79ac795d-e90f-4e77-bda6-9522be21d84b tempest-CreateVolumesFromSnapshotTest-212894485 None] Flow 'volume_create_manager' (8b562857-6e33-40d4-b0d3-5f020949000f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:39:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-79ac795d-e90f-4e77-bda6-9522be21d84b tempest-CreateVolumesFromSnapshotTest-212894485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac60a559-8ef2-448b-8de5-4f43b25dd2b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:39:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-79ac795d-e90f-4e77-bda6-9522be21d84b tempest-CreateVolumesFromSnapshotTest-212894485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac60a559-8ef2-448b-8de5-4f43b25dd2b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:39:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-428353221',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=effc39aa-a6bf-42cd-8786-995b29d4bb0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='607c03e856984681b9ee383fbb094fa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:39:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:39:42Z,use_quota=True,user_id='7f38dc0d335f45468f24538abb1c271c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:39:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-79ac795d-e90f-4e77-bda6-9522be21d84b tempest-CreateVolumesFromSnapshotTest-212894485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4303b99-fd12-4a03-8c10-98398c6cf009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:39:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-79ac795d-e90f-4e77-bda6-9522be21d84b tempest-CreateVolumesFromSnapshotTest-212894485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4303b99-fd12-4a03-8c10-98398c6cf009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:39:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-79ac795d-e90f-4e77-bda6-9522be21d84b tempest-CreateVolumesFromSnapshotTest-212894485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14bae2d1-778e-40fe-b9c7-f4533b6c7452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:39:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-79ac795d-e90f-4e77-bda6-9522be21d84b tempest-CreateVolumesFromSnapshotTest-212894485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14bae2d1-778e-40fe-b9c7-f4533b6c7452) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'effc39aa-a6bf-42cd-8786-995b29d4bb0e', 'volume_name': 'volume-effc39aa-a6bf-42cd-8786-995b29d4bb0e', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:39:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-79ac795d-e90f-4e77-bda6-9522be21d84b tempest-CreateVolumesFromSnapshotTest-212894485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (023d325a-95ec-409e-af1b-b7fa166c6084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:39:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-79ac795d-e90f-4e77-bda6-9522be21d84b tempest-CreateVolumesFromSnapshotTest-212894485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (023d325a-95ec-409e-af1b-b7fa166c6084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:39:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-79ac795d-e90f-4e77-bda6-9522be21d84b tempest-CreateVolumesFromSnapshotTest-212894485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79bd2ae1-ae8a-4b0c-b12a-147b0c1731ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:39:41 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-79ac795d-e90f-4e77-bda6-9522be21d84b tempest-CreateVolumesFromSnapshotTest-212894485 None] Volume effc39aa-a6bf-42cd-8786-995b29d4bb0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-effc39aa-a6bf-42cd-8786-995b29d4bb0e', 'volume_size': 1}
Jul 14 16:39:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-79ac795d-e90f-4e77-bda6-9522be21d84b tempest-CreateVolumesFromSnapshotTest-212894485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:39:41 devstack sudo[103910]: pam_unix(sudo:session): session closed for user root
Jul 14 16:39:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-11101042-f5a4-4e86-8530-3248de72ba87 tempest-CreateVolumesFromSnapshotTest-212894485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fd9f63bd-89c1-4af3-84cd-6a0020b453e3 1073741824" returned: 0 in 0.506s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:39:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-11101042-f5a4-4e86-8530-3248de72ba87 tempest-CreateVolumesFromSnapshotTest-212894485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fd9f63bd-89c1-4af3-84cd-6a0020b453e3 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:39:42 devstack sudo[103917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fd9f63bd-89c1-4af3-84cd-6a0020b453e3
Jul 14 16:39:42 devstack sudo[103917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:39:42 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddeaa1a2-03ab-4ba7-9ad6-e3b64208aa97 tempest-CreateVolumesFromSnapshotTest-212894485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:39:42 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ddeaa1a2-03ab-4ba7-9ad6-e3b64208aa97 tempest-CreateVolumesFromSnapshotTest-212894485 None] Flow 'volume_create_manager' (1390334d-2c15-4d93-ae2d-0039be56ad8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:39:42 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ddeaa1a2-03ab-4ba7-9ad6-e3b64208aa97 tempest-CreateVolumesFromSnapshotTest-212894485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0de4753f-d030-44e9-9f12-5a33ac13902b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:39:42 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ddeaa1a2-03ab-4ba7-9ad6-e3b64208aa97 tempest-CreateVolumesFromSnapshotTest-212894485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0de4753f-d030-44e9-9f12-5a33ac13902b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:39:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-551222081',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58a7f7fe-03a6-4e3a-b5de-b70e2e96d7ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='607c03e856984681b9ee383fbb094fa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:39:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:39:42Z,use_quota=True,user_id='7f38dc0d335f45468f24538abb1c271c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:39:42 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ddeaa1a2-03ab-4ba7-9ad6-e3b64208aa97 tempest-CreateVolumesFromSnapshotTest-212894485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3fdadcb-b021-4985-b194-a8cbc5d4e15f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:39:42 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ddeaa1a2-03ab-4ba7-9ad6-e3b64208aa97 tempest-CreateVolumesFromSnapshotTest-212894485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3fdadcb-b021-4985-b194-a8cbc5d4e15f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:39:42 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ddeaa1a2-03ab-4ba7-9ad6-e3b64208aa97 tempest-CreateVolumesFromSnapshotTest-212894485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50baa20c-8018-4550-8b57-27469ae4e813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:39:42 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ddeaa1a2-03ab-4ba7-9ad6-e3b64208aa97 tempest-CreateVolumesFromSnapshotTest-212894485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50baa20c-8018-4550-8b57-27469ae4e813) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58a7f7fe-03a6-4e3a-b5de-b70e2e96d7ea', 'volume_name': 'volume-58a7f7fe-03a6-4e3a-b5de-b70e2e96d7ea', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:39:42 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ddeaa1a2-03ab-4ba7-9ad6-e3b64208aa97 tempest-CreateVolumesFromSnapshotTest-212894485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c804dcaa-a4db-4db9-9031-44559191689f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:39:42 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ddeaa1a2-03ab-4ba7-9ad6-e3b64208aa97 tempest-CreateVolumesFromSnapshotTest-212894485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c804dcaa-a4db-4db9-9031-44559191689f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:39:42 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ddeaa1a2-03ab-4ba7-9ad6-e3b64208aa97 tempest-CreateVolumesFromSnapshotTest-212894485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e43f3f9-bec6-4825-a389-d5b3e7ea870d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:39:42 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-ddeaa1a2-03ab-4ba7-9ad6-e3b64208aa97 tempest-CreateVolumesFromSnapshotTest-212894485 None] Volume 58a7f7fe-03a6-4e3a-b5de-b70e2e96d7ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58a7f7fe-03a6-4e3a-b5de-b70e2e96d7ea', 'volume_size': 1}
Jul 14 16:39:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ddeaa1a2-03ab-4ba7-9ad6-e3b64208aa97 tempest-CreateVolumesFromSnapshotTest-212894485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:39:42 devstack sudo[103917]: pam_unix(sudo:session): session closed for user root
Jul 14 16:39:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-11101042-f5a4-4e86-8530-3248de72ba87 tempest-CreateVolumesFromSnapshotTest-212894485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fd9f63bd-89c1-4af3-84cd-6a0020b453e3" returned: 0 in 0.299s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:39:42 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-11101042-f5a4-4e86-8530-3248de72ba87 tempest-CreateVolumesFromSnapshotTest-212894485 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:39:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-11101042-f5a4-4e86-8530-3248de72ba87 tempest-CreateVolumesFromSnapshotTest-212894485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:39:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-79ac795d-e90f-4e77-bda6-9522be21d84b tempest-CreateVolumesFromSnapshotTest-212894485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.483s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:39:42 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-79ac795d-e90f-4e77-bda6-9522be21d84b tempest-CreateVolumesFromSnapshotTest-212894485 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:39:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-428353221',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=effc39aa-a6bf-42cd-8786-995b29d4bb0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='607c03e856984681b9ee383fbb094fa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:39:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:39:42Z,use_quota=True,user_id='7f38dc0d335f45468f24538abb1c271c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:39:42 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-79ac795d-e90f-4e77-bda6-9522be21d84b tempest-CreateVolumesFromSnapshotTest-212894485 None] Creating volume effc39aa-a6bf-42cd-8786-995b29d4bb0e {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:39:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-79ac795d-e90f-4e77-bda6-9522be21d84b tempest-CreateVolumesFromSnapshotTest-212894485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:39:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-79ac795d-e90f-4e77-bda6-9522be21d84b tempest-CreateVolumesFromSnapshotTest-212894485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:39:42 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-79ac795d-e90f-4e77-bda6-9522be21d84b tempest-CreateVolumesFromSnapshotTest-212894485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:39:42 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-79ac795d-e90f-4e77-bda6-9522be21d84b tempest-CreateVolumesFromSnapshotTest-212894485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:39:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-79ac795d-e90f-4e77-bda6-9522be21d84b tempest-CreateVolumesFromSnapshotTest-212894485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:39:42 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-79ac795d-e90f-4e77-bda6-9522be21d84b tempest-CreateVolumesFromSnapshotTest-212894485 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:39:42 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-79ac795d-e90f-4e77-bda6-9522be21d84b tempest-CreateVolumesFromSnapshotTest-212894485 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:39:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-79ac795d-e90f-4e77-bda6-9522be21d84b tempest-CreateVolumesFromSnapshotTest-212894485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-effc39aa-a6bf-42cd-8786-995b29d4bb0e 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:39:42 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-11101042-f5a4-4e86-8530-3248de72ba87 tempest-CreateVolumesFromSnapshotTest-212894485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cda38655-185a-4902-ba56-a005ad21f55e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd9f63bd-89c1-4af3-84cd-6a0020b453e3', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:39:42 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-11101042-f5a4-4e86-8530-3248de72ba87 tempest-CreateVolumesFromSnapshotTest-212894485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abaaae9a-95c8-4341-8bf8-d93a65f3b0a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:39:42 devstack sudo[103920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-effc39aa-a6bf-42cd-8786-995b29d4bb0e 1073741824
Jul 14 16:39:42 devstack sudo[103920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:39:42 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-11101042-f5a4-4e86-8530-3248de72ba87 tempest-CreateVolumesFromSnapshotTest-212894485 None] Volume volume-fd9f63bd-89c1-4af3-84cd-6a0020b453e3 (fd9f63bd-89c1-4af3-84cd-6a0020b453e3): created successfully
Jul 14 16:39:42 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-11101042-f5a4-4e86-8530-3248de72ba87 tempest-CreateVolumesFromSnapshotTest-212894485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abaaae9a-95c8-4341-8bf8-d93a65f3b0a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:39:42 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-11101042-f5a4-4e86-8530-3248de72ba87 tempest-CreateVolumesFromSnapshotTest-212894485 None] Flow 'volume_create_manager' (137c35fd-2c69-49cf-b22e-7b048b4b6b02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:39:42 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-11101042-f5a4-4e86-8530-3248de72ba87 tempest-CreateVolumesFromSnapshotTest-212894485 None] Created volume successfully.
Jul 14 16:39:42 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0e0a5a7-7966-4060-b8cb-07f7ac1a5ccc tempest-CreateVolumesFromSnapshotTest-212894485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:39:42 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a0e0a5a7-7966-4060-b8cb-07f7ac1a5ccc tempest-CreateVolumesFromSnapshotTest-212894485 None] Flow 'volume_create_manager' (a257555d-ac70-4599-bf70-f93ff6153f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:39:42 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a0e0a5a7-7966-4060-b8cb-07f7ac1a5ccc tempest-CreateVolumesFromSnapshotTest-212894485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61f24a3a-33c2-4a69-9e9e-88d17a878065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:39:42 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a0e0a5a7-7966-4060-b8cb-07f7ac1a5ccc tempest-CreateVolumesFromSnapshotTest-212894485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61f24a3a-33c2-4a69-9e9e-88d17a878065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:39:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1458460633',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d487fd3-96e3-456b-90d1-b608cd33e0b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='607c03e856984681b9ee383fbb094fa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:39:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:39:42Z,use_quota=True,user_id='7f38dc0d335f45468f24538abb1c271c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:39:42 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a0e0a5a7-7966-4060-b8cb-07f7ac1a5ccc tempest-CreateVolumesFromSnapshotTest-212894485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b228918-04b0-45de-ac0f-7742db8eef4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:39:42 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a0e0a5a7-7966-4060-b8cb-07f7ac1a5ccc tempest-CreateVolumesFromSnapshotTest-212894485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b228918-04b0-45de-ac0f-7742db8eef4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:39:42 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a0e0a5a7-7966-4060-b8cb-07f7ac1a5ccc tempest-CreateVolumesFromSnapshotTest-212894485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c4eeb1d-5849-4d36-ab7e-8c1b03232bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:39:42 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a0e0a5a7-7966-4060-b8cb-07f7ac1a5ccc tempest-CreateVolumesFromSnapshotTest-212894485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c4eeb1d-5849-4d36-ab7e-8c1b03232bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d487fd3-96e3-456b-90d1-b608cd33e0b2', 'volume_name': 'volume-8d487fd3-96e3-456b-90d1-b608cd33e0b2', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:39:42 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a0e0a5a7-7966-4060-b8cb-07f7ac1a5ccc tempest-CreateVolumesFromSnapshotTest-212894485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39aac7c7-c098-4f80-8b59-8ea285680938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:39:42 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a0e0a5a7-7966-4060-b8cb-07f7ac1a5ccc tempest-CreateVolumesFromSnapshotTest-212894485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39aac7c7-c098-4f80-8b59-8ea285680938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:39:42 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a0e0a5a7-7966-4060-b8cb-07f7ac1a5ccc tempest-CreateVolumesFromSnapshotTest-212894485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49779cad-f0b1-4495-95b2-5723d8b304ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:39:42 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-a0e0a5a7-7966-4060-b8cb-07f7ac1a5ccc tempest-CreateVolumesFromSnapshotTest-212894485 None] Volume 8d487fd3-96e3-456b-90d1-b608cd33e0b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d487fd3-96e3-456b-90d1-b608cd33e0b2', 'volume_size': 1}
Jul 14 16:39:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a0e0a5a7-7966-4060-b8cb-07f7ac1a5ccc tempest-CreateVolumesFromSnapshotTest-212894485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:39:42 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-17bfa5ab-aab0-419c-9951-fda1d1780764 tempest-CreateVolumesFromSnapshotTest-212894485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:39:42 devstack sudo[103920]: pam_unix(sudo:session): session closed for user root
Jul 14 16:39:42 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-17bfa5ab-aab0-419c-9951-fda1d1780764 tempest-CreateVolumesFromSnapshotTest-212894485 None] Flow 'volume_create_manager' (4bbd763f-2bb3-4d3f-afd2-79fd26ff00e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:39:42 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-17bfa5ab-aab0-419c-9951-fda1d1780764 tempest-CreateVolumesFromSnapshotTest-212894485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ebe21ce-ddab-47d8-9d45-12376235dcc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:39:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-79ac795d-e90f-4e77-bda6-9522be21d84b tempest-CreateVolumesFromSnapshotTest-212894485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-effc39aa-a6bf-42cd-8786-995b29d4bb0e 1073741824" returned: 0 in 0.531s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:39:42 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-17bfa5ab-aab0-419c-9951-fda1d1780764 tempest-CreateVolumesFromSnapshotTest-212894485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ebe21ce-ddab-47d8-9d45-12376235dcc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:39:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-301542898',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92af5fdc-56ad-4018-b415-1cd67a14ee6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='607c03e856984681b9ee383fbb094fa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:39:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:39:43Z,use_quota=True,user_id='7f38dc0d335f45468f24538abb1c271c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:39:42 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-17bfa5ab-aab0-419c-9951-fda1d1780764 tempest-CreateVolumesFromSnapshotTest-212894485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c3221f6-2b32-4a78-95e3-4e4c663a4755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:39:42 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-17bfa5ab-aab0-419c-9951-fda1d1780764 tempest-CreateVolumesFromSnapshotTest-212894485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c3221f6-2b32-4a78-95e3-4e4c663a4755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:39:42 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-17bfa5ab-aab0-419c-9951-fda1d1780764 tempest-CreateVolumesFromSnapshotTest-212894485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f7cc3b5-e54f-45fc-bbfb-405262a3144f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:39:42 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-17bfa5ab-aab0-419c-9951-fda1d1780764 tempest-CreateVolumesFromSnapshotTest-212894485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f7cc3b5-e54f-45fc-bbfb-405262a3144f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92af5fdc-56ad-4018-b415-1cd67a14ee6d', 'volume_name': 'volume-92af5fdc-56ad-4018-b415-1cd67a14ee6d', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:39:42 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-17bfa5ab-aab0-419c-9951-fda1d1780764 tempest-CreateVolumesFromSnapshotTest-212894485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41e089fa-b515-4b26-a6a1-567f07707a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:39:42 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-17bfa5ab-aab0-419c-9951-fda1d1780764 tempest-CreateVolumesFromSnapshotTest-212894485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41e089fa-b515-4b26-a6a1-567f07707a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:39:42 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-17bfa5ab-aab0-419c-9951-fda1d1780764 tempest-CreateVolumesFromSnapshotTest-212894485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8808c18-67d6-43a2-941f-3f25e59444f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:39:42 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-17bfa5ab-aab0-419c-9951-fda1d1780764 tempest-CreateVolumesFromSnapshotTest-212894485 None] Volume 92af5fdc-56ad-4018-b415-1cd67a14ee6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92af5fdc-56ad-4018-b415-1cd67a14ee6d', 'volume_size': 1}
Jul 14 16:39:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-17bfa5ab-aab0-419c-9951-fda1d1780764 tempest-CreateVolumesFromSnapshotTest-212894485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:39:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-79ac795d-e90f-4e77-bda6-9522be21d84b tempest-CreateVolumesFromSnapshotTest-212894485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-effc39aa-a6bf-42cd-8786-995b29d4bb0e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:39:42 devstack sudo[103926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-effc39aa-a6bf-42cd-8786-995b29d4bb0e
Jul 14 16:39:42 devstack sudo[103926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:39:43 devstack sudo[103926]: pam_unix(sudo:session): session closed for user root
Jul 14 16:39:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-79ac795d-e90f-4e77-bda6-9522be21d84b tempest-CreateVolumesFromSnapshotTest-212894485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-effc39aa-a6bf-42cd-8786-995b29d4bb0e" returned: 0 in 0.256s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:39:43 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-79ac795d-e90f-4e77-bda6-9522be21d84b tempest-CreateVolumesFromSnapshotTest-212894485 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:39:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-79ac795d-e90f-4e77-bda6-9522be21d84b tempest-CreateVolumesFromSnapshotTest-212894485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:39:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ddeaa1a2-03ab-4ba7-9ad6-e3b64208aa97 tempest-CreateVolumesFromSnapshotTest-212894485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:39:43 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ddeaa1a2-03ab-4ba7-9ad6-e3b64208aa97 tempest-CreateVolumesFromSnapshotTest-212894485 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:39:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-551222081',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58a7f7fe-03a6-4e3a-b5de-b70e2e96d7ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='607c03e856984681b9ee383fbb094fa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:39:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:39:42Z,use_quota=True,user_id='7f38dc0d335f45468f24538abb1c271c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:39:43 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-ddeaa1a2-03ab-4ba7-9ad6-e3b64208aa97 tempest-CreateVolumesFromSnapshotTest-212894485 None] Creating volume 58a7f7fe-03a6-4e3a-b5de-b70e2e96d7ea {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:39:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ddeaa1a2-03ab-4ba7-9ad6-e3b64208aa97 tempest-CreateVolumesFromSnapshotTest-212894485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:39:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ddeaa1a2-03ab-4ba7-9ad6-e3b64208aa97 tempest-CreateVolumesFromSnapshotTest-212894485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:39:43 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ddeaa1a2-03ab-4ba7-9ad6-e3b64208aa97 tempest-CreateVolumesFromSnapshotTest-212894485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:39:43 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ddeaa1a2-03ab-4ba7-9ad6-e3b64208aa97 tempest-CreateVolumesFromSnapshotTest-212894485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:39:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ddeaa1a2-03ab-4ba7-9ad6-e3b64208aa97 tempest-CreateVolumesFromSnapshotTest-212894485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:39:43 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ddeaa1a2-03ab-4ba7-9ad6-e3b64208aa97 tempest-CreateVolumesFromSnapshotTest-212894485 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:39:43 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-ddeaa1a2-03ab-4ba7-9ad6-e3b64208aa97 tempest-CreateVolumesFromSnapshotTest-212894485 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:39:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ddeaa1a2-03ab-4ba7-9ad6-e3b64208aa97 tempest-CreateVolumesFromSnapshotTest-212894485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-58a7f7fe-03a6-4e3a-b5de-b70e2e96d7ea 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:39:43 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-79ac795d-e90f-4e77-bda6-9522be21d84b tempest-CreateVolumesFromSnapshotTest-212894485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79bd2ae1-ae8a-4b0c-b12a-147b0c1731ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-effc39aa-a6bf-42cd-8786-995b29d4bb0e', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:39:43 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-79ac795d-e90f-4e77-bda6-9522be21d84b tempest-CreateVolumesFromSnapshotTest-212894485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (405db656-80eb-4d91-8fdd-cf70e995b275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:39:43 devstack sudo[103929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-58a7f7fe-03a6-4e3a-b5de-b70e2e96d7ea 1073741824
Jul 14 16:39:43 devstack sudo[103929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:39:43 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-79ac795d-e90f-4e77-bda6-9522be21d84b tempest-CreateVolumesFromSnapshotTest-212894485 None] Volume volume-effc39aa-a6bf-42cd-8786-995b29d4bb0e (effc39aa-a6bf-42cd-8786-995b29d4bb0e): created successfully
Jul 14 16:39:43 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-79ac795d-e90f-4e77-bda6-9522be21d84b tempest-CreateVolumesFromSnapshotTest-212894485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (405db656-80eb-4d91-8fdd-cf70e995b275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:39:43 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-79ac795d-e90f-4e77-bda6-9522be21d84b tempest-CreateVolumesFromSnapshotTest-212894485 None] Flow 'volume_create_manager' (8b562857-6e33-40d4-b0d3-5f020949000f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:39:43 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-79ac795d-e90f-4e77-bda6-9522be21d84b tempest-CreateVolumesFromSnapshotTest-212894485 None] Created volume successfully.
Jul 14 16:39:43 devstack sudo[103929]: pam_unix(sudo:session): session closed for user root
Jul 14 16:39:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ddeaa1a2-03ab-4ba7-9ad6-e3b64208aa97 tempest-CreateVolumesFromSnapshotTest-212894485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-58a7f7fe-03a6-4e3a-b5de-b70e2e96d7ea 1073741824" returned: 0 in 0.431s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:39:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ddeaa1a2-03ab-4ba7-9ad6-e3b64208aa97 tempest-CreateVolumesFromSnapshotTest-212894485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-58a7f7fe-03a6-4e3a-b5de-b70e2e96d7ea {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:39:43 devstack sudo[103935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-58a7f7fe-03a6-4e3a-b5de-b70e2e96d7ea
Jul 14 16:39:43 devstack sudo[103935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:39:43 devstack sudo[103935]: pam_unix(sudo:session): session closed for user root
Jul 14 16:39:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ddeaa1a2-03ab-4ba7-9ad6-e3b64208aa97 tempest-CreateVolumesFromSnapshotTest-212894485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-58a7f7fe-03a6-4e3a-b5de-b70e2e96d7ea" returned: 0 in 0.249s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:39:43 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ddeaa1a2-03ab-4ba7-9ad6-e3b64208aa97 tempest-CreateVolumesFromSnapshotTest-212894485 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:39:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ddeaa1a2-03ab-4ba7-9ad6-e3b64208aa97 tempest-CreateVolumesFromSnapshotTest-212894485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:39:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a0e0a5a7-7966-4060-b8cb-07f7ac1a5ccc tempest-CreateVolumesFromSnapshotTest-212894485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.361s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:39:43 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a0e0a5a7-7966-4060-b8cb-07f7ac1a5ccc tempest-CreateVolumesFromSnapshotTest-212894485 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:39:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1458460633',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d487fd3-96e3-456b-90d1-b608cd33e0b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='607c03e856984681b9ee383fbb094fa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:39:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:39:42Z,use_quota=True,user_id='7f38dc0d335f45468f24538abb1c271c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:39:43 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-a0e0a5a7-7966-4060-b8cb-07f7ac1a5ccc tempest-CreateVolumesFromSnapshotTest-212894485 None] Creating volume 8d487fd3-96e3-456b-90d1-b608cd33e0b2 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:39:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a0e0a5a7-7966-4060-b8cb-07f7ac1a5ccc tempest-CreateVolumesFromSnapshotTest-212894485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:39:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a0e0a5a7-7966-4060-b8cb-07f7ac1a5ccc tempest-CreateVolumesFromSnapshotTest-212894485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:39:43 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a0e0a5a7-7966-4060-b8cb-07f7ac1a5ccc tempest-CreateVolumesFromSnapshotTest-212894485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:39:43 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a0e0a5a7-7966-4060-b8cb-07f7ac1a5ccc tempest-CreateVolumesFromSnapshotTest-212894485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:39:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a0e0a5a7-7966-4060-b8cb-07f7ac1a5ccc tempest-CreateVolumesFromSnapshotTest-212894485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:39:43 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a0e0a5a7-7966-4060-b8cb-07f7ac1a5ccc tempest-CreateVolumesFromSnapshotTest-212894485 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:39:43 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-a0e0a5a7-7966-4060-b8cb-07f7ac1a5ccc tempest-CreateVolumesFromSnapshotTest-212894485 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:39:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a0e0a5a7-7966-4060-b8cb-07f7ac1a5ccc tempest-CreateVolumesFromSnapshotTest-212894485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8d487fd3-96e3-456b-90d1-b608cd33e0b2 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:39:43 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ddeaa1a2-03ab-4ba7-9ad6-e3b64208aa97 tempest-CreateVolumesFromSnapshotTest-212894485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e43f3f9-bec6-4825-a389-d5b3e7ea870d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58a7f7fe-03a6-4e3a-b5de-b70e2e96d7ea', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:39:43 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ddeaa1a2-03ab-4ba7-9ad6-e3b64208aa97 tempest-CreateVolumesFromSnapshotTest-212894485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f14658c5-766d-4ef3-b588-0435a60d0c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:39:43 devstack sudo[103938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8d487fd3-96e3-456b-90d1-b608cd33e0b2 1073741824
Jul 14 16:39:43 devstack sudo[103938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:39:43 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-ddeaa1a2-03ab-4ba7-9ad6-e3b64208aa97 tempest-CreateVolumesFromSnapshotTest-212894485 None] Volume volume-58a7f7fe-03a6-4e3a-b5de-b70e2e96d7ea (58a7f7fe-03a6-4e3a-b5de-b70e2e96d7ea): created successfully
Jul 14 16:39:43 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ddeaa1a2-03ab-4ba7-9ad6-e3b64208aa97 tempest-CreateVolumesFromSnapshotTest-212894485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f14658c5-766d-4ef3-b588-0435a60d0c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:39:43 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ddeaa1a2-03ab-4ba7-9ad6-e3b64208aa97 tempest-CreateVolumesFromSnapshotTest-212894485 None] Flow 'volume_create_manager' (1390334d-2c15-4d93-ae2d-0039be56ad8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:39:43 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-ddeaa1a2-03ab-4ba7-9ad6-e3b64208aa97 tempest-CreateVolumesFromSnapshotTest-212894485 None] Created volume successfully.
Jul 14 16:39:44 devstack sudo[103938]: pam_unix(sudo:session): session closed for user root
Jul 14 16:39:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a0e0a5a7-7966-4060-b8cb-07f7ac1a5ccc tempest-CreateVolumesFromSnapshotTest-212894485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8d487fd3-96e3-456b-90d1-b608cd33e0b2 1073741824" returned: 0 in 0.406s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:39:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a0e0a5a7-7966-4060-b8cb-07f7ac1a5ccc tempest-CreateVolumesFromSnapshotTest-212894485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8d487fd3-96e3-456b-90d1-b608cd33e0b2 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:39:44 devstack sudo[103944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8d487fd3-96e3-456b-90d1-b608cd33e0b2
Jul 14 16:39:44 devstack sudo[103944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:39:44 devstack sudo[103944]: pam_unix(sudo:session): session closed for user root
Jul 14 16:39:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a0e0a5a7-7966-4060-b8cb-07f7ac1a5ccc tempest-CreateVolumesFromSnapshotTest-212894485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8d487fd3-96e3-456b-90d1-b608cd33e0b2" returned: 0 in 0.246s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:39:44 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a0e0a5a7-7966-4060-b8cb-07f7ac1a5ccc tempest-CreateVolumesFromSnapshotTest-212894485 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:39:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a0e0a5a7-7966-4060-b8cb-07f7ac1a5ccc tempest-CreateVolumesFromSnapshotTest-212894485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:39:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-17bfa5ab-aab0-419c-9951-fda1d1780764 tempest-CreateVolumesFromSnapshotTest-212894485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.715s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:39:44 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-17bfa5ab-aab0-419c-9951-fda1d1780764 tempest-CreateVolumesFromSnapshotTest-212894485 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:39:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-301542898',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92af5fdc-56ad-4018-b415-1cd67a14ee6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='607c03e856984681b9ee383fbb094fa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:39:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:39:43Z,use_quota=True,user_id='7f38dc0d335f45468f24538abb1c271c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:39:44 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-17bfa5ab-aab0-419c-9951-fda1d1780764 tempest-CreateVolumesFromSnapshotTest-212894485 None] Creating volume 92af5fdc-56ad-4018-b415-1cd67a14ee6d {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:39:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-17bfa5ab-aab0-419c-9951-fda1d1780764 tempest-CreateVolumesFromSnapshotTest-212894485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:39:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-17bfa5ab-aab0-419c-9951-fda1d1780764 tempest-CreateVolumesFromSnapshotTest-212894485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:39:44 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-17bfa5ab-aab0-419c-9951-fda1d1780764 tempest-CreateVolumesFromSnapshotTest-212894485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:39:44 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-17bfa5ab-aab0-419c-9951-fda1d1780764 tempest-CreateVolumesFromSnapshotTest-212894485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:39:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-17bfa5ab-aab0-419c-9951-fda1d1780764 tempest-CreateVolumesFromSnapshotTest-212894485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:39:44 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-17bfa5ab-aab0-419c-9951-fda1d1780764 tempest-CreateVolumesFromSnapshotTest-212894485 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:39:44 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-17bfa5ab-aab0-419c-9951-fda1d1780764 tempest-CreateVolumesFromSnapshotTest-212894485 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:39:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-17bfa5ab-aab0-419c-9951-fda1d1780764 tempest-CreateVolumesFromSnapshotTest-212894485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-92af5fdc-56ad-4018-b415-1cd67a14ee6d 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:39:44 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a0e0a5a7-7966-4060-b8cb-07f7ac1a5ccc tempest-CreateVolumesFromSnapshotTest-212894485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49779cad-f0b1-4495-95b2-5723d8b304ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d487fd3-96e3-456b-90d1-b608cd33e0b2', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:39:44 devstack sudo[103947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-92af5fdc-56ad-4018-b415-1cd67a14ee6d 1073741824
Jul 14 16:39:44 devstack sudo[103947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:39:44 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a0e0a5a7-7966-4060-b8cb-07f7ac1a5ccc tempest-CreateVolumesFromSnapshotTest-212894485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3b8c69e-d2cc-45a7-bbb6-14cfdf5de90d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:39:44 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-a0e0a5a7-7966-4060-b8cb-07f7ac1a5ccc tempest-CreateVolumesFromSnapshotTest-212894485 None] Volume volume-8d487fd3-96e3-456b-90d1-b608cd33e0b2 (8d487fd3-96e3-456b-90d1-b608cd33e0b2): created successfully
Jul 14 16:39:44 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a0e0a5a7-7966-4060-b8cb-07f7ac1a5ccc tempest-CreateVolumesFromSnapshotTest-212894485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3b8c69e-d2cc-45a7-bbb6-14cfdf5de90d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:39:44 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a0e0a5a7-7966-4060-b8cb-07f7ac1a5ccc tempest-CreateVolumesFromSnapshotTest-212894485 None] Flow 'volume_create_manager' (a257555d-ac70-4599-bf70-f93ff6153f5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:39:44 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-a0e0a5a7-7966-4060-b8cb-07f7ac1a5ccc tempest-CreateVolumesFromSnapshotTest-212894485 None] Created volume successfully.
Jul 14 16:39:45 devstack sudo[103947]: pam_unix(sudo:session): session closed for user root
Jul 14 16:39:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-17bfa5ab-aab0-419c-9951-fda1d1780764 tempest-CreateVolumesFromSnapshotTest-212894485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-92af5fdc-56ad-4018-b415-1cd67a14ee6d 1073741824" returned: 0 in 0.435s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:39:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-17bfa5ab-aab0-419c-9951-fda1d1780764 tempest-CreateVolumesFromSnapshotTest-212894485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-92af5fdc-56ad-4018-b415-1cd67a14ee6d {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:39:45 devstack sudo[103953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-92af5fdc-56ad-4018-b415-1cd67a14ee6d
Jul 14 16:39:45 devstack sudo[103953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:39:45 devstack sudo[103953]: pam_unix(sudo:session): session closed for user root
Jul 14 16:39:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-17bfa5ab-aab0-419c-9951-fda1d1780764 tempest-CreateVolumesFromSnapshotTest-212894485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-92af5fdc-56ad-4018-b415-1cd67a14ee6d" returned: 0 in 0.241s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:39:45 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-17bfa5ab-aab0-419c-9951-fda1d1780764 tempest-CreateVolumesFromSnapshotTest-212894485 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:39:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-17bfa5ab-aab0-419c-9951-fda1d1780764 tempest-CreateVolumesFromSnapshotTest-212894485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:39:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-17bfa5ab-aab0-419c-9951-fda1d1780764 tempest-CreateVolumesFromSnapshotTest-212894485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8808c18-67d6-43a2-941f-3f25e59444f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92af5fdc-56ad-4018-b415-1cd67a14ee6d', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:39:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-17bfa5ab-aab0-419c-9951-fda1d1780764 tempest-CreateVolumesFromSnapshotTest-212894485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82e960bf-7cca-4448-b640-1ba2fb3c5490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:39:45 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-17bfa5ab-aab0-419c-9951-fda1d1780764 tempest-CreateVolumesFromSnapshotTest-212894485 None] Volume volume-92af5fdc-56ad-4018-b415-1cd67a14ee6d (92af5fdc-56ad-4018-b415-1cd67a14ee6d): created successfully
Jul 14 16:39:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-17bfa5ab-aab0-419c-9951-fda1d1780764 tempest-CreateVolumesFromSnapshotTest-212894485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82e960bf-7cca-4448-b640-1ba2fb3c5490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:39:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-17bfa5ab-aab0-419c-9951-fda1d1780764 tempest-CreateVolumesFromSnapshotTest-212894485 None] Flow 'volume_create_manager' (4bbd763f-2bb3-4d3f-afd2-79fd26ff00e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:39:45 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-17bfa5ab-aab0-419c-9951-fda1d1780764 tempest-CreateVolumesFromSnapshotTest-212894485 None] Created volume successfully.
Jul 14 16:39:46 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-42314d98-f20b-4dac-b815-5d34edb7a83c tempest-CreateVolumesFromSnapshotTest-212894485 None] Acquiring lock "cinder-92af5fdc-56ad-4018-b415-1cd67a14ee6d-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:39:46 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-42314d98-f20b-4dac-b815-5d34edb7a83c tempest-CreateVolumesFromSnapshotTest-212894485 None] Lock "cinder-92af5fdc-56ad-4018-b415-1cd67a14ee6d-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:39:46 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-42314d98-f20b-4dac-b815-5d34edb7a83c tempest-CreateVolumesFromSnapshotTest-212894485 None] Acquiring lock "cinder-quobyte-92af5fdc-56ad-4018-b415-1cd67a14ee6d" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:39:46 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-42314d98-f20b-4dac-b815-5d34edb7a83c tempest-CreateVolumesFromSnapshotTest-212894485 None] Lock "cinder-quobyte-92af5fdc-56ad-4018-b415-1cd67a14ee6d" acquired by "delete_volume" :: waited 0.015s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:39:46 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[364d1b54-48fa-4625-83da-6611ccd9ae21]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:39:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-42314d98-f20b-4dac-b815-5d34edb7a83c tempest-CreateVolumesFromSnapshotTest-212894485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-92af5fdc-56ad-4018-b415-1cd67a14ee6d {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:39:46 devstack sudo[103956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-92af5fdc-56ad-4018-b415-1cd67a14ee6d
Jul 14 16:39:46 devstack sudo[103956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:39:46 devstack sudo[103956]: pam_unix(sudo:session): session closed for user root
Jul 14 16:39:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-42314d98-f20b-4dac-b815-5d34edb7a83c tempest-CreateVolumesFromSnapshotTest-212894485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-92af5fdc-56ad-4018-b415-1cd67a14ee6d" returned: 0 in 0.344s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:39:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-42314d98-f20b-4dac-b815-5d34edb7a83c tempest-CreateVolumesFromSnapshotTest-212894485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-92af5fdc-56ad-4018-b415-1cd67a14ee6d {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:39:46 devstack sudo[103961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-92af5fdc-56ad-4018-b415-1cd67a14ee6d
Jul 14 16:39:46 devstack sudo[103961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:39:46 devstack sudo[103961]: pam_unix(sudo:session): session closed for user root
Jul 14 16:39:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-42314d98-f20b-4dac-b815-5d34edb7a83c tempest-CreateVolumesFromSnapshotTest-212894485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-92af5fdc-56ad-4018-b415-1cd67a14ee6d" returned: 0 in 0.240s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:39:46 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-42314d98-f20b-4dac-b815-5d34edb7a83c tempest-CreateVolumesFromSnapshotTest-212894485 None] Lock "cinder-quobyte-92af5fdc-56ad-4018-b415-1cd67a14ee6d" released by "delete_volume" :: held 0.619s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:39:46 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-42314d98-f20b-4dac-b815-5d34edb7a83c tempest-CreateVolumesFromSnapshotTest-212894485 None] Created reservations ['32aa38d7-c6de-4415-a3d4-60c5cf32fadf', '6e382349-a9f4-4a78-a1ae-5b9db8117d28', '53a3df24-8ad7-459e-9203-2dd8aa1cc4a5', '62de00ab-78bf-4980-be7d-03d54093b3a3'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:39:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-42314d98-f20b-4dac-b815-5d34edb7a83c tempest-CreateVolumesFromSnapshotTest-212894485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:39:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-42314d98-f20b-4dac-b815-5d34edb7a83c tempest-CreateVolumesFromSnapshotTest-212894485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:39:47 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-42314d98-f20b-4dac-b815-5d34edb7a83c tempest-CreateVolumesFromSnapshotTest-212894485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:39:47 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-42314d98-f20b-4dac-b815-5d34edb7a83c tempest-CreateVolumesFromSnapshotTest-212894485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:39:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-42314d98-f20b-4dac-b815-5d34edb7a83c tempest-CreateVolumesFromSnapshotTest-212894485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:39:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-42314d98-f20b-4dac-b815-5d34edb7a83c tempest-CreateVolumesFromSnapshotTest-212894485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:39:47 devstack sudo[103964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:39:47 devstack sudo[103964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:39:47 devstack sudo[103964]: pam_unix(sudo:session): session closed for user root
Jul 14 16:39:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-42314d98-f20b-4dac-b815-5d34edb7a83c tempest-CreateVolumesFromSnapshotTest-212894485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.237s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:39:47 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-42314d98-f20b-4dac-b815-5d34edb7a83c tempest-CreateVolumesFromSnapshotTest-212894485 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:39:47 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-42314d98-f20b-4dac-b815-5d34edb7a83c tempest-CreateVolumesFromSnapshotTest-212894485 None] Deleted volume successfully.
Jul 14 16:39:47 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-42314d98-f20b-4dac-b815-5d34edb7a83c tempest-CreateVolumesFromSnapshotTest-212894485 None] Lock "cinder-92af5fdc-56ad-4018-b415-1cd67a14ee6d-delete_volume" released by "delete_volume" :: held 1.041s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:39:47 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-151ef77d-20ce-42aa-8ec6-d3412732f529 tempest-CreateVolumesFromSnapshotTest-212894485 None] Acquiring lock "cinder-8d487fd3-96e3-456b-90d1-b608cd33e0b2-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:39:47 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-151ef77d-20ce-42aa-8ec6-d3412732f529 tempest-CreateVolumesFromSnapshotTest-212894485 None] Lock "cinder-8d487fd3-96e3-456b-90d1-b608cd33e0b2-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:39:47 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-151ef77d-20ce-42aa-8ec6-d3412732f529 tempest-CreateVolumesFromSnapshotTest-212894485 None] Acquiring lock "cinder-quobyte-8d487fd3-96e3-456b-90d1-b608cd33e0b2" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:39:47 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-151ef77d-20ce-42aa-8ec6-d3412732f529 tempest-CreateVolumesFromSnapshotTest-212894485 None] Lock "cinder-quobyte-8d487fd3-96e3-456b-90d1-b608cd33e0b2" acquired by "delete_volume" :: waited 0.013s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:39:47 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[0908c452-4db2-46ad-9189-5f6cb812e72b]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:39:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-151ef77d-20ce-42aa-8ec6-d3412732f529 tempest-CreateVolumesFromSnapshotTest-212894485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8d487fd3-96e3-456b-90d1-b608cd33e0b2 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:39:47 devstack sudo[103967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8d487fd3-96e3-456b-90d1-b608cd33e0b2
Jul 14 16:39:47 devstack sudo[103967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:39:47 devstack sudo[103967]: pam_unix(sudo:session): session closed for user root
Jul 14 16:39:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-151ef77d-20ce-42aa-8ec6-d3412732f529 tempest-CreateVolumesFromSnapshotTest-212894485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8d487fd3-96e3-456b-90d1-b608cd33e0b2" returned: 0 in 0.350s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:39:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-151ef77d-20ce-42aa-8ec6-d3412732f529 tempest-CreateVolumesFromSnapshotTest-212894485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8d487fd3-96e3-456b-90d1-b608cd33e0b2 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:39:47 devstack sudo[103972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8d487fd3-96e3-456b-90d1-b608cd33e0b2
Jul 14 16:39:47 devstack sudo[103972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:39:48 devstack sudo[103972]: pam_unix(sudo:session): session closed for user root
Jul 14 16:39:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-151ef77d-20ce-42aa-8ec6-d3412732f529 tempest-CreateVolumesFromSnapshotTest-212894485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8d487fd3-96e3-456b-90d1-b608cd33e0b2" returned: 0 in 0.248s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:39:48 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-151ef77d-20ce-42aa-8ec6-d3412732f529 tempest-CreateVolumesFromSnapshotTest-212894485 None] Lock "cinder-quobyte-8d487fd3-96e3-456b-90d1-b608cd33e0b2" released by "delete_volume" :: held 0.638s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:39:48 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-151ef77d-20ce-42aa-8ec6-d3412732f529 tempest-CreateVolumesFromSnapshotTest-212894485 None] Created reservations ['5dd119d4-a973-4753-a80a-8b4107623294', '7ce5ef86-e5fc-4206-a291-49b62132d6a0', '1fbede9b-2e53-4a44-bc77-e51523f0f83c', '1c55558b-37b8-4db9-aed0-5d9d641fa82c'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:39:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-151ef77d-20ce-42aa-8ec6-d3412732f529 tempest-CreateVolumesFromSnapshotTest-212894485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:39:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-151ef77d-20ce-42aa-8ec6-d3412732f529 tempest-CreateVolumesFromSnapshotTest-212894485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:39:48 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-151ef77d-20ce-42aa-8ec6-d3412732f529 tempest-CreateVolumesFromSnapshotTest-212894485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:39:48 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-151ef77d-20ce-42aa-8ec6-d3412732f529 tempest-CreateVolumesFromSnapshotTest-212894485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:39:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-151ef77d-20ce-42aa-8ec6-d3412732f529 tempest-CreateVolumesFromSnapshotTest-212894485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:39:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-151ef77d-20ce-42aa-8ec6-d3412732f529 tempest-CreateVolumesFromSnapshotTest-212894485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:39:48 devstack sudo[103975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:39:48 devstack sudo[103975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:39:48 devstack sudo[103975]: pam_unix(sudo:session): session closed for user root
Jul 14 16:39:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-151ef77d-20ce-42aa-8ec6-d3412732f529 tempest-CreateVolumesFromSnapshotTest-212894485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.236s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:39:48 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-151ef77d-20ce-42aa-8ec6-d3412732f529 tempest-CreateVolumesFromSnapshotTest-212894485 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:39:48 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-151ef77d-20ce-42aa-8ec6-d3412732f529 tempest-CreateVolumesFromSnapshotTest-212894485 None] Deleted volume successfully.
Jul 14 16:39:48 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-151ef77d-20ce-42aa-8ec6-d3412732f529 tempest-CreateVolumesFromSnapshotTest-212894485 None] Lock "cinder-8d487fd3-96e3-456b-90d1-b608cd33e0b2-delete_volume" released by "delete_volume" :: held 1.049s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:39:48 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-cd2901f5-ddf6-49be-a9f5-133eacc1bfcf tempest-CreateVolumesFromSnapshotTest-212894485 None] Acquiring lock "cinder-58a7f7fe-03a6-4e3a-b5de-b70e2e96d7ea-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:39:48 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-cd2901f5-ddf6-49be-a9f5-133eacc1bfcf tempest-CreateVolumesFromSnapshotTest-212894485 None] Lock "cinder-58a7f7fe-03a6-4e3a-b5de-b70e2e96d7ea-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:39:48 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-cd2901f5-ddf6-49be-a9f5-133eacc1bfcf tempest-CreateVolumesFromSnapshotTest-212894485 None] Acquiring lock "cinder-quobyte-58a7f7fe-03a6-4e3a-b5de-b70e2e96d7ea" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:39:48 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-cd2901f5-ddf6-49be-a9f5-133eacc1bfcf tempest-CreateVolumesFromSnapshotTest-212894485 None] Lock "cinder-quobyte-58a7f7fe-03a6-4e3a-b5de-b70e2e96d7ea" acquired by "delete_volume" :: waited 0.015s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:39:48 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[acbba884-8390-419c-9f3b-713e666d0f62]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:39:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cd2901f5-ddf6-49be-a9f5-133eacc1bfcf tempest-CreateVolumesFromSnapshotTest-212894485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-58a7f7fe-03a6-4e3a-b5de-b70e2e96d7ea {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:39:48 devstack sudo[103978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-58a7f7fe-03a6-4e3a-b5de-b70e2e96d7ea
Jul 14 16:39:48 devstack sudo[103978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:39:48 devstack sudo[103978]: pam_unix(sudo:session): session closed for user root
Jul 14 16:39:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cd2901f5-ddf6-49be-a9f5-133eacc1bfcf tempest-CreateVolumesFromSnapshotTest-212894485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-58a7f7fe-03a6-4e3a-b5de-b70e2e96d7ea" returned: 0 in 0.352s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:39:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cd2901f5-ddf6-49be-a9f5-133eacc1bfcf tempest-CreateVolumesFromSnapshotTest-212894485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-58a7f7fe-03a6-4e3a-b5de-b70e2e96d7ea {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:39:49 devstack sudo[103983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-58a7f7fe-03a6-4e3a-b5de-b70e2e96d7ea
Jul 14 16:39:49 devstack sudo[103983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:39:49 devstack sudo[103983]: pam_unix(sudo:session): session closed for user root
Jul 14 16:39:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cd2901f5-ddf6-49be-a9f5-133eacc1bfcf tempest-CreateVolumesFromSnapshotTest-212894485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-58a7f7fe-03a6-4e3a-b5de-b70e2e96d7ea" returned: 0 in 0.241s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:39:49 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-cd2901f5-ddf6-49be-a9f5-133eacc1bfcf tempest-CreateVolumesFromSnapshotTest-212894485 None] Lock "cinder-quobyte-58a7f7fe-03a6-4e3a-b5de-b70e2e96d7ea" released by "delete_volume" :: held 0.630s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:39:49 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-cd2901f5-ddf6-49be-a9f5-133eacc1bfcf tempest-CreateVolumesFromSnapshotTest-212894485 None] Created reservations ['08dc765b-6380-4d01-8735-9609428afe41', '34a9556f-cef9-4961-bb11-d75ae64ba343', 'e261c2f1-96c8-460b-b355-87c477dbc680', '68d700f6-c0c2-42af-a01e-5470fc33b21a'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:39:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cd2901f5-ddf6-49be-a9f5-133eacc1bfcf tempest-CreateVolumesFromSnapshotTest-212894485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:39:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cd2901f5-ddf6-49be-a9f5-133eacc1bfcf tempest-CreateVolumesFromSnapshotTest-212894485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:39:49 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-cd2901f5-ddf6-49be-a9f5-133eacc1bfcf tempest-CreateVolumesFromSnapshotTest-212894485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:39:49 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-cd2901f5-ddf6-49be-a9f5-133eacc1bfcf tempest-CreateVolumesFromSnapshotTest-212894485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:39:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cd2901f5-ddf6-49be-a9f5-133eacc1bfcf tempest-CreateVolumesFromSnapshotTest-212894485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:39:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cd2901f5-ddf6-49be-a9f5-133eacc1bfcf tempest-CreateVolumesFromSnapshotTest-212894485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:39:49 devstack sudo[103986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:39:49 devstack sudo[103986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:39:49 devstack sudo[103986]: pam_unix(sudo:session): session closed for user root
Jul 14 16:39:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cd2901f5-ddf6-49be-a9f5-133eacc1bfcf tempest-CreateVolumesFromSnapshotTest-212894485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.239s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:39:49 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-cd2901f5-ddf6-49be-a9f5-133eacc1bfcf tempest-CreateVolumesFromSnapshotTest-212894485 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:39:49 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-cd2901f5-ddf6-49be-a9f5-133eacc1bfcf tempest-CreateVolumesFromSnapshotTest-212894485 None] Deleted volume successfully.
Jul 14 16:39:49 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-cd2901f5-ddf6-49be-a9f5-133eacc1bfcf tempest-CreateVolumesFromSnapshotTest-212894485 None] Lock "cinder-58a7f7fe-03a6-4e3a-b5de-b70e2e96d7ea-delete_volume" released by "delete_volume" :: held 1.057s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:39:49 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-84b9ef52-072d-48c2-90a6-f144754b9c5a tempest-CreateVolumesFromSnapshotTest-212894485 None] Acquiring lock "cinder-effc39aa-a6bf-42cd-8786-995b29d4bb0e-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:39:49 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-84b9ef52-072d-48c2-90a6-f144754b9c5a tempest-CreateVolumesFromSnapshotTest-212894485 None] Lock "cinder-effc39aa-a6bf-42cd-8786-995b29d4bb0e-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:39:49 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-84b9ef52-072d-48c2-90a6-f144754b9c5a tempest-CreateVolumesFromSnapshotTest-212894485 None] Acquiring lock "cinder-quobyte-effc39aa-a6bf-42cd-8786-995b29d4bb0e" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:39:49 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-84b9ef52-072d-48c2-90a6-f144754b9c5a tempest-CreateVolumesFromSnapshotTest-212894485 None] Lock "cinder-quobyte-effc39aa-a6bf-42cd-8786-995b29d4bb0e" acquired by "delete_volume" :: waited 0.013s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:39:49 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e052c25-3201-4bd4-939b-c39acca0770a]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:39:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-84b9ef52-072d-48c2-90a6-f144754b9c5a tempest-CreateVolumesFromSnapshotTest-212894485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-effc39aa-a6bf-42cd-8786-995b29d4bb0e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:39:49 devstack sudo[103990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-effc39aa-a6bf-42cd-8786-995b29d4bb0e
Jul 14 16:39:49 devstack sudo[103990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:39:50 devstack sudo[103990]: pam_unix(sudo:session): session closed for user root
Jul 14 16:39:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-84b9ef52-072d-48c2-90a6-f144754b9c5a tempest-CreateVolumesFromSnapshotTest-212894485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-effc39aa-a6bf-42cd-8786-995b29d4bb0e" returned: 0 in 0.355s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:39:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-84b9ef52-072d-48c2-90a6-f144754b9c5a tempest-CreateVolumesFromSnapshotTest-212894485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-effc39aa-a6bf-42cd-8786-995b29d4bb0e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:39:50 devstack sudo[103995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-effc39aa-a6bf-42cd-8786-995b29d4bb0e
Jul 14 16:39:50 devstack sudo[103995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:39:50 devstack sudo[103995]: pam_unix(sudo:session): session closed for user root
Jul 14 16:39:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-84b9ef52-072d-48c2-90a6-f144754b9c5a tempest-CreateVolumesFromSnapshotTest-212894485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-effc39aa-a6bf-42cd-8786-995b29d4bb0e" returned: 0 in 0.250s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:39:50 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-84b9ef52-072d-48c2-90a6-f144754b9c5a tempest-CreateVolumesFromSnapshotTest-212894485 None] Lock "cinder-quobyte-effc39aa-a6bf-42cd-8786-995b29d4bb0e" released by "delete_volume" :: held 0.639s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:39:50 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-84b9ef52-072d-48c2-90a6-f144754b9c5a tempest-CreateVolumesFromSnapshotTest-212894485 None] Created reservations ['51b8fb4a-ed02-4e53-a842-1c08e3224216', 'a61eb939-06f7-4f97-b42a-c0d2f6e3d930', '60b3f3d3-c754-4796-907b-ced6e1fe52e1', 'f5bf3a35-afc4-44a3-8cd8-1400c98e7153'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:39:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-84b9ef52-072d-48c2-90a6-f144754b9c5a tempest-CreateVolumesFromSnapshotTest-212894485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:39:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-84b9ef52-072d-48c2-90a6-f144754b9c5a tempest-CreateVolumesFromSnapshotTest-212894485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:39:50 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-84b9ef52-072d-48c2-90a6-f144754b9c5a tempest-CreateVolumesFromSnapshotTest-212894485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:39:50 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-84b9ef52-072d-48c2-90a6-f144754b9c5a tempest-CreateVolumesFromSnapshotTest-212894485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:39:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-84b9ef52-072d-48c2-90a6-f144754b9c5a tempest-CreateVolumesFromSnapshotTest-212894485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:39:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-84b9ef52-072d-48c2-90a6-f144754b9c5a tempest-CreateVolumesFromSnapshotTest-212894485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:39:50 devstack sudo[103998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:39:50 devstack sudo[103998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:39:50 devstack sudo[103998]: pam_unix(sudo:session): session closed for user root
Jul 14 16:39:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-84b9ef52-072d-48c2-90a6-f144754b9c5a tempest-CreateVolumesFromSnapshotTest-212894485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.241s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:39:50 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-84b9ef52-072d-48c2-90a6-f144754b9c5a tempest-CreateVolumesFromSnapshotTest-212894485 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:39:50 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-84b9ef52-072d-48c2-90a6-f144754b9c5a tempest-CreateVolumesFromSnapshotTest-212894485 None] Deleted volume successfully.
Jul 14 16:39:50 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-84b9ef52-072d-48c2-90a6-f144754b9c5a tempest-CreateVolumesFromSnapshotTest-212894485 None] Lock "cinder-effc39aa-a6bf-42cd-8786-995b29d4bb0e-delete_volume" released by "delete_volume" :: held 1.064s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:39:50 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-858513fe-0534-4005-a311-79dbb1d340d4 tempest-CreateVolumesFromSnapshotTest-212894485 None] Acquiring lock "cinder-fd9f63bd-89c1-4af3-84cd-6a0020b453e3-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:39:50 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-858513fe-0534-4005-a311-79dbb1d340d4 tempest-CreateVolumesFromSnapshotTest-212894485 None] Lock "cinder-fd9f63bd-89c1-4af3-84cd-6a0020b453e3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:39:50 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-858513fe-0534-4005-a311-79dbb1d340d4 tempest-CreateVolumesFromSnapshotTest-212894485 None] Acquiring lock "cinder-quobyte-fd9f63bd-89c1-4af3-84cd-6a0020b453e3" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:39:50 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-858513fe-0534-4005-a311-79dbb1d340d4 tempest-CreateVolumesFromSnapshotTest-212894485 None] Lock "cinder-quobyte-fd9f63bd-89c1-4af3-84cd-6a0020b453e3" acquired by "delete_volume" :: waited 0.013s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:39:50 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef2a676-c9c2-44da-b3b4-21fda27f126f]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:39:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-858513fe-0534-4005-a311-79dbb1d340d4 tempest-CreateVolumesFromSnapshotTest-212894485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fd9f63bd-89c1-4af3-84cd-6a0020b453e3 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:39:51 devstack sudo[104001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fd9f63bd-89c1-4af3-84cd-6a0020b453e3
Jul 14 16:39:51 devstack sudo[104001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:39:51 devstack sudo[104001]: pam_unix(sudo:session): session closed for user root
Jul 14 16:39:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-858513fe-0534-4005-a311-79dbb1d340d4 tempest-CreateVolumesFromSnapshotTest-212894485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fd9f63bd-89c1-4af3-84cd-6a0020b453e3" returned: 0 in 0.352s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:39:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-858513fe-0534-4005-a311-79dbb1d340d4 tempest-CreateVolumesFromSnapshotTest-212894485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fd9f63bd-89c1-4af3-84cd-6a0020b453e3 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:39:51 devstack sudo[104006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fd9f63bd-89c1-4af3-84cd-6a0020b453e3
Jul 14 16:39:51 devstack sudo[104006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:39:51 devstack sudo[104006]: pam_unix(sudo:session): session closed for user root
Jul 14 16:39:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-858513fe-0534-4005-a311-79dbb1d340d4 tempest-CreateVolumesFromSnapshotTest-212894485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fd9f63bd-89c1-4af3-84cd-6a0020b453e3" returned: 0 in 0.242s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:39:51 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-858513fe-0534-4005-a311-79dbb1d340d4 tempest-CreateVolumesFromSnapshotTest-212894485 None] Lock "cinder-quobyte-fd9f63bd-89c1-4af3-84cd-6a0020b453e3" released by "delete_volume" :: held 0.633s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:39:51 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-858513fe-0534-4005-a311-79dbb1d340d4 tempest-CreateVolumesFromSnapshotTest-212894485 None] Created reservations ['55a41694-e5ca-4273-86d4-53af852d3be3', '34209d2c-4c52-4250-a196-8a2799f37835', '759905cf-df5d-472a-96c9-0836fe139e32', 'bc9b094a-9f52-4773-a043-7c5cf0f9b5a1'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:39:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-858513fe-0534-4005-a311-79dbb1d340d4 tempest-CreateVolumesFromSnapshotTest-212894485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:39:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-858513fe-0534-4005-a311-79dbb1d340d4 tempest-CreateVolumesFromSnapshotTest-212894485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:39:51 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-858513fe-0534-4005-a311-79dbb1d340d4 tempest-CreateVolumesFromSnapshotTest-212894485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:39:51 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-858513fe-0534-4005-a311-79dbb1d340d4 tempest-CreateVolumesFromSnapshotTest-212894485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:39:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-858513fe-0534-4005-a311-79dbb1d340d4 tempest-CreateVolumesFromSnapshotTest-212894485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:39:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-858513fe-0534-4005-a311-79dbb1d340d4 tempest-CreateVolumesFromSnapshotTest-212894485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:39:51 devstack sudo[104009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:39:51 devstack sudo[104009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:39:51 devstack sudo[104009]: pam_unix(sudo:session): session closed for user root
Jul 14 16:39:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-858513fe-0534-4005-a311-79dbb1d340d4 tempest-CreateVolumesFromSnapshotTest-212894485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.239s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:39:51 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-858513fe-0534-4005-a311-79dbb1d340d4 tempest-CreateVolumesFromSnapshotTest-212894485 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:39:51 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-858513fe-0534-4005-a311-79dbb1d340d4 tempest-CreateVolumesFromSnapshotTest-212894485 None] Deleted volume successfully.
Jul 14 16:39:51 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-858513fe-0534-4005-a311-79dbb1d340d4 tempest-CreateVolumesFromSnapshotTest-212894485 None] Lock "cinder-fd9f63bd-89c1-4af3-84cd-6a0020b453e3-delete_volume" released by "delete_volume" :: held 1.052s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:39:52 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6ff585ef-1bb4-452a-87b0-7312c7145c9d tempest-CreateVolumesFromSnapshotTest-212894485 None] Acquiring lock "cinder-27b3224a-2b51-4ec7-a811-8055a9de806d-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:39:52 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6ff585ef-1bb4-452a-87b0-7312c7145c9d tempest-CreateVolumesFromSnapshotTest-212894485 None] Lock "cinder-27b3224a-2b51-4ec7-a811-8055a9de806d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:39:52 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6ff585ef-1bb4-452a-87b0-7312c7145c9d tempest-CreateVolumesFromSnapshotTest-212894485 None] Acquiring lock "cinder-quobyte-ab6f08f4-41bf-49ac-996b-c125e6ee91f2" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:39:52 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6ff585ef-1bb4-452a-87b0-7312c7145c9d tempest-CreateVolumesFromSnapshotTest-212894485 None] Lock "cinder-quobyte-ab6f08f4-41bf-49ac-996b-c125e6ee91f2" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:39:52 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6ff585ef-1bb4-452a-87b0-7312c7145c9d tempest-CreateVolumesFromSnapshotTest-212894485 None] Acquiring lock "cinder-quobyte-27b3224a-2b51-4ec7-a811-8055a9de806d" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:39:52 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6ff585ef-1bb4-452a-87b0-7312c7145c9d tempest-CreateVolumesFromSnapshotTest-212894485 None] Lock "cinder-quobyte-27b3224a-2b51-4ec7-a811-8055a9de806d" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:39:52 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-6ff585ef-1bb4-452a-87b0-7312c7145c9d tempest-CreateVolumesFromSnapshotTest-212894485 None] Deleting offline snapshot 27b3224a-2b51-4ec7-a811-8055a9de806d of volume ab6f08f4-41bf-49ac-996b-c125e6ee91f2 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 16:39:52 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-6ff585ef-1bb4-452a-87b0-7312c7145c9d tempest-CreateVolumesFromSnapshotTest-212894485 None] snapshot_file for this snap is: volume-ab6f08f4-41bf-49ac-996b-c125e6ee91f2.27b3224a-2b51-4ec7-a811-8055a9de806d {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 16:39:52 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[28aee1a2-1232-4d59-bf8b-c994d179413a]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:39:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6ff585ef-1bb4-452a-87b0-7312c7145c9d tempest-CreateVolumesFromSnapshotTest-212894485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ab6f08f4-41bf-49ac-996b-c125e6ee91f2.27b3224a-2b51-4ec7-a811-8055a9de806d {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:39:52 devstack sudo[104012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ab6f08f4-41bf-49ac-996b-c125e6ee91f2.27b3224a-2b51-4ec7-a811-8055a9de806d
Jul 14 16:39:52 devstack sudo[104012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:39:52 devstack sudo[104012]: pam_unix(sudo:session): session closed for user root
Jul 14 16:39:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6ff585ef-1bb4-452a-87b0-7312c7145c9d tempest-CreateVolumesFromSnapshotTest-212894485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ab6f08f4-41bf-49ac-996b-c125e6ee91f2.27b3224a-2b51-4ec7-a811-8055a9de806d" returned: 0 in 0.350s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:39:52 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-6ff585ef-1bb4-452a-87b0-7312c7145c9d tempest-CreateVolumesFromSnapshotTest-212894485 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab6f08f4-41bf-49ac-996b-c125e6ee91f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 16:39:52 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa948d3-ce03-4a4f-92d0-a31f813a3d8f]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:39:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6ff585ef-1bb4-452a-87b0-7312c7145c9d tempest-CreateVolumesFromSnapshotTest-212894485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ab6f08f4-41bf-49ac-996b-c125e6ee91f2 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:39:52 devstack sudo[104017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ab6f08f4-41bf-49ac-996b-c125e6ee91f2
Jul 14 16:39:52 devstack sudo[104017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:39:52 devstack sudo[104017]: pam_unix(sudo:session): session closed for user root
Jul 14 16:39:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6ff585ef-1bb4-452a-87b0-7312c7145c9d tempest-CreateVolumesFromSnapshotTest-212894485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ab6f08f4-41bf-49ac-996b-c125e6ee91f2" returned: 0 in 0.350s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:39:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6ff585ef-1bb4-452a-87b0-7312c7145c9d tempest-CreateVolumesFromSnapshotTest-212894485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ab6f08f4-41bf-49ac-996b-c125e6ee91f2.27b3224a-2b51-4ec7-a811-8055a9de806d {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:39:52 devstack sudo[104023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ab6f08f4-41bf-49ac-996b-c125e6ee91f2.27b3224a-2b51-4ec7-a811-8055a9de806d
Jul 14 16:39:52 devstack sudo[104023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:39:53 devstack sudo[104023]: pam_unix(sudo:session): session closed for user root
Jul 14 16:39:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6ff585ef-1bb4-452a-87b0-7312c7145c9d tempest-CreateVolumesFromSnapshotTest-212894485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ab6f08f4-41bf-49ac-996b-c125e6ee91f2.27b3224a-2b51-4ec7-a811-8055a9de806d" returned: 0 in 0.319s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:39:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6ff585ef-1bb4-452a-87b0-7312c7145c9d tempest-CreateVolumesFromSnapshotTest-212894485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ab6f08f4-41bf-49ac-996b-c125e6ee91f2.27b3224a-2b51-4ec7-a811-8055a9de806d {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:39:53 devstack sudo[104029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ab6f08f4-41bf-49ac-996b-c125e6ee91f2.27b3224a-2b51-4ec7-a811-8055a9de806d
Jul 14 16:39:53 devstack sudo[104029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:39:53 devstack sudo[104029]: pam_unix(sudo:session): session closed for user root
Jul 14 16:39:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6ff585ef-1bb4-452a-87b0-7312c7145c9d tempest-CreateVolumesFromSnapshotTest-212894485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ab6f08f4-41bf-49ac-996b-c125e6ee91f2.27b3224a-2b51-4ec7-a811-8055a9de806d" returned: 0 in 0.234s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:39:53 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6ff585ef-1bb4-452a-87b0-7312c7145c9d tempest-CreateVolumesFromSnapshotTest-212894485 None] Lock "cinder-quobyte-27b3224a-2b51-4ec7-a811-8055a9de806d" released by "_delete_snapshot" :: held 1.350s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:39:53 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6ff585ef-1bb4-452a-87b0-7312c7145c9d tempest-CreateVolumesFromSnapshotTest-212894485 None] Lock "cinder-quobyte-ab6f08f4-41bf-49ac-996b-c125e6ee91f2" released by "delete_snapshot" :: held 1.374s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:39:53 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-6ff585ef-1bb4-452a-87b0-7312c7145c9d tempest-CreateVolumesFromSnapshotTest-212894485 None] Created reservations ['d7fedc8c-ba3d-4bc9-9b1a-91e95f361dde', '4a59a128-666e-4e26-b753-b70b7465765d', '125a1215-b9c0-41c5-9eb0-280d12a3d143', 'fd539107-f679-467f-976c-bcdf24577882'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:39:53 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-6ff585ef-1bb4-452a-87b0-7312c7145c9d tempest-CreateVolumesFromSnapshotTest-212894485 None] Delete snapshot completed successfully.
Jul 14 16:39:53 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6ff585ef-1bb4-452a-87b0-7312c7145c9d tempest-CreateVolumesFromSnapshotTest-212894485 None] Lock "cinder-27b3224a-2b51-4ec7-a811-8055a9de806d-delete_snapshot" released by "delete_snapshot" :: held 1.499s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:39:54 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0de26743-1f89-49b5-9007-01c32659a195 tempest-CreateVolumesFromSnapshotTest-212894485 None] Acquiring lock "cinder-ab6f08f4-41bf-49ac-996b-c125e6ee91f2-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:39:54 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0de26743-1f89-49b5-9007-01c32659a195 tempest-CreateVolumesFromSnapshotTest-212894485 None] Lock "cinder-ab6f08f4-41bf-49ac-996b-c125e6ee91f2-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:39:54 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0de26743-1f89-49b5-9007-01c32659a195 tempest-CreateVolumesFromSnapshotTest-212894485 None] Acquiring lock "cinder-quobyte-ab6f08f4-41bf-49ac-996b-c125e6ee91f2" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:39:54 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0de26743-1f89-49b5-9007-01c32659a195 tempest-CreateVolumesFromSnapshotTest-212894485 None] Lock "cinder-quobyte-ab6f08f4-41bf-49ac-996b-c125e6ee91f2" acquired by "delete_volume" :: waited 0.015s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:39:54 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a12eaee-2c08-48ef-8ebe-a399231841b0]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:39:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0de26743-1f89-49b5-9007-01c32659a195 tempest-CreateVolumesFromSnapshotTest-212894485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ab6f08f4-41bf-49ac-996b-c125e6ee91f2 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:39:54 devstack sudo[104032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ab6f08f4-41bf-49ac-996b-c125e6ee91f2
Jul 14 16:39:54 devstack sudo[104032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:39:54 devstack sudo[104032]: pam_unix(sudo:session): session closed for user root
Jul 14 16:39:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0de26743-1f89-49b5-9007-01c32659a195 tempest-CreateVolumesFromSnapshotTest-212894485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ab6f08f4-41bf-49ac-996b-c125e6ee91f2" returned: 0 in 0.345s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:39:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0de26743-1f89-49b5-9007-01c32659a195 tempest-CreateVolumesFromSnapshotTest-212894485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ab6f08f4-41bf-49ac-996b-c125e6ee91f2 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:39:54 devstack sudo[104037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ab6f08f4-41bf-49ac-996b-c125e6ee91f2
Jul 14 16:39:54 devstack sudo[104037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:39:54 devstack sudo[104037]: pam_unix(sudo:session): session closed for user root
Jul 14 16:39:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0de26743-1f89-49b5-9007-01c32659a195 tempest-CreateVolumesFromSnapshotTest-212894485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ab6f08f4-41bf-49ac-996b-c125e6ee91f2" returned: 0 in 0.242s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:39:54 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0de26743-1f89-49b5-9007-01c32659a195 tempest-CreateVolumesFromSnapshotTest-212894485 None] Lock "cinder-quobyte-ab6f08f4-41bf-49ac-996b-c125e6ee91f2" released by "delete_volume" :: held 0.643s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:39:54 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-0de26743-1f89-49b5-9007-01c32659a195 tempest-CreateVolumesFromSnapshotTest-212894485 None] Created reservations ['c90c9384-dfaa-44ec-b9ff-8393b1ec078f', 'cb17bf13-d442-445f-ba1a-e515c785414a', '1e5f22f9-76cd-4861-b98f-4cfd6254b8d3', '6964b1d0-0187-496d-a955-4faf7566e5c6'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:39:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0de26743-1f89-49b5-9007-01c32659a195 tempest-CreateVolumesFromSnapshotTest-212894485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:39:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0de26743-1f89-49b5-9007-01c32659a195 tempest-CreateVolumesFromSnapshotTest-212894485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:39:54 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0de26743-1f89-49b5-9007-01c32659a195 tempest-CreateVolumesFromSnapshotTest-212894485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:39:54 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0de26743-1f89-49b5-9007-01c32659a195 tempest-CreateVolumesFromSnapshotTest-212894485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:39:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0de26743-1f89-49b5-9007-01c32659a195 tempest-CreateVolumesFromSnapshotTest-212894485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:39:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0de26743-1f89-49b5-9007-01c32659a195 tempest-CreateVolumesFromSnapshotTest-212894485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:39:54 devstack sudo[104040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:39:54 devstack sudo[104040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:39:55 devstack sudo[104040]: pam_unix(sudo:session): session closed for user root
Jul 14 16:39:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0de26743-1f89-49b5-9007-01c32659a195 tempest-CreateVolumesFromSnapshotTest-212894485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.235s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:39:55 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-0de26743-1f89-49b5-9007-01c32659a195 tempest-CreateVolumesFromSnapshotTest-212894485 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:39:55 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-0de26743-1f89-49b5-9007-01c32659a195 tempest-CreateVolumesFromSnapshotTest-212894485 None] Deleted volume successfully.
Jul 14 16:39:55 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0de26743-1f89-49b5-9007-01c32659a195 tempest-CreateVolumesFromSnapshotTest-212894485 None] Lock "cinder-ab6f08f4-41bf-49ac-996b-c125e6ee91f2-delete_volume" released by "delete_volume" :: held 1.053s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:39:57 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-e43174d7-186c-456d-b87b-c248aacf7ece tempest-VolumeDependencyTests-1344979867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:39:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e43174d7-186c-456d-b87b-c248aacf7ece tempest-VolumeDependencyTests-1344979867 None] Flow 'volume_create_manager' (c721475e-1986-4828-bf50-fa17c039c4c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:39:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e43174d7-186c-456d-b87b-c248aacf7ece tempest-VolumeDependencyTests-1344979867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (546f6a0d-fdf1-4990-adfd-48e294f8d9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:39:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e43174d7-186c-456d-b87b-c248aacf7ece tempest-VolumeDependencyTests-1344979867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (546f6a0d-fdf1-4990-adfd-48e294f8d9af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:39:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-843809080',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88de191f-5077-4b82-be90-de7a86178f5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f2c057902c34d47a72e353369afedfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:39:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:39:58Z,use_quota=True,user_id='a5bb0ef8c5b14d218489f71f6cbfd8c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:39:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e43174d7-186c-456d-b87b-c248aacf7ece tempest-VolumeDependencyTests-1344979867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11510e78-273d-44cf-8341-3ab78a3a3ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:39:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e43174d7-186c-456d-b87b-c248aacf7ece tempest-VolumeDependencyTests-1344979867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11510e78-273d-44cf-8341-3ab78a3a3ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:39:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e43174d7-186c-456d-b87b-c248aacf7ece tempest-VolumeDependencyTests-1344979867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7327e1c-feaa-4709-8592-6e7359446b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:39:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e43174d7-186c-456d-b87b-c248aacf7ece tempest-VolumeDependencyTests-1344979867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7327e1c-feaa-4709-8592-6e7359446b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88de191f-5077-4b82-be90-de7a86178f5c', 'volume_name': 'volume-88de191f-5077-4b82-be90-de7a86178f5c', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:39:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e43174d7-186c-456d-b87b-c248aacf7ece tempest-VolumeDependencyTests-1344979867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0abd7e24-0006-4b41-a8b2-6075b77a11ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:39:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e43174d7-186c-456d-b87b-c248aacf7ece tempest-VolumeDependencyTests-1344979867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0abd7e24-0006-4b41-a8b2-6075b77a11ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:39:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e43174d7-186c-456d-b87b-c248aacf7ece tempest-VolumeDependencyTests-1344979867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43005c92-33eb-45aa-b02c-5dd6bd699d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:39:57 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-e43174d7-186c-456d-b87b-c248aacf7ece tempest-VolumeDependencyTests-1344979867 None] Volume 88de191f-5077-4b82-be90-de7a86178f5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88de191f-5077-4b82-be90-de7a86178f5c', 'volume_size': 1}
Jul 14 16:39:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e43174d7-186c-456d-b87b-c248aacf7ece tempest-VolumeDependencyTests-1344979867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:39:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e43174d7-186c-456d-b87b-c248aacf7ece tempest-VolumeDependencyTests-1344979867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:39:57 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-e43174d7-186c-456d-b87b-c248aacf7ece tempest-VolumeDependencyTests-1344979867 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:39:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-843809080',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88de191f-5077-4b82-be90-de7a86178f5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f2c057902c34d47a72e353369afedfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:39:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:39:58Z,use_quota=True,user_id='a5bb0ef8c5b14d218489f71f6cbfd8c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:39:57 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-e43174d7-186c-456d-b87b-c248aacf7ece tempest-VolumeDependencyTests-1344979867 None] Creating volume 88de191f-5077-4b82-be90-de7a86178f5c {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:39:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e43174d7-186c-456d-b87b-c248aacf7ece tempest-VolumeDependencyTests-1344979867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:39:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e43174d7-186c-456d-b87b-c248aacf7ece tempest-VolumeDependencyTests-1344979867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:39:57 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-e43174d7-186c-456d-b87b-c248aacf7ece tempest-VolumeDependencyTests-1344979867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:39:57 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-e43174d7-186c-456d-b87b-c248aacf7ece tempest-VolumeDependencyTests-1344979867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:39:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e43174d7-186c-456d-b87b-c248aacf7ece tempest-VolumeDependencyTests-1344979867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:39:57 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-e43174d7-186c-456d-b87b-c248aacf7ece tempest-VolumeDependencyTests-1344979867 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:39:57 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-e43174d7-186c-456d-b87b-c248aacf7ece tempest-VolumeDependencyTests-1344979867 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:39:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e43174d7-186c-456d-b87b-c248aacf7ece tempest-VolumeDependencyTests-1344979867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-88de191f-5077-4b82-be90-de7a86178f5c 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:39:57 devstack sudo[104043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-88de191f-5077-4b82-be90-de7a86178f5c 1073741824
Jul 14 16:39:57 devstack sudo[104043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:39:58 devstack sudo[104043]: pam_unix(sudo:session): session closed for user root
Jul 14 16:39:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e43174d7-186c-456d-b87b-c248aacf7ece tempest-VolumeDependencyTests-1344979867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-88de191f-5077-4b82-be90-de7a86178f5c 1073741824" returned: 0 in 0.412s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:39:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e43174d7-186c-456d-b87b-c248aacf7ece tempest-VolumeDependencyTests-1344979867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-88de191f-5077-4b82-be90-de7a86178f5c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:39:58 devstack sudo[104049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-88de191f-5077-4b82-be90-de7a86178f5c
Jul 14 16:39:58 devstack sudo[104049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:39:58 devstack sudo[104049]: pam_unix(sudo:session): session closed for user root
Jul 14 16:39:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e43174d7-186c-456d-b87b-c248aacf7ece tempest-VolumeDependencyTests-1344979867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-88de191f-5077-4b82-be90-de7a86178f5c" returned: 0 in 0.237s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:39:58 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-e43174d7-186c-456d-b87b-c248aacf7ece tempest-VolumeDependencyTests-1344979867 None] <== create_volume: return (690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:39:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e43174d7-186c-456d-b87b-c248aacf7ece tempest-VolumeDependencyTests-1344979867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.692s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:39:58 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e43174d7-186c-456d-b87b-c248aacf7ece tempest-VolumeDependencyTests-1344979867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43005c92-33eb-45aa-b02c-5dd6bd699d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88de191f-5077-4b82-be90-de7a86178f5c', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:39:58 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e43174d7-186c-456d-b87b-c248aacf7ece tempest-VolumeDependencyTests-1344979867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4803fdaf-8616-405e-9ffa-0132feb1de29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:39:58 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-e43174d7-186c-456d-b87b-c248aacf7ece tempest-VolumeDependencyTests-1344979867 None] Volume volume-88de191f-5077-4b82-be90-de7a86178f5c (88de191f-5077-4b82-be90-de7a86178f5c): created successfully
Jul 14 16:39:58 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e43174d7-186c-456d-b87b-c248aacf7ece tempest-VolumeDependencyTests-1344979867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4803fdaf-8616-405e-9ffa-0132feb1de29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:39:58 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e43174d7-186c-456d-b87b-c248aacf7ece tempest-VolumeDependencyTests-1344979867 None] Flow 'volume_create_manager' (c721475e-1986-4828-bf50-fa17c039c4c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:39:58 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-e43174d7-186c-456d-b87b-c248aacf7ece tempest-VolumeDependencyTests-1344979867 None] Created volume successfully.
Jul 14 16:39:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c4f3839a-9f59-49de-ba28-fead0ffaadf7 tempest-VolumeDependencyTests-1344979867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:39:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c4f3839a-9f59-49de-ba28-fead0ffaadf7 tempest-VolumeDependencyTests-1344979867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:39:59 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-c4f3839a-9f59-49de-ba28-fead0ffaadf7 tempest-VolumeDependencyTests-1344979867 None] Creating offline snapshot 98f9e841-7acb-4db8-aa4b-196a47354353 of volume 88de191f-5077-4b82-be90-de7a86178f5c {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 16:39:59 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06ec7cb-2580-4e0b-bb6c-1e13a8cfbeb7]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:39:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c4f3839a-9f59-49de-ba28-fead0ffaadf7 tempest-VolumeDependencyTests-1344979867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-88de191f-5077-4b82-be90-de7a86178f5c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:39:59 devstack sudo[104052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-88de191f-5077-4b82-be90-de7a86178f5c
Jul 14 16:39:59 devstack sudo[104052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:39:59 devstack sudo[104052]: pam_unix(sudo:session): session closed for user root
Jul 14 16:39:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c4f3839a-9f59-49de-ba28-fead0ffaadf7 tempest-VolumeDependencyTests-1344979867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-88de191f-5077-4b82-be90-de7a86178f5c" returned: 0 in 0.341s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:39:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c4f3839a-9f59-49de-ba28-fead0ffaadf7 tempest-VolumeDependencyTests-1344979867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-88de191f-5077-4b82-be90-de7a86178f5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-88de191f-5077-4b82-be90-de7a86178f5c.98f9e841-7acb-4db8-aa4b-196a47354353 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:39:59 devstack sudo[104057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-88de191f-5077-4b82-be90-de7a86178f5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-88de191f-5077-4b82-be90-de7a86178f5c.98f9e841-7acb-4db8-aa4b-196a47354353 1G
Jul 14 16:39:59 devstack sudo[104057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:39:59 devstack sudo[104057]: pam_unix(sudo:session): session closed for user root
Jul 14 16:39:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c4f3839a-9f59-49de-ba28-fead0ffaadf7 tempest-VolumeDependencyTests-1344979867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-88de191f-5077-4b82-be90-de7a86178f5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-88de191f-5077-4b82-be90-de7a86178f5c.98f9e841-7acb-4db8-aa4b-196a47354353 1G" returned: 0 in 0.367s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:39:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c4f3839a-9f59-49de-ba28-fead0ffaadf7 tempest-VolumeDependencyTests-1344979867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88de191f-5077-4b82-be90-de7a86178f5c -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-88de191f-5077-4b82-be90-de7a86178f5c.98f9e841-7acb-4db8-aa4b-196a47354353 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:39:59 devstack sudo[104064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88de191f-5077-4b82-be90-de7a86178f5c -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-88de191f-5077-4b82-be90-de7a86178f5c.98f9e841-7acb-4db8-aa4b-196a47354353
Jul 14 16:39:59 devstack sudo[104064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:40:00 devstack sudo[104064]: pam_unix(sudo:session): session closed for user root
Jul 14 16:40:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c4f3839a-9f59-49de-ba28-fead0ffaadf7 tempest-VolumeDependencyTests-1344979867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88de191f-5077-4b82-be90-de7a86178f5c -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-88de191f-5077-4b82-be90-de7a86178f5c.98f9e841-7acb-4db8-aa4b-196a47354353" returned: 0 in 0.279s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:40:00 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-c4f3839a-9f59-49de-ba28-fead0ffaadf7 tempest-VolumeDependencyTests-1344979867 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-88de191f-5077-4b82-be90-de7a86178f5c.98f9e841-7acb-4db8-aa4b-196a47354353 is being set with open permissions: ugo+rw
Jul 14 16:40:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c4f3839a-9f59-49de-ba28-fead0ffaadf7 tempest-VolumeDependencyTests-1344979867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-88de191f-5077-4b82-be90-de7a86178f5c.98f9e841-7acb-4db8-aa4b-196a47354353 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:40:00 devstack sudo[104069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-88de191f-5077-4b82-be90-de7a86178f5c.98f9e841-7acb-4db8-aa4b-196a47354353
Jul 14 16:40:00 devstack sudo[104069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:40:00 devstack sudo[104069]: pam_unix(sudo:session): session closed for user root
Jul 14 16:40:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c4f3839a-9f59-49de-ba28-fead0ffaadf7 tempest-VolumeDependencyTests-1344979867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-88de191f-5077-4b82-be90-de7a86178f5c.98f9e841-7acb-4db8-aa4b-196a47354353" returned: 0 in 0.231s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:40:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c4f3839a-9f59-49de-ba28-fead0ffaadf7 tempest-VolumeDependencyTests-1344979867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-88de191f-5077-4b82-be90-de7a86178f5c.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:40:00 devstack sudo[104072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-88de191f-5077-4b82-be90-de7a86178f5c.info
Jul 14 16:40:00 devstack sudo[104072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:40:00 devstack sudo[104072]: pam_unix(sudo:session): session closed for user root
Jul 14 16:40:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c4f3839a-9f59-49de-ba28-fead0ffaadf7 tempest-VolumeDependencyTests-1344979867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-88de191f-5077-4b82-be90-de7a86178f5c.info" returned: 0 in 0.246s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:40:00 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-c4f3839a-9f59-49de-ba28-fead0ffaadf7 tempest-VolumeDependencyTests-1344979867 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-88de191f-5077-4b82-be90-de7a86178f5c.info is being set with open permissions: ugo+rw
Jul 14 16:40:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c4f3839a-9f59-49de-ba28-fead0ffaadf7 tempest-VolumeDependencyTests-1344979867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-88de191f-5077-4b82-be90-de7a86178f5c.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:40:00 devstack sudo[104075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-88de191f-5077-4b82-be90-de7a86178f5c.info
Jul 14 16:40:00 devstack sudo[104075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:40:00 devstack sudo[104075]: pam_unix(sudo:session): session closed for user root
Jul 14 16:40:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c4f3839a-9f59-49de-ba28-fead0ffaadf7 tempest-VolumeDependencyTests-1344979867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-88de191f-5077-4b82-be90-de7a86178f5c.info" returned: 0 in 0.235s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:40:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c4f3839a-9f59-49de-ba28-fead0ffaadf7 tempest-VolumeDependencyTests-1344979867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.779s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:40:00 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-c4f3839a-9f59-49de-ba28-fead0ffaadf7 tempest-VolumeDependencyTests-1344979867 None] Create snapshot completed successfully
Jul 14 16:40:01 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-b92451c8-9ba2-48eb-bb44-9bb231f71823 tempest-VolumeDependencyTests-1344979867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:40:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b92451c8-9ba2-48eb-bb44-9bb231f71823 tempest-VolumeDependencyTests-1344979867 None] Flow 'volume_create_manager' (e066f7bc-0744-4886-9639-add301196df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:40:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b92451c8-9ba2-48eb-bb44-9bb231f71823 tempest-VolumeDependencyTests-1344979867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6943594-db3d-4de3-9f1c-190fdb631abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:40:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b92451c8-9ba2-48eb-bb44-9bb231f71823 tempest-VolumeDependencyTests-1344979867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6943594-db3d-4de3-9f1c-190fdb631abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:40:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1773510368',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddbe4cb0-2d86-43c0-89bc-30580ca2d976,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f2c057902c34d47a72e353369afedfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:40:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=98f9e841-7acb-4db8-aa4b-196a47354353,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:40:02Z,use_quota=True,user_id='a5bb0ef8c5b14d218489f71f6cbfd8c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:40:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b92451c8-9ba2-48eb-bb44-9bb231f71823 tempest-VolumeDependencyTests-1344979867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d929a51a-5eea-43f5-ad8e-b3458d92b892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:40:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b92451c8-9ba2-48eb-bb44-9bb231f71823 tempest-VolumeDependencyTests-1344979867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d929a51a-5eea-43f5-ad8e-b3458d92b892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:40:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b92451c8-9ba2-48eb-bb44-9bb231f71823 tempest-VolumeDependencyTests-1344979867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6541987d-3e76-4a09-8a48-558df8b21343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:40:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b92451c8-9ba2-48eb-bb44-9bb231f71823 tempest-VolumeDependencyTests-1344979867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6541987d-3e76-4a09-8a48-558df8b21343) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ddbe4cb0-2d86-43c0-89bc-30580ca2d976', 'volume_name': 'volume-ddbe4cb0-2d86-43c0-89bc-30580ca2d976', 'volume_size': 1, 'snapshot_id': '98f9e841-7acb-4db8-aa4b-196a47354353'}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:40:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b92451c8-9ba2-48eb-bb44-9bb231f71823 tempest-VolumeDependencyTests-1344979867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52c3c4ad-b51f-4358-9350-62843bebe444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:40:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b92451c8-9ba2-48eb-bb44-9bb231f71823 tempest-VolumeDependencyTests-1344979867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52c3c4ad-b51f-4358-9350-62843bebe444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:40:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b92451c8-9ba2-48eb-bb44-9bb231f71823 tempest-VolumeDependencyTests-1344979867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f68d729a-6920-4053-8d83-295a03426e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:40:01 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-b92451c8-9ba2-48eb-bb44-9bb231f71823 tempest-VolumeDependencyTests-1344979867 None] Volume ddbe4cb0-2d86-43c0-89bc-30580ca2d976: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ddbe4cb0-2d86-43c0-89bc-30580ca2d976', 'volume_size': 1, 'snapshot_id': '98f9e841-7acb-4db8-aa4b-196a47354353'}
Jul 14 16:40:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b92451c8-9ba2-48eb-bb44-9bb231f71823 tempest-VolumeDependencyTests-1344979867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:40:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b92451c8-9ba2-48eb-bb44-9bb231f71823 tempest-VolumeDependencyTests-1344979867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:40:01 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b92451c8-9ba2-48eb-bb44-9bb231f71823 tempest-VolumeDependencyTests-1344979867 None] Acquiring lock "cinder-quobyte-98f9e841-7acb-4db8-aa4b-196a47354353-ddbe4cb0-2d86-43c0-89bc-30580ca2d976" by "_create_volume_from_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:40:01 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b92451c8-9ba2-48eb-bb44-9bb231f71823 tempest-VolumeDependencyTests-1344979867 None] Lock "cinder-quobyte-98f9e841-7acb-4db8-aa4b-196a47354353-ddbe4cb0-2d86-43c0-89bc-30580ca2d976" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:40:01 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-b92451c8-9ba2-48eb-bb44-9bb231f71823 tempest-VolumeDependencyTests-1344979867 None] Creating volume ddbe4cb0-2d86-43c0-89bc-30580ca2d976 from snapshot 98f9e841-7acb-4db8-aa4b-196a47354353 {{(pid=87166) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 14 16:40:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b92451c8-9ba2-48eb-bb44-9bb231f71823 tempest-VolumeDependencyTests-1344979867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:40:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b92451c8-9ba2-48eb-bb44-9bb231f71823 tempest-VolumeDependencyTests-1344979867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:40:01 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-b92451c8-9ba2-48eb-bb44-9bb231f71823 tempest-VolumeDependencyTests-1344979867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:40:01 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-b92451c8-9ba2-48eb-bb44-9bb231f71823 tempest-VolumeDependencyTests-1344979867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:40:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b92451c8-9ba2-48eb-bb44-9bb231f71823 tempest-VolumeDependencyTests-1344979867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:40:01 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-b92451c8-9ba2-48eb-bb44-9bb231f71823 tempest-VolumeDependencyTests-1344979867 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:40:01 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b92451c8-9ba2-48eb-bb44-9bb231f71823 tempest-VolumeDependencyTests-1344979867 None] Acquiring lock "cinder-quobyte-ddbe4cb0-2d86-43c0-89bc-30580ca2d976" by "_copy_volume_from_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:40:01 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b92451c8-9ba2-48eb-bb44-9bb231f71823 tempest-VolumeDependencyTests-1344979867 None] Lock "cinder-quobyte-ddbe4cb0-2d86-43c0-89bc-30580ca2d976" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:40:01 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-b92451c8-9ba2-48eb-bb44-9bb231f71823 tempest-VolumeDependencyTests-1344979867 None] snapshot: 98f9e841-7acb-4db8-aa4b-196a47354353, volume: ddbe4cb0-2d86-43c0-89bc-30580ca2d976,  {{(pid=87166) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 14 16:40:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b92451c8-9ba2-48eb-bb44-9bb231f71823 tempest-VolumeDependencyTests-1344979867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:40:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b92451c8-9ba2-48eb-bb44-9bb231f71823 tempest-VolumeDependencyTests-1344979867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:40:01 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-b92451c8-9ba2-48eb-bb44-9bb231f71823 tempest-VolumeDependencyTests-1344979867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:40:01 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-b92451c8-9ba2-48eb-bb44-9bb231f71823 tempest-VolumeDependencyTests-1344979867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:40:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b92451c8-9ba2-48eb-bb44-9bb231f71823 tempest-VolumeDependencyTests-1344979867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:40:01 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1b6c67-0eae-4510-a684-1f788171e79e]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:40:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b92451c8-9ba2-48eb-bb44-9bb231f71823 tempest-VolumeDependencyTests-1344979867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-88de191f-5077-4b82-be90-de7a86178f5c.98f9e841-7acb-4db8-aa4b-196a47354353 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:40:01 devstack sudo[104078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-88de191f-5077-4b82-be90-de7a86178f5c.98f9e841-7acb-4db8-aa4b-196a47354353
Jul 14 16:40:01 devstack sudo[104078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:40:02 devstack sudo[104078]: pam_unix(sudo:session): session closed for user root
Jul 14 16:40:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b92451c8-9ba2-48eb-bb44-9bb231f71823 tempest-VolumeDependencyTests-1344979867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-88de191f-5077-4b82-be90-de7a86178f5c.98f9e841-7acb-4db8-aa4b-196a47354353" returned: 0 in 0.340s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:40:02 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-b92451c8-9ba2-48eb-bb44-9bb231f71823 tempest-VolumeDependencyTests-1344979867 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88de191f-5077-4b82-be90-de7a86178f5c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 16:40:02 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-b92451c8-9ba2-48eb-bb44-9bb231f71823 tempest-VolumeDependencyTests-1344979867 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-88de191f-5077-4b82-be90-de7a86178f5c {{(pid=87166) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 14 16:40:02 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-b92451c8-9ba2-48eb-bb44-9bb231f71823 tempest-VolumeDependencyTests-1344979867 None] Creating direct copy from snapshot {{(pid=87166) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 14 16:40:02 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d278120-2c56-46fa-9da3-c5994734ba9c]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:40:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b92451c8-9ba2-48eb-bb44-9bb231f71823 tempest-VolumeDependencyTests-1344979867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-88de191f-5077-4b82-be90-de7a86178f5c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:40:02 devstack sudo[104083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-88de191f-5077-4b82-be90-de7a86178f5c
Jul 14 16:40:02 devstack sudo[104083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:40:02 devstack sudo[104083]: pam_unix(sudo:session): session closed for user root
Jul 14 16:40:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b92451c8-9ba2-48eb-bb44-9bb231f71823 tempest-VolumeDependencyTests-1344979867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-88de191f-5077-4b82-be90-de7a86178f5c" returned: 0 in 0.348s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:40:02 devstack cinder-volume[87166]: DEBUG cinder.utils [None req-b92451c8-9ba2-48eb-bb44-9bb231f71823 tempest-VolumeDependencyTests-1344979867 None] Path /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ddbe4cb0-2d86-43c0-89bc-30580ca2d976 not found in is_blk_device check {{(pid=87166) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 14 16:40:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b92451c8-9ba2-48eb-bb44-9bb231f71823 tempest-VolumeDependencyTests-1344979867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-88de191f-5077-4b82-be90-de7a86178f5c /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ddbe4cb0-2d86-43c0-89bc-30580ca2d976 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:40:02 devstack sudo[104088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-88de191f-5077-4b82-be90-de7a86178f5c /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ddbe4cb0-2d86-43c0-89bc-30580ca2d976
Jul 14 16:40:02 devstack sudo[104088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:40:06 devstack sudo[104088]: pam_unix(sudo:session): session closed for user root
Jul 14 16:40:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b92451c8-9ba2-48eb-bb44-9bb231f71823 tempest-VolumeDependencyTests-1344979867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-88de191f-5077-4b82-be90-de7a86178f5c /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ddbe4cb0-2d86-43c0-89bc-30580ca2d976" returned: 0 in 3.994s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:40:06 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[6409bfd8-528c-4954-ae4e-d83ba6cdb150]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:40:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b92451c8-9ba2-48eb-bb44-9bb231f71823 tempest-VolumeDependencyTests-1344979867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-88de191f-5077-4b82-be90-de7a86178f5c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:40:06 devstack sudo[104101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-88de191f-5077-4b82-be90-de7a86178f5c
Jul 14 16:40:06 devstack sudo[104101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:40:07 devstack sudo[104101]: pam_unix(sudo:session): session closed for user root
Jul 14 16:40:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b92451c8-9ba2-48eb-bb44-9bb231f71823 tempest-VolumeDependencyTests-1344979867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-88de191f-5077-4b82-be90-de7a86178f5c" returned: 0 in 0.557s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:40:07 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-b92451c8-9ba2-48eb-bb44-9bb231f71823 tempest-VolumeDependencyTests-1344979867 None] Image conversion details: src /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-88de191f-5077-4b82-be90-de7a86178f5c, size 1024.00 MB, duration 3.99 sec, destination /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ddbe4cb0-2d86-43c0-89bc-30580ca2d976 {{(pid=87166) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 14 16:40:07 devstack cinder-volume[87166]: INFO cinder.image.image_utils [None req-b92451c8-9ba2-48eb-bb44-9bb231f71823 tempest-VolumeDependencyTests-1344979867 None] Converted 1024.00 MB image at 256.33 MB/s
Jul 14 16:40:07 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-b92451c8-9ba2-48eb-bb44-9bb231f71823 tempest-VolumeDependencyTests-1344979867 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ddbe4cb0-2d86-43c0-89bc-30580ca2d976 is being set with open permissions: ugo+rw
Jul 14 16:40:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b92451c8-9ba2-48eb-bb44-9bb231f71823 tempest-VolumeDependencyTests-1344979867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ddbe4cb0-2d86-43c0-89bc-30580ca2d976 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:40:07 devstack sudo[104107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ddbe4cb0-2d86-43c0-89bc-30580ca2d976
Jul 14 16:40:07 devstack sudo[104107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:40:07 devstack sudo[104107]: pam_unix(sudo:session): session closed for user root
Jul 14 16:40:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b92451c8-9ba2-48eb-bb44-9bb231f71823 tempest-VolumeDependencyTests-1344979867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ddbe4cb0-2d86-43c0-89bc-30580ca2d976" returned: 0 in 0.271s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:40:07 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b92451c8-9ba2-48eb-bb44-9bb231f71823 tempest-VolumeDependencyTests-1344979867 None] Lock "cinder-quobyte-ddbe4cb0-2d86-43c0-89bc-30580ca2d976" released by "_copy_volume_from_snapshot" :: held 5.593s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:40:07 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b92451c8-9ba2-48eb-bb44-9bb231f71823 tempest-VolumeDependencyTests-1344979867 None] Lock "cinder-quobyte-98f9e841-7acb-4db8-aa4b-196a47354353-ddbe4cb0-2d86-43c0-89bc-30580ca2d976" released by "_create_volume_from_snapshot" :: held 5.621s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:40:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b92451c8-9ba2-48eb-bb44-9bb231f71823 tempest-VolumeDependencyTests-1344979867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.636s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:40:07 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b92451c8-9ba2-48eb-bb44-9bb231f71823 tempest-VolumeDependencyTests-1344979867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f68d729a-6920-4053-8d83-295a03426e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddbe4cb0-2d86-43c0-89bc-30580ca2d976', 'volume_size': 1, 'snapshot_id': '98f9e841-7acb-4db8-aa4b-196a47354353'}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:40:07 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b92451c8-9ba2-48eb-bb44-9bb231f71823 tempest-VolumeDependencyTests-1344979867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f1bca55-9c3c-4808-98c5-233623ee1e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:40:07 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-b92451c8-9ba2-48eb-bb44-9bb231f71823 tempest-VolumeDependencyTests-1344979867 None] Volume volume-ddbe4cb0-2d86-43c0-89bc-30580ca2d976 (ddbe4cb0-2d86-43c0-89bc-30580ca2d976): created successfully
Jul 14 16:40:07 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b92451c8-9ba2-48eb-bb44-9bb231f71823 tempest-VolumeDependencyTests-1344979867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f1bca55-9c3c-4808-98c5-233623ee1e9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:40:07 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b92451c8-9ba2-48eb-bb44-9bb231f71823 tempest-VolumeDependencyTests-1344979867 None] Flow 'volume_create_manager' (e066f7bc-0744-4886-9639-add301196df7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:40:07 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-b92451c8-9ba2-48eb-bb44-9bb231f71823 tempest-VolumeDependencyTests-1344979867 None] Created volume successfully.
Jul 14 16:40:08 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e266c872-126f-48e0-b35e-dc32270abf72 tempest-VolumeDependencyTests-1344979867 None] Acquiring lock "cinder-98f9e841-7acb-4db8-aa4b-196a47354353-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:40:08 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e266c872-126f-48e0-b35e-dc32270abf72 tempest-VolumeDependencyTests-1344979867 None] Lock "cinder-98f9e841-7acb-4db8-aa4b-196a47354353-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:40:08 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e266c872-126f-48e0-b35e-dc32270abf72 tempest-VolumeDependencyTests-1344979867 None] Acquiring lock "cinder-quobyte-88de191f-5077-4b82-be90-de7a86178f5c" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:40:08 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e266c872-126f-48e0-b35e-dc32270abf72 tempest-VolumeDependencyTests-1344979867 None] Lock "cinder-quobyte-88de191f-5077-4b82-be90-de7a86178f5c" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:40:08 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e266c872-126f-48e0-b35e-dc32270abf72 tempest-VolumeDependencyTests-1344979867 None] Acquiring lock "cinder-quobyte-98f9e841-7acb-4db8-aa4b-196a47354353" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:40:08 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e266c872-126f-48e0-b35e-dc32270abf72 tempest-VolumeDependencyTests-1344979867 None] Lock "cinder-quobyte-98f9e841-7acb-4db8-aa4b-196a47354353" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:40:08 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-e266c872-126f-48e0-b35e-dc32270abf72 tempest-VolumeDependencyTests-1344979867 None] Deleting offline snapshot 98f9e841-7acb-4db8-aa4b-196a47354353 of volume 88de191f-5077-4b82-be90-de7a86178f5c {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 16:40:08 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-e266c872-126f-48e0-b35e-dc32270abf72 tempest-VolumeDependencyTests-1344979867 None] snapshot_file for this snap is: volume-88de191f-5077-4b82-be90-de7a86178f5c.98f9e841-7acb-4db8-aa4b-196a47354353 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 16:40:08 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae368fb-20b0-48b7-963c-f9f399f34e07]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:40:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e266c872-126f-48e0-b35e-dc32270abf72 tempest-VolumeDependencyTests-1344979867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-88de191f-5077-4b82-be90-de7a86178f5c.98f9e841-7acb-4db8-aa4b-196a47354353 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:40:08 devstack sudo[104150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-88de191f-5077-4b82-be90-de7a86178f5c.98f9e841-7acb-4db8-aa4b-196a47354353
Jul 14 16:40:08 devstack sudo[104150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:40:08 devstack sudo[104150]: pam_unix(sudo:session): session closed for user root
Jul 14 16:40:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e266c872-126f-48e0-b35e-dc32270abf72 tempest-VolumeDependencyTests-1344979867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-88de191f-5077-4b82-be90-de7a86178f5c.98f9e841-7acb-4db8-aa4b-196a47354353" returned: 0 in 0.348s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:40:08 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-e266c872-126f-48e0-b35e-dc32270abf72 tempest-VolumeDependencyTests-1344979867 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88de191f-5077-4b82-be90-de7a86178f5c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 16:40:08 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[080ad225-48aa-4dab-b748-3f03f7c2298d]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:40:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e266c872-126f-48e0-b35e-dc32270abf72 tempest-VolumeDependencyTests-1344979867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-88de191f-5077-4b82-be90-de7a86178f5c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:40:08 devstack sudo[104155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-88de191f-5077-4b82-be90-de7a86178f5c
Jul 14 16:40:08 devstack sudo[104155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:40:09 devstack sudo[104155]: pam_unix(sudo:session): session closed for user root
Jul 14 16:40:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e266c872-126f-48e0-b35e-dc32270abf72 tempest-VolumeDependencyTests-1344979867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-88de191f-5077-4b82-be90-de7a86178f5c" returned: 0 in 0.340s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:40:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e266c872-126f-48e0-b35e-dc32270abf72 tempest-VolumeDependencyTests-1344979867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-88de191f-5077-4b82-be90-de7a86178f5c.98f9e841-7acb-4db8-aa4b-196a47354353 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:40:09 devstack sudo[104160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-88de191f-5077-4b82-be90-de7a86178f5c.98f9e841-7acb-4db8-aa4b-196a47354353
Jul 14 16:40:09 devstack sudo[104160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:40:09 devstack sudo[104160]: pam_unix(sudo:session): session closed for user root
Jul 14 16:40:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e266c872-126f-48e0-b35e-dc32270abf72 tempest-VolumeDependencyTests-1344979867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-88de191f-5077-4b82-be90-de7a86178f5c.98f9e841-7acb-4db8-aa4b-196a47354353" returned: 0 in 0.329s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:40:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e266c872-126f-48e0-b35e-dc32270abf72 tempest-VolumeDependencyTests-1344979867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-88de191f-5077-4b82-be90-de7a86178f5c.98f9e841-7acb-4db8-aa4b-196a47354353 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:40:09 devstack sudo[104166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-88de191f-5077-4b82-be90-de7a86178f5c.98f9e841-7acb-4db8-aa4b-196a47354353
Jul 14 16:40:09 devstack sudo[104166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:40:09 devstack sudo[104166]: pam_unix(sudo:session): session closed for user root
Jul 14 16:40:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e266c872-126f-48e0-b35e-dc32270abf72 tempest-VolumeDependencyTests-1344979867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-88de191f-5077-4b82-be90-de7a86178f5c.98f9e841-7acb-4db8-aa4b-196a47354353" returned: 0 in 0.241s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:40:09 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e266c872-126f-48e0-b35e-dc32270abf72 tempest-VolumeDependencyTests-1344979867 None] Lock "cinder-quobyte-98f9e841-7acb-4db8-aa4b-196a47354353" released by "_delete_snapshot" :: held 1.347s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:40:09 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e266c872-126f-48e0-b35e-dc32270abf72 tempest-VolumeDependencyTests-1344979867 None] Lock "cinder-quobyte-88de191f-5077-4b82-be90-de7a86178f5c" released by "delete_snapshot" :: held 1.372s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:40:09 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-e266c872-126f-48e0-b35e-dc32270abf72 tempest-VolumeDependencyTests-1344979867 None] Created reservations ['571f0565-8aef-4d62-90c6-eb3f2645ae41', 'ce86ceb5-3fc1-478a-abcd-6923bc90ba03', 'a2920d62-dfde-4e70-92d1-6f223ab346ca', '70d6d4a7-8496-45de-bd95-2f7bca5346ca'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:40:09 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-e266c872-126f-48e0-b35e-dc32270abf72 tempest-VolumeDependencyTests-1344979867 None] Delete snapshot completed successfully.
Jul 14 16:40:09 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e266c872-126f-48e0-b35e-dc32270abf72 tempest-VolumeDependencyTests-1344979867 None] Lock "cinder-98f9e841-7acb-4db8-aa4b-196a47354353-delete_snapshot" released by "delete_snapshot" :: held 1.505s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:40:10 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-87125920-9e4c-43d1-8344-3d125d5b25d7 tempest-VolumeDependencyTests-1344979867 None] Acquiring lock "cinder-88de191f-5077-4b82-be90-de7a86178f5c-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:40:10 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-87125920-9e4c-43d1-8344-3d125d5b25d7 tempest-VolumeDependencyTests-1344979867 None] Lock "cinder-88de191f-5077-4b82-be90-de7a86178f5c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:40:10 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:SELECT=91,cinder:UPDATE=103,cinder:INSERT=29,cinder:DELETE=8 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 16:40:10 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:SELECT=84,cinder:UPDATE=115,cinder:INSERT=24,cinder:DELETE=10 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 16:40:10 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-87125920-9e4c-43d1-8344-3d125d5b25d7 tempest-VolumeDependencyTests-1344979867 None] Acquiring lock "cinder-quobyte-88de191f-5077-4b82-be90-de7a86178f5c" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:40:10 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-87125920-9e4c-43d1-8344-3d125d5b25d7 tempest-VolumeDependencyTests-1344979867 None] Lock "cinder-quobyte-88de191f-5077-4b82-be90-de7a86178f5c" acquired by "delete_volume" :: waited 0.022s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:40:10 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[c497ed6b-5a92-4efe-83b2-85046d90002e]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:40:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-87125920-9e4c-43d1-8344-3d125d5b25d7 tempest-VolumeDependencyTests-1344979867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-88de191f-5077-4b82-be90-de7a86178f5c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:40:10 devstack sudo[104170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-88de191f-5077-4b82-be90-de7a86178f5c
Jul 14 16:40:10 devstack sudo[104170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:40:10 devstack sudo[104170]: pam_unix(sudo:session): session closed for user root
Jul 14 16:40:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-87125920-9e4c-43d1-8344-3d125d5b25d7 tempest-VolumeDependencyTests-1344979867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-88de191f-5077-4b82-be90-de7a86178f5c" returned: 0 in 0.352s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:40:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-87125920-9e4c-43d1-8344-3d125d5b25d7 tempest-VolumeDependencyTests-1344979867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-88de191f-5077-4b82-be90-de7a86178f5c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:40:10 devstack sudo[104175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-88de191f-5077-4b82-be90-de7a86178f5c
Jul 14 16:40:10 devstack sudo[104175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:40:11 devstack sudo[104175]: pam_unix(sudo:session): session closed for user root
Jul 14 16:40:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-87125920-9e4c-43d1-8344-3d125d5b25d7 tempest-VolumeDependencyTests-1344979867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-88de191f-5077-4b82-be90-de7a86178f5c" returned: 0 in 0.244s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:40:11 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-87125920-9e4c-43d1-8344-3d125d5b25d7 tempest-VolumeDependencyTests-1344979867 None] Lock "cinder-quobyte-88de191f-5077-4b82-be90-de7a86178f5c" released by "delete_volume" :: held 0.665s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:40:11 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-87125920-9e4c-43d1-8344-3d125d5b25d7 tempest-VolumeDependencyTests-1344979867 None] Created reservations ['99600567-f6ed-44fd-853b-0d46625ab743', '8d7e1ea1-6b39-4b7e-b0af-f0f93f96a4cf', '7d2943c0-1199-4acb-910d-99c11a0db3ea', '7bd21a37-e703-48f0-bc63-d8a3c4b71d80'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:40:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-87125920-9e4c-43d1-8344-3d125d5b25d7 tempest-VolumeDependencyTests-1344979867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:40:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-87125920-9e4c-43d1-8344-3d125d5b25d7 tempest-VolumeDependencyTests-1344979867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:40:11 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-87125920-9e4c-43d1-8344-3d125d5b25d7 tempest-VolumeDependencyTests-1344979867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:40:11 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-87125920-9e4c-43d1-8344-3d125d5b25d7 tempest-VolumeDependencyTests-1344979867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:40:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-87125920-9e4c-43d1-8344-3d125d5b25d7 tempest-VolumeDependencyTests-1344979867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:40:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-87125920-9e4c-43d1-8344-3d125d5b25d7 tempest-VolumeDependencyTests-1344979867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:40:11 devstack sudo[104178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:40:11 devstack sudo[104178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:40:11 devstack sudo[104178]: pam_unix(sudo:session): session closed for user root
Jul 14 16:40:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-87125920-9e4c-43d1-8344-3d125d5b25d7 tempest-VolumeDependencyTests-1344979867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.237s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:40:11 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-87125920-9e4c-43d1-8344-3d125d5b25d7 tempest-VolumeDependencyTests-1344979867 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:40:11 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-87125920-9e4c-43d1-8344-3d125d5b25d7 tempest-VolumeDependencyTests-1344979867 None] Deleted volume successfully.
Jul 14 16:40:11 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-87125920-9e4c-43d1-8344-3d125d5b25d7 tempest-VolumeDependencyTests-1344979867 None] Lock "cinder-88de191f-5077-4b82-be90-de7a86178f5c-delete_volume" released by "delete_volume" :: held 1.123s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:40:11 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-47a7c705-a650-4e9a-a58a-b544b6156e52 tempest-VolumeDependencyTests-1344979867 None] Acquiring lock "cinder-ddbe4cb0-2d86-43c0-89bc-30580ca2d976-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:40:11 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-47a7c705-a650-4e9a-a58a-b544b6156e52 tempest-VolumeDependencyTests-1344979867 None] Lock "cinder-ddbe4cb0-2d86-43c0-89bc-30580ca2d976-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:40:11 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-47a7c705-a650-4e9a-a58a-b544b6156e52 tempest-VolumeDependencyTests-1344979867 None] Acquiring lock "cinder-quobyte-ddbe4cb0-2d86-43c0-89bc-30580ca2d976" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:40:11 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-47a7c705-a650-4e9a-a58a-b544b6156e52 tempest-VolumeDependencyTests-1344979867 None] Lock "cinder-quobyte-ddbe4cb0-2d86-43c0-89bc-30580ca2d976" acquired by "delete_volume" :: waited 0.016s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:40:11 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ce35ee-2836-4797-954c-dd7050d4bfb2]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:40:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-47a7c705-a650-4e9a-a58a-b544b6156e52 tempest-VolumeDependencyTests-1344979867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ddbe4cb0-2d86-43c0-89bc-30580ca2d976 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:40:11 devstack sudo[104181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ddbe4cb0-2d86-43c0-89bc-30580ca2d976
Jul 14 16:40:11 devstack sudo[104181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:40:12 devstack sudo[104181]: pam_unix(sudo:session): session closed for user root
Jul 14 16:40:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-47a7c705-a650-4e9a-a58a-b544b6156e52 tempest-VolumeDependencyTests-1344979867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ddbe4cb0-2d86-43c0-89bc-30580ca2d976" returned: 0 in 0.350s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:40:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-47a7c705-a650-4e9a-a58a-b544b6156e52 tempest-VolumeDependencyTests-1344979867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ddbe4cb0-2d86-43c0-89bc-30580ca2d976 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:40:12 devstack sudo[104186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ddbe4cb0-2d86-43c0-89bc-30580ca2d976
Jul 14 16:40:12 devstack sudo[104186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:40:12 devstack sudo[104186]: pam_unix(sudo:session): session closed for user root
Jul 14 16:40:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-47a7c705-a650-4e9a-a58a-b544b6156e52 tempest-VolumeDependencyTests-1344979867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ddbe4cb0-2d86-43c0-89bc-30580ca2d976" returned: 0 in 0.247s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:40:12 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-47a7c705-a650-4e9a-a58a-b544b6156e52 tempest-VolumeDependencyTests-1344979867 None] Lock "cinder-quobyte-ddbe4cb0-2d86-43c0-89bc-30580ca2d976" released by "delete_volume" :: held 0.651s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:40:12 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-47a7c705-a650-4e9a-a58a-b544b6156e52 tempest-VolumeDependencyTests-1344979867 None] Created reservations ['a5e87939-169c-4f7f-a492-ed68e26574d0', 'c8b731f0-238e-4d3f-be54-01a2135e03a7', 'f13c1ce9-4211-4f69-84a4-989f76f72a5c', 'fb3d863f-bd90-4061-9305-42e807f50163'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:40:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-47a7c705-a650-4e9a-a58a-b544b6156e52 tempest-VolumeDependencyTests-1344979867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:40:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-47a7c705-a650-4e9a-a58a-b544b6156e52 tempest-VolumeDependencyTests-1344979867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:40:12 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-47a7c705-a650-4e9a-a58a-b544b6156e52 tempest-VolumeDependencyTests-1344979867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:40:12 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-47a7c705-a650-4e9a-a58a-b544b6156e52 tempest-VolumeDependencyTests-1344979867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:40:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-47a7c705-a650-4e9a-a58a-b544b6156e52 tempest-VolumeDependencyTests-1344979867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:40:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-47a7c705-a650-4e9a-a58a-b544b6156e52 tempest-VolumeDependencyTests-1344979867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:40:12 devstack sudo[104195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:40:12 devstack sudo[104195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:40:12 devstack sudo[104195]: pam_unix(sudo:session): session closed for user root
Jul 14 16:40:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-47a7c705-a650-4e9a-a58a-b544b6156e52 tempest-VolumeDependencyTests-1344979867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.240s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:40:12 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-47a7c705-a650-4e9a-a58a-b544b6156e52 tempest-VolumeDependencyTests-1344979867 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:40:12 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-47a7c705-a650-4e9a-a58a-b544b6156e52 tempest-VolumeDependencyTests-1344979867 None] Deleted volume successfully.
Jul 14 16:40:12 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-47a7c705-a650-4e9a-a58a-b544b6156e52 tempest-VolumeDependencyTests-1344979867 None] Lock "cinder-ddbe4cb0-2d86-43c0-89bc-30580ca2d976-delete_volume" released by "delete_volume" :: held 1.079s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:40:17 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c80515c-b631-48cc-a341-b1fcb3f0d81e tempest-VolumeImageDependencyTests-720961631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:40:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1c80515c-b631-48cc-a341-b1fcb3f0d81e tempest-VolumeImageDependencyTests-720961631 None] Flow 'volume_create_manager' (d4ea5035-8e32-4d39-8070-7db646ba036a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:40:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1c80515c-b631-48cc-a341-b1fcb3f0d81e tempest-VolumeImageDependencyTests-720961631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d0e5a50-ba3e-4610-8201-9d3286011dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:40:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1c80515c-b631-48cc-a341-b1fcb3f0d81e tempest-VolumeImageDependencyTests-720961631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d0e5a50-ba3e-4610-8201-9d3286011dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:40:17Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6970a7b0-a104-4d0f-9433-523caf4e9a01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ba6d3995250492180e1ca21687fe8d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:40:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:40:18Z,use_quota=True,user_id='4d8ac2d552c3459eb832f5f256451a1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:40:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1c80515c-b631-48cc-a341-b1fcb3f0d81e tempest-VolumeImageDependencyTests-720961631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6441979e-73a1-45c9-93bb-f21e37b4b885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:40:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1c80515c-b631-48cc-a341-b1fcb3f0d81e tempest-VolumeImageDependencyTests-720961631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6441979e-73a1-45c9-93bb-f21e37b4b885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:40:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1c80515c-b631-48cc-a341-b1fcb3f0d81e tempest-VolumeImageDependencyTests-720961631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e80becf9-cb33-4a9e-82e1-99379b8a6cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:40:17 devstack cinder-volume[87166]: DEBUG cinder.image.glance [None req-1c80515c-b631-48cc-a341-b1fcb3f0d81e tempest-VolumeImageDependencyTests-720961631 None] Creating Keystone auth plugin from conf {{(pid=87166) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 14 16:40:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1c80515c-b631-48cc-a341-b1fcb3f0d81e tempest-VolumeImageDependencyTests-720961631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e80becf9-cb33-4a9e-82e1-99379b8a6cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6970a7b0-a104-4d0f-9433-523caf4e9a01', 'volume_name': 'volume-6970a7b0-a104-4d0f-9433-523caf4e9a01', 'volume_size': 1, 'image_id': '5ff24071-5fc7-443b-a708-22f67ee22ba0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5ff24071-5fc7-443b-a708-22f67ee22ba0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7cf3aaeeece81fc2ced7319e9799247b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8ba6d3995250492180e1ca21687fe8d6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '98227490e756c533b0eeae06e057a2da727090856bbc8038b5b9b19d4469070eb07e1cd0046740ab3e78ad4ee55fa2d24fbe390f6b3af46688badf1c739e3769', 'id': '5ff24071-5fc7-443b-a708-22f67ee22ba0', 'created_at': datetime.datetime(2026, 7, 14, 14, 40, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 14, 40, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5ff24071-5fc7-443b-a708-22f67ee22ba0/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74f776a966f0>}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:40:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1c80515c-b631-48cc-a341-b1fcb3f0d81e tempest-VolumeImageDependencyTests-720961631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8225feb3-569a-4e49-b356-305d9ffcc61b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:40:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1c80515c-b631-48cc-a341-b1fcb3f0d81e tempest-VolumeImageDependencyTests-720961631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8225feb3-569a-4e49-b356-305d9ffcc61b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:40:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1c80515c-b631-48cc-a341-b1fcb3f0d81e tempest-VolumeImageDependencyTests-720961631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f1d4df0-6a76-47d6-84bd-c2f694c59211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:40:17 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-1c80515c-b631-48cc-a341-b1fcb3f0d81e tempest-VolumeImageDependencyTests-720961631 None] Volume 6970a7b0-a104-4d0f-9433-523caf4e9a01: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6970a7b0-a104-4d0f-9433-523caf4e9a01', 'volume_size': 1, 'image_id': '5ff24071-5fc7-443b-a708-22f67ee22ba0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5ff24071-5fc7-443b-a708-22f67ee22ba0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7cf3aaeeece81fc2ced7319e9799247b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8ba6d3995250492180e1ca21687fe8d6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '98227490e756c533b0eeae06e057a2da727090856bbc8038b5b9b19d4469070eb07e1cd0046740ab3e78ad4ee55fa2d24fbe390f6b3af46688badf1c739e3769', 'id': '5ff24071-5fc7-443b-a708-22f67ee22ba0', 'created_at': datetime.datetime(2026, 7, 14, 14, 40, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 14, 40, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5ff24071-5fc7-443b-a708-22f67ee22ba0/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74f776a966f0>}
Jul 14 16:40:17 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c80515c-b631-48cc-a341-b1fcb3f0d81e tempest-VolumeImageDependencyTests-720961631 None] Trying to clone 6970a7b0-a104-4d0f-9433-523caf4e9a01 from image 5ff24071-5fc7-443b-a708-22f67ee22ba0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5ff24071-5fc7-443b-a708-22f67ee22ba0', 'metadata': {}}]). {{(pid=87166) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 14 16:40:17 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-1c80515c-b631-48cc-a341-b1fcb3f0d81e tempest-VolumeImageDependencyTests-720961631 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5ff24071-5fc7-443b-a708-22f67ee22ba0_t3p0i2aldevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87166) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 14 16:40:17 devstack cinder-volume[87166]: INFO cinder.image.image_utils [None req-1c80515c-b631-48cc-a341-b1fcb3f0d81e tempest-VolumeImageDependencyTests-720961631 None] Image download 0.00 MB at 0.00 MB/s
Jul 14 16:40:18 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd09fd5-eab0-4e5d-a634-2dcd184f2db4]: (4, 'raw') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:40:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1c80515c-b631-48cc-a341-b1fcb3f0d81e tempest-VolumeImageDependencyTests-720961631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ff24071-5fc7-443b-a708-22f67ee22ba0_t3p0i2aldevstack@QuobyteHD {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:40:18 devstack sudo[104200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ff24071-5fc7-443b-a708-22f67ee22ba0_t3p0i2aldevstack@QuobyteHD
Jul 14 16:40:18 devstack sudo[104200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:40:18 devstack sudo[104200]: pam_unix(sudo:session): session closed for user root
Jul 14 16:40:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1c80515c-b631-48cc-a341-b1fcb3f0d81e tempest-VolumeImageDependencyTests-720961631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ff24071-5fc7-443b-a708-22f67ee22ba0_t3p0i2aldevstack@QuobyteHD" returned: 0 in 0.316s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:40:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1c80515c-b631-48cc-a341-b1fcb3f0d81e tempest-VolumeImageDependencyTests-720961631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ff24071-5fc7-443b-a708-22f67ee22ba0_t3p0i2aldevstack@QuobyteHD {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:40:18 devstack sudo[104204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ff24071-5fc7-443b-a708-22f67ee22ba0_t3p0i2aldevstack@QuobyteHD
Jul 14 16:40:18 devstack sudo[104204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:40:18 devstack sudo[104204]: pam_unix(sudo:session): session closed for user root
Jul 14 16:40:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1c80515c-b631-48cc-a341-b1fcb3f0d81e tempest-VolumeImageDependencyTests-720961631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ff24071-5fc7-443b-a708-22f67ee22ba0_t3p0i2aldevstack@QuobyteHD" returned: 1 in 0.314s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:40:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1c80515c-b631-48cc-a341-b1fcb3f0d81e tempest-VolumeImageDependencyTests-720961631 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ff24071-5fc7-443b-a708-22f67ee22ba0_t3p0i2aldevstack@QuobyteHD' failed. Not Retrying. {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 16:40:18 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-1c80515c-b631-48cc-a341-b1fcb3f0d81e tempest-VolumeImageDependencyTests-720961631 None] Temporary image 5ff24071-5fc7-443b-a708-22f67ee22ba0 is fetched for user 4d8ac2d552c3459eb832f5f256451a1f. {{(pid=87166) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 14 16:40:18 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac2f557-d767-4596-9025-9c53499d38aa]: (4, 'raw') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:40:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1c80515c-b631-48cc-a341-b1fcb3f0d81e tempest-VolumeImageDependencyTests-720961631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ff24071-5fc7-443b-a708-22f67ee22ba0_t3p0i2aldevstack@QuobyteHD {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:40:18 devstack sudo[104209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ff24071-5fc7-443b-a708-22f67ee22ba0_t3p0i2aldevstack@QuobyteHD
Jul 14 16:40:18 devstack sudo[104209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:40:19 devstack sudo[104209]: pam_unix(sudo:session): session closed for user root
Jul 14 16:40:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1c80515c-b631-48cc-a341-b1fcb3f0d81e tempest-VolumeImageDependencyTests-720961631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ff24071-5fc7-443b-a708-22f67ee22ba0_t3p0i2aldevstack@QuobyteHD" returned: 0 in 0.329s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:40:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1c80515c-b631-48cc-a341-b1fcb3f0d81e tempest-VolumeImageDependencyTests-720961631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ff24071-5fc7-443b-a708-22f67ee22ba0_t3p0i2aldevstack@QuobyteHD {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:40:19 devstack sudo[104213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ff24071-5fc7-443b-a708-22f67ee22ba0_t3p0i2aldevstack@QuobyteHD
Jul 14 16:40:19 devstack sudo[104213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:40:19 devstack sudo[104213]: pam_unix(sudo:session): session closed for user root
Jul 14 16:40:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1c80515c-b631-48cc-a341-b1fcb3f0d81e tempest-VolumeImageDependencyTests-720961631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ff24071-5fc7-443b-a708-22f67ee22ba0_t3p0i2aldevstack@QuobyteHD" returned: 1 in 0.316s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:40:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1c80515c-b631-48cc-a341-b1fcb3f0d81e tempest-VolumeImageDependencyTests-720961631 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ff24071-5fc7-443b-a708-22f67ee22ba0_t3p0i2aldevstack@QuobyteHD' failed. Not Retrying. {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 16:40:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1c80515c-b631-48cc-a341-b1fcb3f0d81e tempest-VolumeImageDependencyTests-720961631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:40:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1c80515c-b631-48cc-a341-b1fcb3f0d81e tempest-VolumeImageDependencyTests-720961631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:40:19 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-1c80515c-b631-48cc-a341-b1fcb3f0d81e tempest-VolumeImageDependencyTests-720961631 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:40:17Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6970a7b0-a104-4d0f-9433-523caf4e9a01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ba6d3995250492180e1ca21687fe8d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:40:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:40:18Z,use_quota=True,user_id='4d8ac2d552c3459eb832f5f256451a1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:40:19 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-1c80515c-b631-48cc-a341-b1fcb3f0d81e tempest-VolumeImageDependencyTests-720961631 None] Creating volume 6970a7b0-a104-4d0f-9433-523caf4e9a01 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:40:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1c80515c-b631-48cc-a341-b1fcb3f0d81e tempest-VolumeImageDependencyTests-720961631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:40:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1c80515c-b631-48cc-a341-b1fcb3f0d81e tempest-VolumeImageDependencyTests-720961631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:40:19 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-1c80515c-b631-48cc-a341-b1fcb3f0d81e tempest-VolumeImageDependencyTests-720961631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:40:19 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-1c80515c-b631-48cc-a341-b1fcb3f0d81e tempest-VolumeImageDependencyTests-720961631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:40:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1c80515c-b631-48cc-a341-b1fcb3f0d81e tempest-VolumeImageDependencyTests-720961631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:40:19 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-1c80515c-b631-48cc-a341-b1fcb3f0d81e tempest-VolumeImageDependencyTests-720961631 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:40:19 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-1c80515c-b631-48cc-a341-b1fcb3f0d81e tempest-VolumeImageDependencyTests-720961631 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:40:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1c80515c-b631-48cc-a341-b1fcb3f0d81e tempest-VolumeImageDependencyTests-720961631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6970a7b0-a104-4d0f-9433-523caf4e9a01 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:40:19 devstack sudo[104218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6970a7b0-a104-4d0f-9433-523caf4e9a01 1073741824
Jul 14 16:40:19 devstack sudo[104218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:40:19 devstack sudo[104218]: pam_unix(sudo:session): session closed for user root
Jul 14 16:40:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1c80515c-b631-48cc-a341-b1fcb3f0d81e tempest-VolumeImageDependencyTests-720961631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6970a7b0-a104-4d0f-9433-523caf4e9a01 1073741824" returned: 0 in 0.407s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:40:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1c80515c-b631-48cc-a341-b1fcb3f0d81e tempest-VolumeImageDependencyTests-720961631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6970a7b0-a104-4d0f-9433-523caf4e9a01 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:40:19 devstack sudo[104224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6970a7b0-a104-4d0f-9433-523caf4e9a01
Jul 14 16:40:19 devstack sudo[104224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:40:20 devstack sudo[104224]: pam_unix(sudo:session): session closed for user root
Jul 14 16:40:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1c80515c-b631-48cc-a341-b1fcb3f0d81e tempest-VolumeImageDependencyTests-720961631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6970a7b0-a104-4d0f-9433-523caf4e9a01" returned: 0 in 0.247s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:40:20 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-1c80515c-b631-48cc-a341-b1fcb3f0d81e tempest-VolumeImageDependencyTests-720961631 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:40:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1c80515c-b631-48cc-a341-b1fcb3f0d81e tempest-VolumeImageDependencyTests-720961631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.698s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:40:20 devstack cinder-volume[87166]: DEBUG cinder.volume.volume_utils [None req-1c80515c-b631-48cc-a341-b1fcb3f0d81e tempest-VolumeImageDependencyTests-720961631 None] Attempting download of 5ff24071-5fc7-443b-a708-22f67ee22ba0 ((None, [{'url': 'file:///opt/stack/data/glance/images/5ff24071-5fc7-443b-a708-22f67ee22ba0', 'metadata': {}}])) to volume 6970a7b0-a104-4d0f-9433-523caf4e9a01. {{(pid=87166) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 14 16:40:20 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd4bae9-c6ac-4820-ab12-92096d3edfd2]: (4, 'raw') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:40:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1c80515c-b631-48cc-a341-b1fcb3f0d81e tempest-VolumeImageDependencyTests-720961631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5ff24071-5fc7-443b-a708-22f67ee22ba0_kx1b0b7n {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:40:20 devstack sudo[104227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5ff24071-5fc7-443b-a708-22f67ee22ba0_kx1b0b7n
Jul 14 16:40:20 devstack sudo[104227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:40:20 devstack sudo[104227]: pam_unix(sudo:session): session closed for user root
Jul 14 16:40:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1c80515c-b631-48cc-a341-b1fcb3f0d81e tempest-VolumeImageDependencyTests-720961631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5ff24071-5fc7-443b-a708-22f67ee22ba0_kx1b0b7n" returned: 0 in 0.322s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:40:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1c80515c-b631-48cc-a341-b1fcb3f0d81e tempest-VolumeImageDependencyTests-720961631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5ff24071-5fc7-443b-a708-22f67ee22ba0_kx1b0b7n {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:40:20 devstack sudo[104231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5ff24071-5fc7-443b-a708-22f67ee22ba0_kx1b0b7n
Jul 14 16:40:20 devstack sudo[104231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:40:20 devstack sudo[104231]: pam_unix(sudo:session): session closed for user root
Jul 14 16:40:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1c80515c-b631-48cc-a341-b1fcb3f0d81e tempest-VolumeImageDependencyTests-720961631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5ff24071-5fc7-443b-a708-22f67ee22ba0_kx1b0b7n" returned: 1 in 0.332s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:40:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1c80515c-b631-48cc-a341-b1fcb3f0d81e tempest-VolumeImageDependencyTests-720961631 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5ff24071-5fc7-443b-a708-22f67ee22ba0_kx1b0b7n' failed. Not Retrying. {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 16:40:20 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccffdc7d-db26-4984-b679-9bd808f1f506]: (4, 'raw') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:40:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1c80515c-b631-48cc-a341-b1fcb3f0d81e tempest-VolumeImageDependencyTests-720961631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ff24071-5fc7-443b-a708-22f67ee22ba0_t3p0i2aldevstack@QuobyteHD {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:40:20 devstack sudo[104235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ff24071-5fc7-443b-a708-22f67ee22ba0_t3p0i2aldevstack@QuobyteHD
Jul 14 16:40:20 devstack sudo[104235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:40:21 devstack sudo[104235]: pam_unix(sudo:session): session closed for user root
Jul 14 16:40:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1c80515c-b631-48cc-a341-b1fcb3f0d81e tempest-VolumeImageDependencyTests-720961631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ff24071-5fc7-443b-a708-22f67ee22ba0_t3p0i2aldevstack@QuobyteHD" returned: 0 in 0.331s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:40:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1c80515c-b631-48cc-a341-b1fcb3f0d81e tempest-VolumeImageDependencyTests-720961631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ff24071-5fc7-443b-a708-22f67ee22ba0_t3p0i2aldevstack@QuobyteHD {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:40:21 devstack sudo[104239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ff24071-5fc7-443b-a708-22f67ee22ba0_t3p0i2aldevstack@QuobyteHD
Jul 14 16:40:21 devstack sudo[104239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:40:21 devstack sudo[104239]: pam_unix(sudo:session): session closed for user root
Jul 14 16:40:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1c80515c-b631-48cc-a341-b1fcb3f0d81e tempest-VolumeImageDependencyTests-720961631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ff24071-5fc7-443b-a708-22f67ee22ba0_t3p0i2aldevstack@QuobyteHD" returned: 1 in 0.319s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:40:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1c80515c-b631-48cc-a341-b1fcb3f0d81e tempest-VolumeImageDependencyTests-720961631 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ff24071-5fc7-443b-a708-22f67ee22ba0_t3p0i2aldevstack@QuobyteHD' failed. Not Retrying. {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 16:40:21 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-1c80515c-b631-48cc-a341-b1fcb3f0d81e tempest-VolumeImageDependencyTests-720961631 None] 5ff24071-5fc7-443b-a708-22f67ee22ba0 was raw, converting to raw {{(pid=87166) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 14 16:40:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1c80515c-b631-48cc-a341-b1fcb3f0d81e tempest-VolumeImageDependencyTests-720961631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_5ff24071-5fc7-443b-a708-22f67ee22ba0_t3p0i2aldevstack@QuobyteHD /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6970a7b0-a104-4d0f-9433-523caf4e9a01 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:40:21 devstack sudo[104244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_5ff24071-5fc7-443b-a708-22f67ee22ba0_t3p0i2aldevstack@QuobyteHD /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6970a7b0-a104-4d0f-9433-523caf4e9a01
Jul 14 16:40:21 devstack sudo[104244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:40:21 devstack sudo[104244]: pam_unix(sudo:session): session closed for user root
Jul 14 16:40:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1c80515c-b631-48cc-a341-b1fcb3f0d81e tempest-VolumeImageDependencyTests-720961631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_5ff24071-5fc7-443b-a708-22f67ee22ba0_t3p0i2aldevstack@QuobyteHD /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6970a7b0-a104-4d0f-9433-523caf4e9a01" returned: 0 in 0.328s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:40:21 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-1c80515c-b631-48cc-a341-b1fcb3f0d81e tempest-VolumeImageDependencyTests-720961631 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5ff24071-5fc7-443b-a708-22f67ee22ba0_t3p0i2aldevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6970a7b0-a104-4d0f-9433-523caf4e9a01 {{(pid=87166) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 14 16:40:21 devstack cinder-volume[87166]: INFO cinder.image.image_utils [None req-1c80515c-b631-48cc-a341-b1fcb3f0d81e tempest-VolumeImageDependencyTests-720961631 None] Converted 0.00 MB image at 0.00 MB/s
Jul 14 16:40:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1c80515c-b631-48cc-a341-b1fcb3f0d81e tempest-VolumeImageDependencyTests-720961631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6970a7b0-a104-4d0f-9433-523caf4e9a01 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:40:21 devstack sudo[104249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6970a7b0-a104-4d0f-9433-523caf4e9a01 1G
Jul 14 16:40:21 devstack sudo[104249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:40:22 devstack sudo[104249]: pam_unix(sudo:session): session closed for user root
Jul 14 16:40:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1c80515c-b631-48cc-a341-b1fcb3f0d81e tempest-VolumeImageDependencyTests-720961631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6970a7b0-a104-4d0f-9433-523caf4e9a01 1G" returned: 0 in 0.274s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:40:22 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fec8eaf-53fe-4c7a-9eb9-0f59cd8d5733]: (4, 'raw') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:40:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1c80515c-b631-48cc-a341-b1fcb3f0d81e tempest-VolumeImageDependencyTests-720961631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6970a7b0-a104-4d0f-9433-523caf4e9a01 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:40:22 devstack sudo[104254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6970a7b0-a104-4d0f-9433-523caf4e9a01
Jul 14 16:40:22 devstack sudo[104254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:40:22 devstack sudo[104254]: pam_unix(sudo:session): session closed for user root
Jul 14 16:40:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1c80515c-b631-48cc-a341-b1fcb3f0d81e tempest-VolumeImageDependencyTests-720961631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6970a7b0-a104-4d0f-9433-523caf4e9a01" returned: 0 in 0.347s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:40:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1c80515c-b631-48cc-a341-b1fcb3f0d81e tempest-VolumeImageDependencyTests-720961631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6970a7b0-a104-4d0f-9433-523caf4e9a01 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:40:22 devstack sudo[104258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6970a7b0-a104-4d0f-9433-523caf4e9a01
Jul 14 16:40:22 devstack sudo[104258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:40:22 devstack sudo[104258]: pam_unix(sudo:session): session closed for user root
Jul 14 16:40:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1c80515c-b631-48cc-a341-b1fcb3f0d81e tempest-VolumeImageDependencyTests-720961631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6970a7b0-a104-4d0f-9433-523caf4e9a01" returned: 1 in 0.343s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:40:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1c80515c-b631-48cc-a341-b1fcb3f0d81e tempest-VolumeImageDependencyTests-720961631 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6970a7b0-a104-4d0f-9433-523caf4e9a01' failed. Not Retrying. {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 16:40:22 devstack cinder-volume[87166]: DEBUG cinder.volume.volume_utils [None req-1c80515c-b631-48cc-a341-b1fcb3f0d81e tempest-VolumeImageDependencyTests-720961631 None] Downloaded image 5ff24071-5fc7-443b-a708-22f67ee22ba0 ((None, [{'url': 'file:///opt/stack/data/glance/images/5ff24071-5fc7-443b-a708-22f67ee22ba0', 'metadata': {}}])) to volume 6970a7b0-a104-4d0f-9433-523caf4e9a01 successfully. {{(pid=87166) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 14 16:40:22 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-1c80515c-b631-48cc-a341-b1fcb3f0d81e tempest-VolumeImageDependencyTests-720961631 None] Temporary image 5ff24071-5fc7-443b-a708-22f67ee22ba0 for user 4d8ac2d552c3459eb832f5f256451a1f is deleted. {{(pid=87166) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 14 16:40:22 devstack cinder-volume[87166]: DEBUG cinder.volume.volume_utils [None req-1c80515c-b631-48cc-a341-b1fcb3f0d81e tempest-VolumeImageDependencyTests-720961631 None] Marking volume 6970a7b0-a104-4d0f-9433-523caf4e9a01 as bootable. {{(pid=87166) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 14 16:40:22 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c80515c-b631-48cc-a341-b1fcb3f0d81e tempest-VolumeImageDependencyTests-720961631 None] Copying metadata from image 5ff24071-5fc7-443b-a708-22f67ee22ba0 to 6970a7b0-a104-4d0f-9433-523caf4e9a01. {{(pid=87166) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 14 16:40:22 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c80515c-b631-48cc-a341-b1fcb3f0d81e tempest-VolumeImageDependencyTests-720961631 None] Creating volume glance metadata for volume 6970a7b0-a104-4d0f-9433-523caf4e9a01 backed by image 5ff24071-5fc7-443b-a708-22f67ee22ba0 with: {'image_id': '5ff24071-5fc7-443b-a708-22f67ee22ba0', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '7cf3aaeeece81fc2ced7319e9799247b', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87166) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 14 16:40:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1c80515c-b631-48cc-a341-b1fcb3f0d81e tempest-VolumeImageDependencyTests-720961631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f1d4df0-6a76-47d6-84bd-c2f694c59211) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6970a7b0-a104-4d0f-9433-523caf4e9a01', 'volume_size': 1, 'image_id': '5ff24071-5fc7-443b-a708-22f67ee22ba0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5ff24071-5fc7-443b-a708-22f67ee22ba0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7cf3aaeeece81fc2ced7319e9799247b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8ba6d3995250492180e1ca21687fe8d6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '98227490e756c533b0eeae06e057a2da727090856bbc8038b5b9b19d4469070eb07e1cd0046740ab3e78ad4ee55fa2d24fbe390f6b3af46688badf1c739e3769', 'id': '5ff24071-5fc7-443b-a708-22f67ee22ba0', 'created_at': datetime.datetime(2026, 7, 14, 14, 40, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 14, 40, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5ff24071-5fc7-443b-a708-22f67ee22ba0/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74f776a966f0>}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:40:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1c80515c-b631-48cc-a341-b1fcb3f0d81e tempest-VolumeImageDependencyTests-720961631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d11d926-0921-4c7b-970c-933bdfec9fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:40:22 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-1c80515c-b631-48cc-a341-b1fcb3f0d81e tempest-VolumeImageDependencyTests-720961631 None] Volume volume-6970a7b0-a104-4d0f-9433-523caf4e9a01 (6970a7b0-a104-4d0f-9433-523caf4e9a01): created successfully
Jul 14 16:40:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1c80515c-b631-48cc-a341-b1fcb3f0d81e tempest-VolumeImageDependencyTests-720961631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d11d926-0921-4c7b-970c-933bdfec9fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:40:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1c80515c-b631-48cc-a341-b1fcb3f0d81e tempest-VolumeImageDependencyTests-720961631 None] Flow 'volume_create_manager' (d4ea5035-8e32-4d39-8070-7db646ba036a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:40:22 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-1c80515c-b631-48cc-a341-b1fcb3f0d81e tempest-VolumeImageDependencyTests-720961631 None] Created volume successfully.
Jul 14 16:40:23 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e3a9aa03-f196-4be2-83d0-e96ca8b7c11c tempest-VolumeImageDependencyTests-720961631 None] Acquiring lock "cinder-6970a7b0-a104-4d0f-9433-523caf4e9a01-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:40:23 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e3a9aa03-f196-4be2-83d0-e96ca8b7c11c tempest-VolumeImageDependencyTests-720961631 None] Lock "cinder-6970a7b0-a104-4d0f-9433-523caf4e9a01-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:40:24 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e3a9aa03-f196-4be2-83d0-e96ca8b7c11c tempest-VolumeImageDependencyTests-720961631 None] Acquiring lock "cinder-quobyte-6970a7b0-a104-4d0f-9433-523caf4e9a01" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:40:24 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e3a9aa03-f196-4be2-83d0-e96ca8b7c11c tempest-VolumeImageDependencyTests-720961631 None] Lock "cinder-quobyte-6970a7b0-a104-4d0f-9433-523caf4e9a01" acquired by "delete_volume" :: waited 0.014s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:40:24 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7cf635d-ea89-4b6e-98f9-b9ee800a2e98]: (4, 'raw') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:40:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e3a9aa03-f196-4be2-83d0-e96ca8b7c11c tempest-VolumeImageDependencyTests-720961631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6970a7b0-a104-4d0f-9433-523caf4e9a01 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:40:24 devstack sudo[104263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6970a7b0-a104-4d0f-9433-523caf4e9a01
Jul 14 16:40:24 devstack sudo[104263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:40:24 devstack sudo[104263]: pam_unix(sudo:session): session closed for user root
Jul 14 16:40:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e3a9aa03-f196-4be2-83d0-e96ca8b7c11c tempest-VolumeImageDependencyTests-720961631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6970a7b0-a104-4d0f-9433-523caf4e9a01" returned: 0 in 0.349s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:40:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e3a9aa03-f196-4be2-83d0-e96ca8b7c11c tempest-VolumeImageDependencyTests-720961631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6970a7b0-a104-4d0f-9433-523caf4e9a01 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:40:24 devstack sudo[104267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6970a7b0-a104-4d0f-9433-523caf4e9a01
Jul 14 16:40:24 devstack sudo[104267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:40:24 devstack sudo[104267]: pam_unix(sudo:session): session closed for user root
Jul 14 16:40:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e3a9aa03-f196-4be2-83d0-e96ca8b7c11c tempest-VolumeImageDependencyTests-720961631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6970a7b0-a104-4d0f-9433-523caf4e9a01" returned: 1 in 0.347s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:40:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e3a9aa03-f196-4be2-83d0-e96ca8b7c11c tempest-VolumeImageDependencyTests-720961631 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6970a7b0-a104-4d0f-9433-523caf4e9a01' failed. Not Retrying. {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 16:40:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e3a9aa03-f196-4be2-83d0-e96ca8b7c11c tempest-VolumeImageDependencyTests-720961631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6970a7b0-a104-4d0f-9433-523caf4e9a01 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:40:24 devstack sudo[104272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6970a7b0-a104-4d0f-9433-523caf4e9a01
Jul 14 16:40:24 devstack sudo[104272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:40:25 devstack sudo[104272]: pam_unix(sudo:session): session closed for user root
Jul 14 16:40:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e3a9aa03-f196-4be2-83d0-e96ca8b7c11c tempest-VolumeImageDependencyTests-720961631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6970a7b0-a104-4d0f-9433-523caf4e9a01" returned: 0 in 0.253s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:40:25 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e3a9aa03-f196-4be2-83d0-e96ca8b7c11c tempest-VolumeImageDependencyTests-720961631 None] Lock "cinder-quobyte-6970a7b0-a104-4d0f-9433-523caf4e9a01" released by "delete_volume" :: held 1.005s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:40:25 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-e3a9aa03-f196-4be2-83d0-e96ca8b7c11c tempest-VolumeImageDependencyTests-720961631 None] Created reservations ['47a409b6-46b8-491d-9d7c-f21c36e7e899', '8f08c629-a8ff-4610-a4db-d72c4eb718eb', '7b8f7b2a-38b9-4748-8639-cc5995b63e65', '8aeb253a-49bf-4a63-b95a-3b94b968662c'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:40:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e3a9aa03-f196-4be2-83d0-e96ca8b7c11c tempest-VolumeImageDependencyTests-720961631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:40:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e3a9aa03-f196-4be2-83d0-e96ca8b7c11c tempest-VolumeImageDependencyTests-720961631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:40:25 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-e3a9aa03-f196-4be2-83d0-e96ca8b7c11c tempest-VolumeImageDependencyTests-720961631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:40:25 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-e3a9aa03-f196-4be2-83d0-e96ca8b7c11c tempest-VolumeImageDependencyTests-720961631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:40:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e3a9aa03-f196-4be2-83d0-e96ca8b7c11c tempest-VolumeImageDependencyTests-720961631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:40:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e3a9aa03-f196-4be2-83d0-e96ca8b7c11c tempest-VolumeImageDependencyTests-720961631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:40:25 devstack sudo[104275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:40:25 devstack sudo[104275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:40:25 devstack sudo[104275]: pam_unix(sudo:session): session closed for user root
Jul 14 16:40:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e3a9aa03-f196-4be2-83d0-e96ca8b7c11c tempest-VolumeImageDependencyTests-720961631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.242s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:40:25 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-e3a9aa03-f196-4be2-83d0-e96ca8b7c11c tempest-VolumeImageDependencyTests-720961631 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:40:25 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-e3a9aa03-f196-4be2-83d0-e96ca8b7c11c tempest-VolumeImageDependencyTests-720961631 None] Deleted volume successfully.
Jul 14 16:40:25 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e3a9aa03-f196-4be2-83d0-e96ca8b7c11c tempest-VolumeImageDependencyTests-720961631 None] Lock "cinder-6970a7b0-a104-4d0f-9433-523caf4e9a01-delete_volume" released by "delete_volume" :: held 1.439s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:40:29 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-1233d1a4-ca51-4eda-aaa2-548c89148836 tempest-CinderUnicodeTest-1301854972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:40:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1233d1a4-ca51-4eda-aaa2-548c89148836 tempest-CinderUnicodeTest-1301854972 None] Flow 'volume_create_manager' (85093215-2534-4f35-b1be-f404302aad7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:40:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1233d1a4-ca51-4eda-aaa2-548c89148836 tempest-CinderUnicodeTest-1301854972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8758f599-72b6-40e3-bb6c-19c8e051668d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:40:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1233d1a4-ca51-4eda-aaa2-548c89148836 tempest-CinderUnicodeTest-1301854972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8758f599-72b6-40e3-bb6c-19c8e051668d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:40:29Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a89828a-a02a-4b99-b584-de33eb06bb34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78d71f586d3e4322968a60b226e76e8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:40:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:40:29Z,use_quota=True,user_id='ff4ff156d8b84d1bacd9c1b3b46b2635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:40:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1233d1a4-ca51-4eda-aaa2-548c89148836 tempest-CinderUnicodeTest-1301854972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61e081f9-08b1-4d4f-9896-f458d927cd9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:40:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1233d1a4-ca51-4eda-aaa2-548c89148836 tempest-CinderUnicodeTest-1301854972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61e081f9-08b1-4d4f-9896-f458d927cd9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:40:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1233d1a4-ca51-4eda-aaa2-548c89148836 tempest-CinderUnicodeTest-1301854972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68f77be6-eb6c-403c-a088-92fc3e60067b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:40:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1233d1a4-ca51-4eda-aaa2-548c89148836 tempest-CinderUnicodeTest-1301854972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68f77be6-eb6c-403c-a088-92fc3e60067b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a89828a-a02a-4b99-b584-de33eb06bb34', 'volume_name': 'volume-6a89828a-a02a-4b99-b584-de33eb06bb34', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:40:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1233d1a4-ca51-4eda-aaa2-548c89148836 tempest-CinderUnicodeTest-1301854972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45a74799-9a95-4a1d-82ab-c28b8a5367e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:40:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1233d1a4-ca51-4eda-aaa2-548c89148836 tempest-CinderUnicodeTest-1301854972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45a74799-9a95-4a1d-82ab-c28b8a5367e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:40:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1233d1a4-ca51-4eda-aaa2-548c89148836 tempest-CinderUnicodeTest-1301854972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac6c2604-174a-451c-ab3b-f0636c08f8e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:40:29 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-1233d1a4-ca51-4eda-aaa2-548c89148836 tempest-CinderUnicodeTest-1301854972 None] Volume 6a89828a-a02a-4b99-b584-de33eb06bb34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a89828a-a02a-4b99-b584-de33eb06bb34', 'volume_size': 1}
Jul 14 16:40:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1233d1a4-ca51-4eda-aaa2-548c89148836 tempest-CinderUnicodeTest-1301854972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:40:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1233d1a4-ca51-4eda-aaa2-548c89148836 tempest-CinderUnicodeTest-1301854972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:40:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-1233d1a4-ca51-4eda-aaa2-548c89148836 tempest-CinderUnicodeTest-1301854972 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:40:29Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a89828a-a02a-4b99-b584-de33eb06bb34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78d71f586d3e4322968a60b226e76e8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:40:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:40:29Z,use_quota=True,user_id='ff4ff156d8b84d1bacd9c1b3b46b2635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:40:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-1233d1a4-ca51-4eda-aaa2-548c89148836 tempest-CinderUnicodeTest-1301854972 None] Creating volume 6a89828a-a02a-4b99-b584-de33eb06bb34 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:40:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1233d1a4-ca51-4eda-aaa2-548c89148836 tempest-CinderUnicodeTest-1301854972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:40:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1233d1a4-ca51-4eda-aaa2-548c89148836 tempest-CinderUnicodeTest-1301854972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:40:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-1233d1a4-ca51-4eda-aaa2-548c89148836 tempest-CinderUnicodeTest-1301854972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:40:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-1233d1a4-ca51-4eda-aaa2-548c89148836 tempest-CinderUnicodeTest-1301854972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:40:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1233d1a4-ca51-4eda-aaa2-548c89148836 tempest-CinderUnicodeTest-1301854972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:40:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-1233d1a4-ca51-4eda-aaa2-548c89148836 tempest-CinderUnicodeTest-1301854972 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:40:29 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-1233d1a4-ca51-4eda-aaa2-548c89148836 tempest-CinderUnicodeTest-1301854972 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:40:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1233d1a4-ca51-4eda-aaa2-548c89148836 tempest-CinderUnicodeTest-1301854972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6a89828a-a02a-4b99-b584-de33eb06bb34 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:40:29 devstack sudo[104279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6a89828a-a02a-4b99-b584-de33eb06bb34 1073741824
Jul 14 16:40:29 devstack sudo[104279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:40:29 devstack sudo[104279]: pam_unix(sudo:session): session closed for user root
Jul 14 16:40:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1233d1a4-ca51-4eda-aaa2-548c89148836 tempest-CinderUnicodeTest-1301854972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6a89828a-a02a-4b99-b584-de33eb06bb34 1073741824" returned: 0 in 0.419s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:40:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1233d1a4-ca51-4eda-aaa2-548c89148836 tempest-CinderUnicodeTest-1301854972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6a89828a-a02a-4b99-b584-de33eb06bb34 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:40:29 devstack sudo[104285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6a89828a-a02a-4b99-b584-de33eb06bb34
Jul 14 16:40:29 devstack sudo[104285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:40:29 devstack sudo[104285]: pam_unix(sudo:session): session closed for user root
Jul 14 16:40:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1233d1a4-ca51-4eda-aaa2-548c89148836 tempest-CinderUnicodeTest-1301854972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6a89828a-a02a-4b99-b584-de33eb06bb34" returned: 0 in 0.243s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:40:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-1233d1a4-ca51-4eda-aaa2-548c89148836 tempest-CinderUnicodeTest-1301854972 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:40:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1233d1a4-ca51-4eda-aaa2-548c89148836 tempest-CinderUnicodeTest-1301854972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:40:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1233d1a4-ca51-4eda-aaa2-548c89148836 tempest-CinderUnicodeTest-1301854972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac6c2604-174a-451c-ab3b-f0636c08f8e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a89828a-a02a-4b99-b584-de33eb06bb34', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:40:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1233d1a4-ca51-4eda-aaa2-548c89148836 tempest-CinderUnicodeTest-1301854972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98063da8-d0d3-48a8-8c44-8e94ab293251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:40:29 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-1233d1a4-ca51-4eda-aaa2-548c89148836 tempest-CinderUnicodeTest-1301854972 None] Volume volume-6a89828a-a02a-4b99-b584-de33eb06bb34 (6a89828a-a02a-4b99-b584-de33eb06bb34): created successfully
Jul 14 16:40:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1233d1a4-ca51-4eda-aaa2-548c89148836 tempest-CinderUnicodeTest-1301854972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98063da8-d0d3-48a8-8c44-8e94ab293251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:40:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1233d1a4-ca51-4eda-aaa2-548c89148836 tempest-CinderUnicodeTest-1301854972 None] Flow 'volume_create_manager' (85093215-2534-4f35-b1be-f404302aad7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:40:29 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-1233d1a4-ca51-4eda-aaa2-548c89148836 tempest-CinderUnicodeTest-1301854972 None] Created volume successfully.
Jul 14 16:40:30 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-a39c36c6-9241-4231-98a1-7ac5ad4c6054 tempest-CinderUnicodeTest-1301854972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:40:30 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a39c36c6-9241-4231-98a1-7ac5ad4c6054 tempest-CinderUnicodeTest-1301854972 None] Flow 'volume_create_manager' (d10ca45c-20f1-4961-8520-48d97466ab58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:40:30 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a39c36c6-9241-4231-98a1-7ac5ad4c6054 tempest-CinderUnicodeTest-1301854972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eff83148-1198-4575-8602-ae048614e67b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:40:30 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a39c36c6-9241-4231-98a1-7ac5ad4c6054 tempest-CinderUnicodeTest-1301854972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eff83148-1198-4575-8602-ae048614e67b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:40:30Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-101834571',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bc03257-c2a2-42bf-bc41-125408ffff66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78d71f586d3e4322968a60b226e76e8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:40:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:40:30Z,use_quota=True,user_id='ff4ff156d8b84d1bacd9c1b3b46b2635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:40:30 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a39c36c6-9241-4231-98a1-7ac5ad4c6054 tempest-CinderUnicodeTest-1301854972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ec30ce1-9b58-4798-b09e-f142d7235a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:40:30 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a39c36c6-9241-4231-98a1-7ac5ad4c6054 tempest-CinderUnicodeTest-1301854972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ec30ce1-9b58-4798-b09e-f142d7235a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:40:30 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a39c36c6-9241-4231-98a1-7ac5ad4c6054 tempest-CinderUnicodeTest-1301854972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c340a1ae-9f6c-43d0-a50d-5afff272c19b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:40:30 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a39c36c6-9241-4231-98a1-7ac5ad4c6054 tempest-CinderUnicodeTest-1301854972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c340a1ae-9f6c-43d0-a50d-5afff272c19b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bc03257-c2a2-42bf-bc41-125408ffff66', 'volume_name': 'volume-8bc03257-c2a2-42bf-bc41-125408ffff66', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:40:30 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a39c36c6-9241-4231-98a1-7ac5ad4c6054 tempest-CinderUnicodeTest-1301854972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35b0a4f8-6ecd-4d72-ba1b-d7d730430c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:40:30 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a39c36c6-9241-4231-98a1-7ac5ad4c6054 tempest-CinderUnicodeTest-1301854972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35b0a4f8-6ecd-4d72-ba1b-d7d730430c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:40:30 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a39c36c6-9241-4231-98a1-7ac5ad4c6054 tempest-CinderUnicodeTest-1301854972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (456cf07f-6a9d-4fad-b651-d5b81f2c3e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:40:30 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-a39c36c6-9241-4231-98a1-7ac5ad4c6054 tempest-CinderUnicodeTest-1301854972 None] Volume 8bc03257-c2a2-42bf-bc41-125408ffff66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bc03257-c2a2-42bf-bc41-125408ffff66', 'volume_size': 1}
Jul 14 16:40:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a39c36c6-9241-4231-98a1-7ac5ad4c6054 tempest-CinderUnicodeTest-1301854972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:40:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a39c36c6-9241-4231-98a1-7ac5ad4c6054 tempest-CinderUnicodeTest-1301854972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:40:30 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a39c36c6-9241-4231-98a1-7ac5ad4c6054 tempest-CinderUnicodeTest-1301854972 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:40:30Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-101834571',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bc03257-c2a2-42bf-bc41-125408ffff66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78d71f586d3e4322968a60b226e76e8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:40:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:40:30Z,use_quota=True,user_id='ff4ff156d8b84d1bacd9c1b3b46b2635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:40:30 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-a39c36c6-9241-4231-98a1-7ac5ad4c6054 tempest-CinderUnicodeTest-1301854972 None] Creating volume 8bc03257-c2a2-42bf-bc41-125408ffff66 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:40:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a39c36c6-9241-4231-98a1-7ac5ad4c6054 tempest-CinderUnicodeTest-1301854972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:40:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a39c36c6-9241-4231-98a1-7ac5ad4c6054 tempest-CinderUnicodeTest-1301854972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:40:30 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a39c36c6-9241-4231-98a1-7ac5ad4c6054 tempest-CinderUnicodeTest-1301854972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:40:30 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a39c36c6-9241-4231-98a1-7ac5ad4c6054 tempest-CinderUnicodeTest-1301854972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:40:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a39c36c6-9241-4231-98a1-7ac5ad4c6054 tempest-CinderUnicodeTest-1301854972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:40:30 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a39c36c6-9241-4231-98a1-7ac5ad4c6054 tempest-CinderUnicodeTest-1301854972 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:40:30 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-a39c36c6-9241-4231-98a1-7ac5ad4c6054 tempest-CinderUnicodeTest-1301854972 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:40:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a39c36c6-9241-4231-98a1-7ac5ad4c6054 tempest-CinderUnicodeTest-1301854972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8bc03257-c2a2-42bf-bc41-125408ffff66 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:40:30 devstack sudo[104288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8bc03257-c2a2-42bf-bc41-125408ffff66 1073741824
Jul 14 16:40:30 devstack sudo[104288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:40:31 devstack sudo[104288]: pam_unix(sudo:session): session closed for user root
Jul 14 16:40:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a39c36c6-9241-4231-98a1-7ac5ad4c6054 tempest-CinderUnicodeTest-1301854972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8bc03257-c2a2-42bf-bc41-125408ffff66 1073741824" returned: 0 in 0.394s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:40:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a39c36c6-9241-4231-98a1-7ac5ad4c6054 tempest-CinderUnicodeTest-1301854972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8bc03257-c2a2-42bf-bc41-125408ffff66 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:40:31 devstack sudo[104294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8bc03257-c2a2-42bf-bc41-125408ffff66
Jul 14 16:40:31 devstack sudo[104294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:40:31 devstack sudo[104294]: pam_unix(sudo:session): session closed for user root
Jul 14 16:40:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a39c36c6-9241-4231-98a1-7ac5ad4c6054 tempest-CinderUnicodeTest-1301854972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8bc03257-c2a2-42bf-bc41-125408ffff66" returned: 0 in 0.242s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:40:31 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a39c36c6-9241-4231-98a1-7ac5ad4c6054 tempest-CinderUnicodeTest-1301854972 None] <== create_volume: return (675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:40:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a39c36c6-9241-4231-98a1-7ac5ad4c6054 tempest-CinderUnicodeTest-1301854972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.678s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:40:31 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a39c36c6-9241-4231-98a1-7ac5ad4c6054 tempest-CinderUnicodeTest-1301854972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (456cf07f-6a9d-4fad-b651-d5b81f2c3e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bc03257-c2a2-42bf-bc41-125408ffff66', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:40:31 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a39c36c6-9241-4231-98a1-7ac5ad4c6054 tempest-CinderUnicodeTest-1301854972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecb3bff6-cc9a-48c5-9985-3722b58cb414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:40:31 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-a39c36c6-9241-4231-98a1-7ac5ad4c6054 tempest-CinderUnicodeTest-1301854972 None] Volume volume-8bc03257-c2a2-42bf-bc41-125408ffff66 (8bc03257-c2a2-42bf-bc41-125408ffff66): created successfully
Jul 14 16:40:31 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a39c36c6-9241-4231-98a1-7ac5ad4c6054 tempest-CinderUnicodeTest-1301854972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecb3bff6-cc9a-48c5-9985-3722b58cb414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:40:31 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a39c36c6-9241-4231-98a1-7ac5ad4c6054 tempest-CinderUnicodeTest-1301854972 None] Flow 'volume_create_manager' (d10ca45c-20f1-4961-8520-48d97466ab58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:40:31 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-a39c36c6-9241-4231-98a1-7ac5ad4c6054 tempest-CinderUnicodeTest-1301854972 None] Created volume successfully.
Jul 14 16:40:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f89c16ce-fdac-44aa-98e9-8622c604c819 tempest-CinderUnicodeTest-1301854972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:40:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f89c16ce-fdac-44aa-98e9-8622c604c819 tempest-CinderUnicodeTest-1301854972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:40:31 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-f89c16ce-fdac-44aa-98e9-8622c604c819 tempest-CinderUnicodeTest-1301854972 None] Creating offline snapshot 997d5e6d-52b1-43bd-8ff4-006fb24c4b0e of volume 8bc03257-c2a2-42bf-bc41-125408ffff66 {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 16:40:31 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[29cc80be-baa2-4878-bf52-13efd40e559f]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:40:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f89c16ce-fdac-44aa-98e9-8622c604c819 tempest-CinderUnicodeTest-1301854972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8bc03257-c2a2-42bf-bc41-125408ffff66 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:40:31 devstack sudo[104297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8bc03257-c2a2-42bf-bc41-125408ffff66
Jul 14 16:40:31 devstack sudo[104297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:40:32 devstack sudo[104297]: pam_unix(sudo:session): session closed for user root
Jul 14 16:40:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f89c16ce-fdac-44aa-98e9-8622c604c819 tempest-CinderUnicodeTest-1301854972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8bc03257-c2a2-42bf-bc41-125408ffff66" returned: 0 in 0.348s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:40:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f89c16ce-fdac-44aa-98e9-8622c604c819 tempest-CinderUnicodeTest-1301854972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8bc03257-c2a2-42bf-bc41-125408ffff66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8bc03257-c2a2-42bf-bc41-125408ffff66.997d5e6d-52b1-43bd-8ff4-006fb24c4b0e 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:40:32 devstack sudo[104302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8bc03257-c2a2-42bf-bc41-125408ffff66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8bc03257-c2a2-42bf-bc41-125408ffff66.997d5e6d-52b1-43bd-8ff4-006fb24c4b0e 1G
Jul 14 16:40:32 devstack sudo[104302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:40:32 devstack sudo[104302]: pam_unix(sudo:session): session closed for user root
Jul 14 16:40:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f89c16ce-fdac-44aa-98e9-8622c604c819 tempest-CinderUnicodeTest-1301854972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8bc03257-c2a2-42bf-bc41-125408ffff66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8bc03257-c2a2-42bf-bc41-125408ffff66.997d5e6d-52b1-43bd-8ff4-006fb24c4b0e 1G" returned: 0 in 0.408s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:40:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f89c16ce-fdac-44aa-98e9-8622c604c819 tempest-CinderUnicodeTest-1301854972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8bc03257-c2a2-42bf-bc41-125408ffff66 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8bc03257-c2a2-42bf-bc41-125408ffff66.997d5e6d-52b1-43bd-8ff4-006fb24c4b0e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:40:32 devstack sudo[104307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8bc03257-c2a2-42bf-bc41-125408ffff66 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8bc03257-c2a2-42bf-bc41-125408ffff66.997d5e6d-52b1-43bd-8ff4-006fb24c4b0e
Jul 14 16:40:32 devstack sudo[104307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:40:32 devstack sudo[104307]: pam_unix(sudo:session): session closed for user root
Jul 14 16:40:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f89c16ce-fdac-44aa-98e9-8622c604c819 tempest-CinderUnicodeTest-1301854972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8bc03257-c2a2-42bf-bc41-125408ffff66 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8bc03257-c2a2-42bf-bc41-125408ffff66.997d5e6d-52b1-43bd-8ff4-006fb24c4b0e" returned: 0 in 0.293s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:40:32 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-f89c16ce-fdac-44aa-98e9-8622c604c819 tempest-CinderUnicodeTest-1301854972 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8bc03257-c2a2-42bf-bc41-125408ffff66.997d5e6d-52b1-43bd-8ff4-006fb24c4b0e is being set with open permissions: ugo+rw
Jul 14 16:40:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f89c16ce-fdac-44aa-98e9-8622c604c819 tempest-CinderUnicodeTest-1301854972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8bc03257-c2a2-42bf-bc41-125408ffff66.997d5e6d-52b1-43bd-8ff4-006fb24c4b0e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:40:32 devstack sudo[104312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8bc03257-c2a2-42bf-bc41-125408ffff66.997d5e6d-52b1-43bd-8ff4-006fb24c4b0e
Jul 14 16:40:32 devstack sudo[104312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:40:33 devstack sudo[104312]: pam_unix(sudo:session): session closed for user root
Jul 14 16:40:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f89c16ce-fdac-44aa-98e9-8622c604c819 tempest-CinderUnicodeTest-1301854972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8bc03257-c2a2-42bf-bc41-125408ffff66.997d5e6d-52b1-43bd-8ff4-006fb24c4b0e" returned: 0 in 0.238s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:40:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f89c16ce-fdac-44aa-98e9-8622c604c819 tempest-CinderUnicodeTest-1301854972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8bc03257-c2a2-42bf-bc41-125408ffff66.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:40:33 devstack sudo[104315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8bc03257-c2a2-42bf-bc41-125408ffff66.info
Jul 14 16:40:33 devstack sudo[104315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:40:33 devstack sudo[104315]: pam_unix(sudo:session): session closed for user root
Jul 14 16:40:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f89c16ce-fdac-44aa-98e9-8622c604c819 tempest-CinderUnicodeTest-1301854972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8bc03257-c2a2-42bf-bc41-125408ffff66.info" returned: 0 in 0.251s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:40:33 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-f89c16ce-fdac-44aa-98e9-8622c604c819 tempest-CinderUnicodeTest-1301854972 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8bc03257-c2a2-42bf-bc41-125408ffff66.info is being set with open permissions: ugo+rw
Jul 14 16:40:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f89c16ce-fdac-44aa-98e9-8622c604c819 tempest-CinderUnicodeTest-1301854972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8bc03257-c2a2-42bf-bc41-125408ffff66.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:40:33 devstack sudo[104318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8bc03257-c2a2-42bf-bc41-125408ffff66.info
Jul 14 16:40:33 devstack sudo[104318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:40:33 devstack sudo[104318]: pam_unix(sudo:session): session closed for user root
Jul 14 16:40:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f89c16ce-fdac-44aa-98e9-8622c604c819 tempest-CinderUnicodeTest-1301854972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8bc03257-c2a2-42bf-bc41-125408ffff66.info" returned: 0 in 0.251s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:40:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f89c16ce-fdac-44aa-98e9-8622c604c819 tempest-CinderUnicodeTest-1301854972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.874s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:40:33 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-f89c16ce-fdac-44aa-98e9-8622c604c819 tempest-CinderUnicodeTest-1301854972 None] Create snapshot completed successfully
Jul 14 16:40:33 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-5c126fe1-cd33-426f-8d34-6bd3b556ccca tempest-CinderUnicodeTest-1301854972 None] Acquiring lock "cinder-997d5e6d-52b1-43bd-8ff4-006fb24c4b0e-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:40:33 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-5c126fe1-cd33-426f-8d34-6bd3b556ccca tempest-CinderUnicodeTest-1301854972 None] Lock "cinder-997d5e6d-52b1-43bd-8ff4-006fb24c4b0e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:40:33 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-5c126fe1-cd33-426f-8d34-6bd3b556ccca tempest-CinderUnicodeTest-1301854972 None] Acquiring lock "cinder-quobyte-8bc03257-c2a2-42bf-bc41-125408ffff66" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:40:33 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-5c126fe1-cd33-426f-8d34-6bd3b556ccca tempest-CinderUnicodeTest-1301854972 None] Lock "cinder-quobyte-8bc03257-c2a2-42bf-bc41-125408ffff66" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:40:33 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-5c126fe1-cd33-426f-8d34-6bd3b556ccca tempest-CinderUnicodeTest-1301854972 None] Acquiring lock "cinder-quobyte-997d5e6d-52b1-43bd-8ff4-006fb24c4b0e" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:40:33 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-5c126fe1-cd33-426f-8d34-6bd3b556ccca tempest-CinderUnicodeTest-1301854972 None] Lock "cinder-quobyte-997d5e6d-52b1-43bd-8ff4-006fb24c4b0e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:40:33 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-5c126fe1-cd33-426f-8d34-6bd3b556ccca tempest-CinderUnicodeTest-1301854972 None] Deleting offline snapshot 997d5e6d-52b1-43bd-8ff4-006fb24c4b0e of volume 8bc03257-c2a2-42bf-bc41-125408ffff66 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 16:40:33 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-5c126fe1-cd33-426f-8d34-6bd3b556ccca tempest-CinderUnicodeTest-1301854972 None] snapshot_file for this snap is: volume-8bc03257-c2a2-42bf-bc41-125408ffff66.997d5e6d-52b1-43bd-8ff4-006fb24c4b0e {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 16:40:33 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a6a525-76d8-4150-83de-1fb4a9055e89]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:40:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5c126fe1-cd33-426f-8d34-6bd3b556ccca tempest-CinderUnicodeTest-1301854972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8bc03257-c2a2-42bf-bc41-125408ffff66.997d5e6d-52b1-43bd-8ff4-006fb24c4b0e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:40:34 devstack sudo[104322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8bc03257-c2a2-42bf-bc41-125408ffff66.997d5e6d-52b1-43bd-8ff4-006fb24c4b0e
Jul 14 16:40:34 devstack sudo[104322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:40:34 devstack sudo[104322]: pam_unix(sudo:session): session closed for user root
Jul 14 16:40:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5c126fe1-cd33-426f-8d34-6bd3b556ccca tempest-CinderUnicodeTest-1301854972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8bc03257-c2a2-42bf-bc41-125408ffff66.997d5e6d-52b1-43bd-8ff4-006fb24c4b0e" returned: 0 in 0.348s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:40:34 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-5c126fe1-cd33-426f-8d34-6bd3b556ccca tempest-CinderUnicodeTest-1301854972 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8bc03257-c2a2-42bf-bc41-125408ffff66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 16:40:34 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5da19a5-7fe1-4939-8d6e-fa873eb68a80]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:40:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5c126fe1-cd33-426f-8d34-6bd3b556ccca tempest-CinderUnicodeTest-1301854972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8bc03257-c2a2-42bf-bc41-125408ffff66 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:40:34 devstack sudo[104328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8bc03257-c2a2-42bf-bc41-125408ffff66
Jul 14 16:40:34 devstack sudo[104328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:40:34 devstack sudo[104328]: pam_unix(sudo:session): session closed for user root
Jul 14 16:40:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5c126fe1-cd33-426f-8d34-6bd3b556ccca tempest-CinderUnicodeTest-1301854972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8bc03257-c2a2-42bf-bc41-125408ffff66" returned: 0 in 0.356s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:40:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5c126fe1-cd33-426f-8d34-6bd3b556ccca tempest-CinderUnicodeTest-1301854972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8bc03257-c2a2-42bf-bc41-125408ffff66.997d5e6d-52b1-43bd-8ff4-006fb24c4b0e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:40:34 devstack sudo[104333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8bc03257-c2a2-42bf-bc41-125408ffff66.997d5e6d-52b1-43bd-8ff4-006fb24c4b0e
Jul 14 16:40:34 devstack sudo[104333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:40:35 devstack sudo[104333]: pam_unix(sudo:session): session closed for user root
Jul 14 16:40:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5c126fe1-cd33-426f-8d34-6bd3b556ccca tempest-CinderUnicodeTest-1301854972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8bc03257-c2a2-42bf-bc41-125408ffff66.997d5e6d-52b1-43bd-8ff4-006fb24c4b0e" returned: 0 in 0.342s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:40:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5c126fe1-cd33-426f-8d34-6bd3b556ccca tempest-CinderUnicodeTest-1301854972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8bc03257-c2a2-42bf-bc41-125408ffff66.997d5e6d-52b1-43bd-8ff4-006fb24c4b0e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:40:35 devstack sudo[104338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8bc03257-c2a2-42bf-bc41-125408ffff66.997d5e6d-52b1-43bd-8ff4-006fb24c4b0e
Jul 14 16:40:35 devstack sudo[104338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:40:35 devstack sudo[104338]: pam_unix(sudo:session): session closed for user root
Jul 14 16:40:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5c126fe1-cd33-426f-8d34-6bd3b556ccca tempest-CinderUnicodeTest-1301854972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8bc03257-c2a2-42bf-bc41-125408ffff66.997d5e6d-52b1-43bd-8ff4-006fb24c4b0e" returned: 0 in 0.248s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:40:35 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-5c126fe1-cd33-426f-8d34-6bd3b556ccca tempest-CinderUnicodeTest-1301854972 None] Lock "cinder-quobyte-997d5e6d-52b1-43bd-8ff4-006fb24c4b0e" released by "_delete_snapshot" :: held 1.391s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:40:35 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-5c126fe1-cd33-426f-8d34-6bd3b556ccca tempest-CinderUnicodeTest-1301854972 None] Lock "cinder-quobyte-8bc03257-c2a2-42bf-bc41-125408ffff66" released by "delete_snapshot" :: held 1.414s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:40:35 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-5c126fe1-cd33-426f-8d34-6bd3b556ccca tempest-CinderUnicodeTest-1301854972 None] Created reservations ['2d357deb-d459-4201-9013-69c47f6619e7', '34d87dcb-a299-43b8-8184-997ddf8c96a7', 'fa09b915-549e-47f5-918e-dba1f7ec37b2', '3318c27a-05c0-4a10-8ac0-e7da4c743144'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:40:35 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 16:40:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:40:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:40:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:40:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:40:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:40:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:40:35 devstack sudo[104341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:40:35 devstack sudo[104341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:40:35 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-5c126fe1-cd33-426f-8d34-6bd3b556ccca tempest-CinderUnicodeTest-1301854972 None] Delete snapshot completed successfully.
Jul 14 16:40:35 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-5c126fe1-cd33-426f-8d34-6bd3b556ccca tempest-CinderUnicodeTest-1301854972 None] Lock "cinder-997d5e6d-52b1-43bd-8ff4-006fb24c4b0e-delete_snapshot" released by "delete_snapshot" :: held 1.558s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:40:35 devstack sudo[104341]: pam_unix(sudo:session): session closed for user root
Jul 14 16:40:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.241s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:40:35 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:40:35 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Running periodic task VolumeManager._thread_info {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 16:40:35 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] thread count: 29 {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 14 16:40:35 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] thread info: [<_MainThread(MainThread, started 128606490927232)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128606415432960)>, <Thread(Thread-3 (stat_writer), started daemon 128606378859328)>, <Thread(Rabbit-heartbeat, started daemon 128606379646144)>, <Thread(Thread-5 (_runner), started daemon 128606377685824)>, <Thread(Thread-7 (_runner), started daemon 128606377701888)>, <Thread(fd_logger, started daemon 128606377091392)>, <Thread(privsep_reader, started daemon 128606375782080)>, <Thread(tpool_thread_0, started daemon 128606365607616)>, <Thread(tpool_thread_1, started daemon 128606357214912)>, <Thread(tpool_thread_2, started daemon 128606348822208)>, <Thread(tpool_thread_3, started daemon 128606340413120)>, <Thread(tpool_thread_4, started daemon 128606332004032)>, <Thread(tpool_thread_5, started daemon 128606323594944)>, <Thread(tpool_thread_6, started daemon 128606315185856)>, <Thread(tpool_thread_7, started daemon 128606306776768)>, <Thread(tpool_thread_8, started daemon 128606298367680)>, <Thread(tpool_thread_9, started daemon 128606289958592)>, <Thread(tpool_thread_10, started daemon 128606281549504)>, <Thread(tpool_thread_11, started daemon 128606273140416)>, <Thread(tpool_thread_12, started daemon 128606264731328)>, <Thread(tpool_thread_13, started daemon 128606256322240)>, <Thread(tpool_thread_14, started daemon 128606247913152)>, <Thread(tpool_thread_15, started daemon 128606239504064)>, <Thread(tpool_thread_16, started daemon 128606231094976)>, <Thread(tpool_thread_17, started daemon 128606222685888)>, <Thread(tpool_thread_18, started daemon 128606214276800)>, <Thread(tpool_thread_19, started daemon 128606205867712)>, <Thread(Rabbit-heartbeat, started daemon 128606368169344)>] {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 14 16:40:36 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-92ac45b1-5102-4897-93e6-3a4337483c36 tempest-CinderUnicodeTest-1301854972 None] Acquiring lock "cinder-8bc03257-c2a2-42bf-bc41-125408ffff66-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:40:36 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-92ac45b1-5102-4897-93e6-3a4337483c36 tempest-CinderUnicodeTest-1301854972 None] Lock "cinder-8bc03257-c2a2-42bf-bc41-125408ffff66-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:40:36 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-92ac45b1-5102-4897-93e6-3a4337483c36 tempest-CinderUnicodeTest-1301854972 None] Acquiring lock "cinder-quobyte-8bc03257-c2a2-42bf-bc41-125408ffff66" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:40:36 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-92ac45b1-5102-4897-93e6-3a4337483c36 tempest-CinderUnicodeTest-1301854972 None] Lock "cinder-quobyte-8bc03257-c2a2-42bf-bc41-125408ffff66" acquired by "delete_volume" :: waited 0.016s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:40:36 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[74877932-f21b-4911-9dbf-0839bcaf861f]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:40:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-92ac45b1-5102-4897-93e6-3a4337483c36 tempest-CinderUnicodeTest-1301854972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8bc03257-c2a2-42bf-bc41-125408ffff66 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:40:36 devstack sudo[104344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8bc03257-c2a2-42bf-bc41-125408ffff66
Jul 14 16:40:36 devstack sudo[104344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:40:36 devstack sudo[104344]: pam_unix(sudo:session): session closed for user root
Jul 14 16:40:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-92ac45b1-5102-4897-93e6-3a4337483c36 tempest-CinderUnicodeTest-1301854972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8bc03257-c2a2-42bf-bc41-125408ffff66" returned: 0 in 0.366s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:40:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-92ac45b1-5102-4897-93e6-3a4337483c36 tempest-CinderUnicodeTest-1301854972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8bc03257-c2a2-42bf-bc41-125408ffff66 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:40:36 devstack sudo[104351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8bc03257-c2a2-42bf-bc41-125408ffff66
Jul 14 16:40:36 devstack sudo[104351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:40:36 devstack sudo[104351]: pam_unix(sudo:session): session closed for user root
Jul 14 16:40:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-92ac45b1-5102-4897-93e6-3a4337483c36 tempest-CinderUnicodeTest-1301854972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8bc03257-c2a2-42bf-bc41-125408ffff66" returned: 0 in 0.237s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:40:36 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-92ac45b1-5102-4897-93e6-3a4337483c36 tempest-CinderUnicodeTest-1301854972 None] Lock "cinder-quobyte-8bc03257-c2a2-42bf-bc41-125408ffff66" released by "delete_volume" :: held 0.660s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:40:36 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-92ac45b1-5102-4897-93e6-3a4337483c36 tempest-CinderUnicodeTest-1301854972 None] Created reservations ['5fff83c6-3458-4fcc-a7da-f5d32d7cac18', '114f1bcd-9211-421a-8267-a36423844d51', '3336c1a6-9604-4290-892c-fa10c3563216', 'c2d74312-5fba-4935-94a1-e69e516e5e4f'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:40:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-92ac45b1-5102-4897-93e6-3a4337483c36 tempest-CinderUnicodeTest-1301854972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:40:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-92ac45b1-5102-4897-93e6-3a4337483c36 tempest-CinderUnicodeTest-1301854972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:40:36 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-92ac45b1-5102-4897-93e6-3a4337483c36 tempest-CinderUnicodeTest-1301854972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:40:36 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-92ac45b1-5102-4897-93e6-3a4337483c36 tempest-CinderUnicodeTest-1301854972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:40:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-92ac45b1-5102-4897-93e6-3a4337483c36 tempest-CinderUnicodeTest-1301854972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:40:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-92ac45b1-5102-4897-93e6-3a4337483c36 tempest-CinderUnicodeTest-1301854972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:40:36 devstack sudo[104354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:40:36 devstack sudo[104354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:40:37 devstack sudo[104354]: pam_unix(sudo:session): session closed for user root
Jul 14 16:40:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-92ac45b1-5102-4897-93e6-3a4337483c36 tempest-CinderUnicodeTest-1301854972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.243s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:40:37 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-92ac45b1-5102-4897-93e6-3a4337483c36 tempest-CinderUnicodeTest-1301854972 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:40:37 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-92ac45b1-5102-4897-93e6-3a4337483c36 tempest-CinderUnicodeTest-1301854972 None] Deleted volume successfully.
Jul 14 16:40:37 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-92ac45b1-5102-4897-93e6-3a4337483c36 tempest-CinderUnicodeTest-1301854972 None] Lock "cinder-8bc03257-c2a2-42bf-bc41-125408ffff66-delete_volume" released by "delete_volume" :: held 1.100s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:40:37 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3f6ddc0b-5a73-40a5-8c22-f92bd4cb12b6 tempest-CinderUnicodeTest-1301854972 None] Acquiring lock "cinder-6a89828a-a02a-4b99-b584-de33eb06bb34-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:40:37 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3f6ddc0b-5a73-40a5-8c22-f92bd4cb12b6 tempest-CinderUnicodeTest-1301854972 None] Lock "cinder-6a89828a-a02a-4b99-b584-de33eb06bb34-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:40:37 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3f6ddc0b-5a73-40a5-8c22-f92bd4cb12b6 tempest-CinderUnicodeTest-1301854972 None] Acquiring lock "cinder-quobyte-6a89828a-a02a-4b99-b584-de33eb06bb34" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:40:37 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3f6ddc0b-5a73-40a5-8c22-f92bd4cb12b6 tempest-CinderUnicodeTest-1301854972 None] Lock "cinder-quobyte-6a89828a-a02a-4b99-b584-de33eb06bb34" acquired by "delete_volume" :: waited 0.022s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:40:37 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c3f86e7-06ac-4cff-a878-344c12df854b]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:40:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3f6ddc0b-5a73-40a5-8c22-f92bd4cb12b6 tempest-CinderUnicodeTest-1301854972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6a89828a-a02a-4b99-b584-de33eb06bb34 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:40:37 devstack sudo[104357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6a89828a-a02a-4b99-b584-de33eb06bb34
Jul 14 16:40:37 devstack sudo[104357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:40:37 devstack sudo[104357]: pam_unix(sudo:session): session closed for user root
Jul 14 16:40:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3f6ddc0b-5a73-40a5-8c22-f92bd4cb12b6 tempest-CinderUnicodeTest-1301854972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6a89828a-a02a-4b99-b584-de33eb06bb34" returned: 0 in 0.360s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:40:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3f6ddc0b-5a73-40a5-8c22-f92bd4cb12b6 tempest-CinderUnicodeTest-1301854972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6a89828a-a02a-4b99-b584-de33eb06bb34 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:40:37 devstack sudo[104362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6a89828a-a02a-4b99-b584-de33eb06bb34
Jul 14 16:40:37 devstack sudo[104362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:40:37 devstack sudo[104362]: pam_unix(sudo:session): session closed for user root
Jul 14 16:40:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3f6ddc0b-5a73-40a5-8c22-f92bd4cb12b6 tempest-CinderUnicodeTest-1301854972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-6a89828a-a02a-4b99-b584-de33eb06bb34" returned: 0 in 0.248s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:40:37 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3f6ddc0b-5a73-40a5-8c22-f92bd4cb12b6 tempest-CinderUnicodeTest-1301854972 None] Lock "cinder-quobyte-6a89828a-a02a-4b99-b584-de33eb06bb34" released by "delete_volume" :: held 0.663s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:40:37 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-3f6ddc0b-5a73-40a5-8c22-f92bd4cb12b6 tempest-CinderUnicodeTest-1301854972 None] Created reservations ['2472ffbb-eaa2-44db-8ad2-5e4a9b2658a9', 'cd42e915-b893-4376-9747-6dd9760a019d', '699a6210-e7f4-4d7f-997b-64159ecf959c', '4bdb730d-beb1-4ea0-bb5c-5a49a75012e9'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:40:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3f6ddc0b-5a73-40a5-8c22-f92bd4cb12b6 tempest-CinderUnicodeTest-1301854972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:40:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3f6ddc0b-5a73-40a5-8c22-f92bd4cb12b6 tempest-CinderUnicodeTest-1301854972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:40:38 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-3f6ddc0b-5a73-40a5-8c22-f92bd4cb12b6 tempest-CinderUnicodeTest-1301854972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:40:38 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-3f6ddc0b-5a73-40a5-8c22-f92bd4cb12b6 tempest-CinderUnicodeTest-1301854972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:40:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3f6ddc0b-5a73-40a5-8c22-f92bd4cb12b6 tempest-CinderUnicodeTest-1301854972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:40:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3f6ddc0b-5a73-40a5-8c22-f92bd4cb12b6 tempest-CinderUnicodeTest-1301854972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:40:38 devstack sudo[104365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:40:38 devstack sudo[104365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:40:38 devstack sudo[104365]: pam_unix(sudo:session): session closed for user root
Jul 14 16:40:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3f6ddc0b-5a73-40a5-8c22-f92bd4cb12b6 tempest-CinderUnicodeTest-1301854972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.256s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:40:38 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-3f6ddc0b-5a73-40a5-8c22-f92bd4cb12b6 tempest-CinderUnicodeTest-1301854972 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:40:38 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-3f6ddc0b-5a73-40a5-8c22-f92bd4cb12b6 tempest-CinderUnicodeTest-1301854972 None] Deleted volume successfully.
Jul 14 16:40:38 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3f6ddc0b-5a73-40a5-8c22-f92bd4cb12b6 tempest-CinderUnicodeTest-1301854972 None] Lock "cinder-6a89828a-a02a-4b99-b584-de33eb06bb34-delete_volume" released by "delete_volume" :: held 1.106s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:40:48 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:SELECT=46,cinder:INSERT=22,cinder:UPDATE=58,cinder:DELETE=4 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 16:40:48 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:SELECT=44,cinder:INSERT=15,cinder:UPDATE=56,cinder:DELETE=5 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 16:40:58 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-77b7c3e2-1445-46f5-9a88-e0727acd320d tempest-CreateVolumesFromSnapshotTest-860857562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:40:58 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-77b7c3e2-1445-46f5-9a88-e0727acd320d tempest-CreateVolumesFromSnapshotTest-860857562 None] Flow 'volume_create_manager' (2c156a11-88d7-47b6-9aa9-fda9a92df4ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:40:58 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-77b7c3e2-1445-46f5-9a88-e0727acd320d tempest-CreateVolumesFromSnapshotTest-860857562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da5a35a5-e7b3-4e32-9ef5-92d0f6f409ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:40:58 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-77b7c3e2-1445-46f5-9a88-e0727acd320d tempest-CreateVolumesFromSnapshotTest-860857562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da5a35a5-e7b3-4e32-9ef5-92d0f6f409ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:40:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-813026156',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb2d2eb6-1175-495b-80e4-a0057f4d0dbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e08a088459f34bb891367dfbb94a6f83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:40:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:40:58Z,use_quota=True,user_id='1e6fa70abe9c48e2a52755e148363909',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:40:58 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-77b7c3e2-1445-46f5-9a88-e0727acd320d tempest-CreateVolumesFromSnapshotTest-860857562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (261b68d4-bd1a-4f09-a19c-4a937f842263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:40:58 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-77b7c3e2-1445-46f5-9a88-e0727acd320d tempest-CreateVolumesFromSnapshotTest-860857562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (261b68d4-bd1a-4f09-a19c-4a937f842263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:40:58 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-77b7c3e2-1445-46f5-9a88-e0727acd320d tempest-CreateVolumesFromSnapshotTest-860857562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27de23b1-ccb6-4834-9388-cb50b7677ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:40:58 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-77b7c3e2-1445-46f5-9a88-e0727acd320d tempest-CreateVolumesFromSnapshotTest-860857562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27de23b1-ccb6-4834-9388-cb50b7677ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb2d2eb6-1175-495b-80e4-a0057f4d0dbe', 'volume_name': 'volume-cb2d2eb6-1175-495b-80e4-a0057f4d0dbe', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:40:58 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-77b7c3e2-1445-46f5-9a88-e0727acd320d tempest-CreateVolumesFromSnapshotTest-860857562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (096bbd54-9b94-4e74-8eb8-0d4b08dd8e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:40:58 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-77b7c3e2-1445-46f5-9a88-e0727acd320d tempest-CreateVolumesFromSnapshotTest-860857562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (096bbd54-9b94-4e74-8eb8-0d4b08dd8e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:40:58 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-77b7c3e2-1445-46f5-9a88-e0727acd320d tempest-CreateVolumesFromSnapshotTest-860857562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c109729b-2edf-41e9-b79a-f554e77f0360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:40:58 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-77b7c3e2-1445-46f5-9a88-e0727acd320d tempest-CreateVolumesFromSnapshotTest-860857562 None] Volume cb2d2eb6-1175-495b-80e4-a0057f4d0dbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb2d2eb6-1175-495b-80e4-a0057f4d0dbe', 'volume_size': 1}
Jul 14 16:40:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-77b7c3e2-1445-46f5-9a88-e0727acd320d tempest-CreateVolumesFromSnapshotTest-860857562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:40:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-77b7c3e2-1445-46f5-9a88-e0727acd320d tempest-CreateVolumesFromSnapshotTest-860857562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:40:58 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-77b7c3e2-1445-46f5-9a88-e0727acd320d tempest-CreateVolumesFromSnapshotTest-860857562 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:40:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-813026156',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb2d2eb6-1175-495b-80e4-a0057f4d0dbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e08a088459f34bb891367dfbb94a6f83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:40:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:40:58Z,use_quota=True,user_id='1e6fa70abe9c48e2a52755e148363909',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:40:58 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-77b7c3e2-1445-46f5-9a88-e0727acd320d tempest-CreateVolumesFromSnapshotTest-860857562 None] Creating volume cb2d2eb6-1175-495b-80e4-a0057f4d0dbe {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:40:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-77b7c3e2-1445-46f5-9a88-e0727acd320d tempest-CreateVolumesFromSnapshotTest-860857562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:40:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-77b7c3e2-1445-46f5-9a88-e0727acd320d tempest-CreateVolumesFromSnapshotTest-860857562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:40:58 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-77b7c3e2-1445-46f5-9a88-e0727acd320d tempest-CreateVolumesFromSnapshotTest-860857562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:40:58 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-77b7c3e2-1445-46f5-9a88-e0727acd320d tempest-CreateVolumesFromSnapshotTest-860857562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:40:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-77b7c3e2-1445-46f5-9a88-e0727acd320d tempest-CreateVolumesFromSnapshotTest-860857562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:40:58 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-77b7c3e2-1445-46f5-9a88-e0727acd320d tempest-CreateVolumesFromSnapshotTest-860857562 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:40:58 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-77b7c3e2-1445-46f5-9a88-e0727acd320d tempest-CreateVolumesFromSnapshotTest-860857562 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:40:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-77b7c3e2-1445-46f5-9a88-e0727acd320d tempest-CreateVolumesFromSnapshotTest-860857562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cb2d2eb6-1175-495b-80e4-a0057f4d0dbe 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:40:58 devstack sudo[104408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cb2d2eb6-1175-495b-80e4-a0057f4d0dbe 1073741824
Jul 14 16:40:58 devstack sudo[104408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:40:58 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-a52c2e55-743c-48bc-8d26-e25c7185fc31 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:40:58 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a52c2e55-743c-48bc-8d26-e25c7185fc31 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Flow 'volume_create_manager' (e0ebee43-b7ae-4141-b2b6-6082ed8f8087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:40:58 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a52c2e55-743c-48bc-8d26-e25c7185fc31 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (232b4ed0-6a37-4c4d-b166-ed443bb81092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:40:58 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a52c2e55-743c-48bc-8d26-e25c7185fc31 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (232b4ed0-6a37-4c4d-b166-ed443bb81092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:40:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1921895789',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=164dd959-4416-4a66-84da-9aa1af14623c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa8cce6d04344298b32ee2746c8ad475',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:40:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:40:59Z,use_quota=True,user_id='0e95301afe7c4871a5ee550e46523691',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:40:58 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a52c2e55-743c-48bc-8d26-e25c7185fc31 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2aa2e3b-ffbe-41e0-adef-70d3ab16b677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:40:58 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a52c2e55-743c-48bc-8d26-e25c7185fc31 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2aa2e3b-ffbe-41e0-adef-70d3ab16b677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:40:58 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a52c2e55-743c-48bc-8d26-e25c7185fc31 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35dd9c17-5e5a-4ef0-b01f-9ae6772a0535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:40:58 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a52c2e55-743c-48bc-8d26-e25c7185fc31 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35dd9c17-5e5a-4ef0-b01f-9ae6772a0535) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '164dd959-4416-4a66-84da-9aa1af14623c', 'volume_name': 'volume-164dd959-4416-4a66-84da-9aa1af14623c', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:40:58 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a52c2e55-743c-48bc-8d26-e25c7185fc31 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dc14d55-e190-4bce-84dd-2b2c19cbcd02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:40:58 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a52c2e55-743c-48bc-8d26-e25c7185fc31 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dc14d55-e190-4bce-84dd-2b2c19cbcd02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:40:58 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a52c2e55-743c-48bc-8d26-e25c7185fc31 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad4123d1-be6a-497a-8020-a910d022ec2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:40:58 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-a52c2e55-743c-48bc-8d26-e25c7185fc31 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Volume 164dd959-4416-4a66-84da-9aa1af14623c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-164dd959-4416-4a66-84da-9aa1af14623c', 'volume_size': 1}
Jul 14 16:40:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a52c2e55-743c-48bc-8d26-e25c7185fc31 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:40:58 devstack sudo[104408]: pam_unix(sudo:session): session closed for user root
Jul 14 16:40:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-77b7c3e2-1445-46f5-9a88-e0727acd320d tempest-CreateVolumesFromSnapshotTest-860857562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cb2d2eb6-1175-495b-80e4-a0057f4d0dbe 1073741824" returned: 0 in 0.626s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:40:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-77b7c3e2-1445-46f5-9a88-e0727acd320d tempest-CreateVolumesFromSnapshotTest-860857562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cb2d2eb6-1175-495b-80e4-a0057f4d0dbe {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:40:59 devstack sudo[104414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cb2d2eb6-1175-495b-80e4-a0057f4d0dbe
Jul 14 16:40:59 devstack sudo[104414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:40:59 devstack sudo[104414]: pam_unix(sudo:session): session closed for user root
Jul 14 16:40:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-77b7c3e2-1445-46f5-9a88-e0727acd320d tempest-CreateVolumesFromSnapshotTest-860857562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cb2d2eb6-1175-495b-80e4-a0057f4d0dbe" returned: 0 in 0.271s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:40:59 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-77b7c3e2-1445-46f5-9a88-e0727acd320d tempest-CreateVolumesFromSnapshotTest-860857562 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:40:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-77b7c3e2-1445-46f5-9a88-e0727acd320d tempest-CreateVolumesFromSnapshotTest-860857562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:40:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a52c2e55-743c-48bc-8d26-e25c7185fc31 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.486s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:40:59 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a52c2e55-743c-48bc-8d26-e25c7185fc31 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:40:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1921895789',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=164dd959-4416-4a66-84da-9aa1af14623c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa8cce6d04344298b32ee2746c8ad475',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:40:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:40:59Z,use_quota=True,user_id='0e95301afe7c4871a5ee550e46523691',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:40:59 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-a52c2e55-743c-48bc-8d26-e25c7185fc31 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Creating volume 164dd959-4416-4a66-84da-9aa1af14623c {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:40:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a52c2e55-743c-48bc-8d26-e25c7185fc31 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:40:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a52c2e55-743c-48bc-8d26-e25c7185fc31 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:40:59 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a52c2e55-743c-48bc-8d26-e25c7185fc31 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:40:59 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a52c2e55-743c-48bc-8d26-e25c7185fc31 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:40:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a52c2e55-743c-48bc-8d26-e25c7185fc31 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:40:59 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a52c2e55-743c-48bc-8d26-e25c7185fc31 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:40:59 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-a52c2e55-743c-48bc-8d26-e25c7185fc31 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:40:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a52c2e55-743c-48bc-8d26-e25c7185fc31 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-164dd959-4416-4a66-84da-9aa1af14623c 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:40:59 devstack sudo[104417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-164dd959-4416-4a66-84da-9aa1af14623c 1073741824
Jul 14 16:40:59 devstack sudo[104417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:40:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-77b7c3e2-1445-46f5-9a88-e0727acd320d tempest-CreateVolumesFromSnapshotTest-860857562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c109729b-2edf-41e9-b79a-f554e77f0360) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb2d2eb6-1175-495b-80e4-a0057f4d0dbe', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:40:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-77b7c3e2-1445-46f5-9a88-e0727acd320d tempest-CreateVolumesFromSnapshotTest-860857562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de279c29-c5c6-4ada-9adf-4c0be7a2ce4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:40:59 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-77b7c3e2-1445-46f5-9a88-e0727acd320d tempest-CreateVolumesFromSnapshotTest-860857562 None] Volume volume-cb2d2eb6-1175-495b-80e4-a0057f4d0dbe (cb2d2eb6-1175-495b-80e4-a0057f4d0dbe): created successfully
Jul 14 16:40:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-77b7c3e2-1445-46f5-9a88-e0727acd320d tempest-CreateVolumesFromSnapshotTest-860857562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de279c29-c5c6-4ada-9adf-4c0be7a2ce4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:40:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-77b7c3e2-1445-46f5-9a88-e0727acd320d tempest-CreateVolumesFromSnapshotTest-860857562 None] Flow 'volume_create_manager' (2c156a11-88d7-47b6-9aa9-fda9a92df4ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:40:59 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-77b7c3e2-1445-46f5-9a88-e0727acd320d tempest-CreateVolumesFromSnapshotTest-860857562 None] Created volume successfully.
Jul 14 16:40:59 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e265424-b665-4505-b8b3-2b7af40eb5de tempest-ProjectReaderTests-1127203843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:40:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2e265424-b665-4505-b8b3-2b7af40eb5de tempest-ProjectReaderTests-1127203843 None] Flow 'volume_create_manager' (8965c85a-b9dc-4aae-900c-8613ae250e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:40:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2e265424-b665-4505-b8b3-2b7af40eb5de tempest-ProjectReaderTests-1127203843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d8a97f0-47a0-4ee5-bd08-5df531f795ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:40:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2e265424-b665-4505-b8b3-2b7af40eb5de tempest-ProjectReaderTests-1127203843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d8a97f0-47a0-4ee5-bd08-5df531f795ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:40:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1371194316',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7644d56-9f5e-41f5-9a04-1bc617bea51e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='883944e7bf4f4b4dbc774e64e3e27858',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:41:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:41:00Z,use_quota=True,user_id='edcf2b7f48504051a3973d82e7b0fa86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:40:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2e265424-b665-4505-b8b3-2b7af40eb5de tempest-ProjectReaderTests-1127203843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (667f2de5-f005-4167-9aa5-f880cf9fe87c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:40:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2e265424-b665-4505-b8b3-2b7af40eb5de tempest-ProjectReaderTests-1127203843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (667f2de5-f005-4167-9aa5-f880cf9fe87c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:40:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2e265424-b665-4505-b8b3-2b7af40eb5de tempest-ProjectReaderTests-1127203843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d854918a-4b3e-44a7-bb0f-2ba638d38eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:40:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2e265424-b665-4505-b8b3-2b7af40eb5de tempest-ProjectReaderTests-1127203843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d854918a-4b3e-44a7-bb0f-2ba638d38eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7644d56-9f5e-41f5-9a04-1bc617bea51e', 'volume_name': 'volume-c7644d56-9f5e-41f5-9a04-1bc617bea51e', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:40:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2e265424-b665-4505-b8b3-2b7af40eb5de tempest-ProjectReaderTests-1127203843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0101773a-2cf1-4ac8-b0f7-37d8f2336840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:40:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2e265424-b665-4505-b8b3-2b7af40eb5de tempest-ProjectReaderTests-1127203843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0101773a-2cf1-4ac8-b0f7-37d8f2336840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:40:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2e265424-b665-4505-b8b3-2b7af40eb5de tempest-ProjectReaderTests-1127203843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11fe918f-5a69-40aa-8833-f84417ba9436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:40:59 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-2e265424-b665-4505-b8b3-2b7af40eb5de tempest-ProjectReaderTests-1127203843 None] Volume c7644d56-9f5e-41f5-9a04-1bc617bea51e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7644d56-9f5e-41f5-9a04-1bc617bea51e', 'volume_size': 1}
Jul 14 16:40:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2e265424-b665-4505-b8b3-2b7af40eb5de tempest-ProjectReaderTests-1127203843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:40:59 devstack sudo[104417]: pam_unix(sudo:session): session closed for user root
Jul 14 16:40:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a52c2e55-743c-48bc-8d26-e25c7185fc31 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-164dd959-4416-4a66-84da-9aa1af14623c 1073741824" returned: 0 in 0.492s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:40:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a52c2e55-743c-48bc-8d26-e25c7185fc31 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-164dd959-4416-4a66-84da-9aa1af14623c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:40:59 devstack sudo[104424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-164dd959-4416-4a66-84da-9aa1af14623c
Jul 14 16:40:59 devstack sudo[104424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:00 devstack sudo[104424]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a52c2e55-743c-48bc-8d26-e25c7185fc31 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-164dd959-4416-4a66-84da-9aa1af14623c" returned: 0 in 0.248s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:00 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a52c2e55-743c-48bc-8d26-e25c7185fc31 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:41:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a52c2e55-743c-48bc-8d26-e25c7185fc31 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2e265424-b665-4505-b8b3-2b7af40eb5de tempest-ProjectReaderTests-1127203843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.436s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:00 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2e265424-b665-4505-b8b3-2b7af40eb5de tempest-ProjectReaderTests-1127203843 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:40:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1371194316',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7644d56-9f5e-41f5-9a04-1bc617bea51e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='883944e7bf4f4b4dbc774e64e3e27858',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:41:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:41:00Z,use_quota=True,user_id='edcf2b7f48504051a3973d82e7b0fa86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:41:00 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-2e265424-b665-4505-b8b3-2b7af40eb5de tempest-ProjectReaderTests-1127203843 None] Creating volume c7644d56-9f5e-41f5-9a04-1bc617bea51e {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:41:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2e265424-b665-4505-b8b3-2b7af40eb5de tempest-ProjectReaderTests-1127203843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2e265424-b665-4505-b8b3-2b7af40eb5de tempest-ProjectReaderTests-1127203843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:00 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2e265424-b665-4505-b8b3-2b7af40eb5de tempest-ProjectReaderTests-1127203843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:41:00 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2e265424-b665-4505-b8b3-2b7af40eb5de tempest-ProjectReaderTests-1127203843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:41:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2e265424-b665-4505-b8b3-2b7af40eb5de tempest-ProjectReaderTests-1127203843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:00 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2e265424-b665-4505-b8b3-2b7af40eb5de tempest-ProjectReaderTests-1127203843 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:41:00 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-2e265424-b665-4505-b8b3-2b7af40eb5de tempest-ProjectReaderTests-1127203843 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:41:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2e265424-b665-4505-b8b3-2b7af40eb5de tempest-ProjectReaderTests-1127203843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c7644d56-9f5e-41f5-9a04-1bc617bea51e 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a52c2e55-743c-48bc-8d26-e25c7185fc31 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad4123d1-be6a-497a-8020-a910d022ec2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-164dd959-4416-4a66-84da-9aa1af14623c', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a52c2e55-743c-48bc-8d26-e25c7185fc31 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8de854e-1323-4d3d-a2e1-dcb3d45ba0b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:00 devstack sudo[104427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c7644d56-9f5e-41f5-9a04-1bc617bea51e 1073741824
Jul 14 16:41:00 devstack sudo[104427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:00 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-a52c2e55-743c-48bc-8d26-e25c7185fc31 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Volume volume-164dd959-4416-4a66-84da-9aa1af14623c (164dd959-4416-4a66-84da-9aa1af14623c): created successfully
Jul 14 16:41:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a52c2e55-743c-48bc-8d26-e25c7185fc31 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8de854e-1323-4d3d-a2e1-dcb3d45ba0b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a52c2e55-743c-48bc-8d26-e25c7185fc31 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Flow 'volume_create_manager' (e0ebee43-b7ae-4141-b2b6-6082ed8f8087) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:41:00 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-a52c2e55-743c-48bc-8d26-e25c7185fc31 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Created volume successfully.
Jul 14 16:41:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9d6cbbeb-46be-4cca-afb7-cb5dde2a580e tempest-CreateVolumesFromSnapshotTest-860857562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:00 devstack sudo[104427]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2e265424-b665-4505-b8b3-2b7af40eb5de tempest-ProjectReaderTests-1127203843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c7644d56-9f5e-41f5-9a04-1bc617bea51e 1073741824" returned: 0 in 0.536s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2e265424-b665-4505-b8b3-2b7af40eb5de tempest-ProjectReaderTests-1127203843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c7644d56-9f5e-41f5-9a04-1bc617bea51e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:00 devstack sudo[104433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c7644d56-9f5e-41f5-9a04-1bc617bea51e
Jul 14 16:41:00 devstack sudo[104433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:00 devstack sudo[104433]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2e265424-b665-4505-b8b3-2b7af40eb5de tempest-ProjectReaderTests-1127203843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c7644d56-9f5e-41f5-9a04-1bc617bea51e" returned: 0 in 0.276s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:00 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2e265424-b665-4505-b8b3-2b7af40eb5de tempest-ProjectReaderTests-1127203843 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:41:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2e265424-b665-4505-b8b3-2b7af40eb5de tempest-ProjectReaderTests-1127203843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9d6cbbeb-46be-4cca-afb7-cb5dde2a580e tempest-CreateVolumesFromSnapshotTest-860857562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.345s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2e265424-b665-4505-b8b3-2b7af40eb5de tempest-ProjectReaderTests-1127203843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11fe918f-5a69-40aa-8833-f84417ba9436) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7644d56-9f5e-41f5-9a04-1bc617bea51e', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2e265424-b665-4505-b8b3-2b7af40eb5de tempest-ProjectReaderTests-1127203843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (720f02fd-5bbb-4994-880d-bf14dea5f04a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:01 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-9d6cbbeb-46be-4cca-afb7-cb5dde2a580e tempest-CreateVolumesFromSnapshotTest-860857562 None] Creating offline snapshot 16cbd470-bbab-499c-9ebe-fb383bb3f133 of volume cb2d2eb6-1175-495b-80e4-a0057f4d0dbe {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 16:41:01 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-2e265424-b665-4505-b8b3-2b7af40eb5de tempest-ProjectReaderTests-1127203843 None] Volume volume-c7644d56-9f5e-41f5-9a04-1bc617bea51e (c7644d56-9f5e-41f5-9a04-1bc617bea51e): created successfully
Jul 14 16:41:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2e265424-b665-4505-b8b3-2b7af40eb5de tempest-ProjectReaderTests-1127203843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (720f02fd-5bbb-4994-880d-bf14dea5f04a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2e265424-b665-4505-b8b3-2b7af40eb5de tempest-ProjectReaderTests-1127203843 None] Flow 'volume_create_manager' (8965c85a-b9dc-4aae-900c-8613ae250e89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:41:01 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e0b7dd3-2a14-413c-b61a-bf03e95003d8]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:41:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9d6cbbeb-46be-4cca-afb7-cb5dde2a580e tempest-CreateVolumesFromSnapshotTest-860857562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cb2d2eb6-1175-495b-80e4-a0057f4d0dbe {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:01 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-2e265424-b665-4505-b8b3-2b7af40eb5de tempest-ProjectReaderTests-1127203843 None] Created volume successfully.
Jul 14 16:41:01 devstack sudo[104436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cb2d2eb6-1175-495b-80e4-a0057f4d0dbe
Jul 14 16:41:01 devstack sudo[104436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:01 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3035d6d-10f7-4159-b3cd-82b3cc248791 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:41:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c3035d6d-10f7-4159-b3cd-82b3cc248791 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Flow 'volume_create_manager' (264b8956-0960-4605-92bc-baeb7d742212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:41:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c3035d6d-10f7-4159-b3cd-82b3cc248791 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eeae53c-bd88-4192-99be-7be923838e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c3035d6d-10f7-4159-b3cd-82b3cc248791 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eeae53c-bd88-4192-99be-7be923838e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:41:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-263215519',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11917a9a-2508-49ad-81b9-5bb8f4038b74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa8cce6d04344298b32ee2746c8ad475',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:41:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:41:01Z,use_quota=True,user_id='0e95301afe7c4871a5ee550e46523691',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c3035d6d-10f7-4159-b3cd-82b3cc248791 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f00ff18-8576-41f9-908b-41685a96dec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c3035d6d-10f7-4159-b3cd-82b3cc248791 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f00ff18-8576-41f9-908b-41685a96dec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c3035d6d-10f7-4159-b3cd-82b3cc248791 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28c7c87d-b5d2-40c2-be70-ce628a66b1ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c3035d6d-10f7-4159-b3cd-82b3cc248791 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28c7c87d-b5d2-40c2-be70-ce628a66b1ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11917a9a-2508-49ad-81b9-5bb8f4038b74', 'volume_name': 'volume-11917a9a-2508-49ad-81b9-5bb8f4038b74', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c3035d6d-10f7-4159-b3cd-82b3cc248791 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c369fe86-7131-473f-8d0d-2961638bbef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c3035d6d-10f7-4159-b3cd-82b3cc248791 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c369fe86-7131-473f-8d0d-2961638bbef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c3035d6d-10f7-4159-b3cd-82b3cc248791 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a571731f-0f93-48d0-9ee7-9b6b919b1831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:01 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-c3035d6d-10f7-4159-b3cd-82b3cc248791 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Volume 11917a9a-2508-49ad-81b9-5bb8f4038b74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11917a9a-2508-49ad-81b9-5bb8f4038b74', 'volume_size': 1}
Jul 14 16:41:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c3035d6d-10f7-4159-b3cd-82b3cc248791 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:01 devstack sudo[104436]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9d6cbbeb-46be-4cca-afb7-cb5dde2a580e tempest-CreateVolumesFromSnapshotTest-860857562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cb2d2eb6-1175-495b-80e4-a0057f4d0dbe" returned: 0 in 0.536s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9d6cbbeb-46be-4cca-afb7-cb5dde2a580e tempest-CreateVolumesFromSnapshotTest-860857562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cb2d2eb6-1175-495b-80e4-a0057f4d0dbe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cb2d2eb6-1175-495b-80e4-a0057f4d0dbe.16cbd470-bbab-499c-9ebe-fb383bb3f133 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:01 devstack sudo[104442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cb2d2eb6-1175-495b-80e4-a0057f4d0dbe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cb2d2eb6-1175-495b-80e4-a0057f4d0dbe.16cbd470-bbab-499c-9ebe-fb383bb3f133 1G
Jul 14 16:41:01 devstack sudo[104442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:01 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d9d523f-2b90-4794-ba86-7e57e7c549d9 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:41:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5d9d523f-2b90-4794-ba86-7e57e7c549d9 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Flow 'volume_create_manager' (4d6c50f5-7aa4-4ab4-8bd5-6cedc042af6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:41:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5d9d523f-2b90-4794-ba86-7e57e7c549d9 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (713499f4-109d-442e-9346-12bd2fc0bfdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5d9d523f-2b90-4794-ba86-7e57e7c549d9 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (713499f4-109d-442e-9346-12bd2fc0bfdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:41:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1618421516',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=244d8be4-3958-4799-9edd-552e124eef76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa8cce6d04344298b32ee2746c8ad475',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:41:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:41:02Z,use_quota=True,user_id='0e95301afe7c4871a5ee550e46523691',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5d9d523f-2b90-4794-ba86-7e57e7c549d9 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d5ae922-9a8b-4dfe-bd2b-4e9f3087ccb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5d9d523f-2b90-4794-ba86-7e57e7c549d9 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d5ae922-9a8b-4dfe-bd2b-4e9f3087ccb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5d9d523f-2b90-4794-ba86-7e57e7c549d9 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (256df403-6141-474e-ad6f-61f4d4c6b17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5d9d523f-2b90-4794-ba86-7e57e7c549d9 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (256df403-6141-474e-ad6f-61f4d4c6b17b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '244d8be4-3958-4799-9edd-552e124eef76', 'volume_name': 'volume-244d8be4-3958-4799-9edd-552e124eef76', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5d9d523f-2b90-4794-ba86-7e57e7c549d9 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42834363-c753-4283-acbe-4867d579954d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5d9d523f-2b90-4794-ba86-7e57e7c549d9 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42834363-c753-4283-acbe-4867d579954d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5d9d523f-2b90-4794-ba86-7e57e7c549d9 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c37bb314-ec8e-4f08-9df7-3b50a6b33f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:01 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-5d9d523f-2b90-4794-ba86-7e57e7c549d9 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Volume 244d8be4-3958-4799-9edd-552e124eef76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-244d8be4-3958-4799-9edd-552e124eef76', 'volume_size': 1}
Jul 14 16:41:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5d9d523f-2b90-4794-ba86-7e57e7c549d9 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:02 devstack sudo[104442]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9d6cbbeb-46be-4cca-afb7-cb5dde2a580e tempest-CreateVolumesFromSnapshotTest-860857562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cb2d2eb6-1175-495b-80e4-a0057f4d0dbe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cb2d2eb6-1175-495b-80e4-a0057f4d0dbe.16cbd470-bbab-499c-9ebe-fb383bb3f133 1G" returned: 0 in 0.560s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9d6cbbeb-46be-4cca-afb7-cb5dde2a580e tempest-CreateVolumesFromSnapshotTest-860857562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb2d2eb6-1175-495b-80e4-a0057f4d0dbe -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cb2d2eb6-1175-495b-80e4-a0057f4d0dbe.16cbd470-bbab-499c-9ebe-fb383bb3f133 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:02 devstack sudo[104448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb2d2eb6-1175-495b-80e4-a0057f4d0dbe -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cb2d2eb6-1175-495b-80e4-a0057f4d0dbe.16cbd470-bbab-499c-9ebe-fb383bb3f133
Jul 14 16:41:02 devstack sudo[104448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:02 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-789d298f-47c5-4933-bf27-95a11876082f tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:41:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-789d298f-47c5-4933-bf27-95a11876082f tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Flow 'volume_create_manager' (8a0f7203-08d5-438e-91d7-261d5c31d2d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:41:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-789d298f-47c5-4933-bf27-95a11876082f tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e08cf8a6-8046-46a6-97bd-bf06bb4436e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-789d298f-47c5-4933-bf27-95a11876082f tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e08cf8a6-8046-46a6-97bd-bf06bb4436e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:41:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1715910438',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05e8d4bf-bdf0-4bc4-aee0-0d95d9b37b6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa8cce6d04344298b32ee2746c8ad475',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:41:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:41:02Z,use_quota=True,user_id='0e95301afe7c4871a5ee550e46523691',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-789d298f-47c5-4933-bf27-95a11876082f tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (339dafa7-aa6b-44d7-826c-e430c4eac082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-789d298f-47c5-4933-bf27-95a11876082f tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (339dafa7-aa6b-44d7-826c-e430c4eac082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-789d298f-47c5-4933-bf27-95a11876082f tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41cc894c-8649-460f-8ce2-2924654c2ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-789d298f-47c5-4933-bf27-95a11876082f tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41cc894c-8649-460f-8ce2-2924654c2ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05e8d4bf-bdf0-4bc4-aee0-0d95d9b37b6f', 'volume_name': 'volume-05e8d4bf-bdf0-4bc4-aee0-0d95d9b37b6f', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-789d298f-47c5-4933-bf27-95a11876082f tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00a60f89-69e7-4a2b-b1f4-bb8b8e99adf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-789d298f-47c5-4933-bf27-95a11876082f tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00a60f89-69e7-4a2b-b1f4-bb8b8e99adf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-789d298f-47c5-4933-bf27-95a11876082f tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fee8ca23-b45d-4cf4-a233-8064d4628fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:02 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-789d298f-47c5-4933-bf27-95a11876082f tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Volume 05e8d4bf-bdf0-4bc4-aee0-0d95d9b37b6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05e8d4bf-bdf0-4bc4-aee0-0d95d9b37b6f', 'volume_size': 1}
Jul 14 16:41:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-789d298f-47c5-4933-bf27-95a11876082f tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:02 devstack sudo[104448]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9d6cbbeb-46be-4cca-afb7-cb5dde2a580e tempest-CreateVolumesFromSnapshotTest-860857562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb2d2eb6-1175-495b-80e4-a0057f4d0dbe -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cb2d2eb6-1175-495b-80e4-a0057f4d0dbe.16cbd470-bbab-499c-9ebe-fb383bb3f133" returned: 0 in 0.442s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:02 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-9d6cbbeb-46be-4cca-afb7-cb5dde2a580e tempest-CreateVolumesFromSnapshotTest-860857562 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cb2d2eb6-1175-495b-80e4-a0057f4d0dbe.16cbd470-bbab-499c-9ebe-fb383bb3f133 is being set with open permissions: ugo+rw
Jul 14 16:41:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9d6cbbeb-46be-4cca-afb7-cb5dde2a580e tempest-CreateVolumesFromSnapshotTest-860857562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cb2d2eb6-1175-495b-80e4-a0057f4d0dbe.16cbd470-bbab-499c-9ebe-fb383bb3f133 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:02 devstack sudo[104453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cb2d2eb6-1175-495b-80e4-a0057f4d0dbe.16cbd470-bbab-499c-9ebe-fb383bb3f133
Jul 14 16:41:02 devstack sudo[104453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-04d55288-6fda-4fab-b85e-ad889de568e3 tempest-ProjectReaderTests-1127203843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:02 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-accd0ce2-8994-45ca-ad56-c9f7859754f5 tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:41:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-accd0ce2-8994-45ca-ad56-c9f7859754f5 tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] Flow 'volume_create_manager' (39595c28-50ef-402e-820c-a50cabb7ebfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:41:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-accd0ce2-8994-45ca-ad56-c9f7859754f5 tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee579083-fb15-4a5a-bde0-0850aef7ff17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-accd0ce2-8994-45ca-ad56-c9f7859754f5 tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee579083-fb15-4a5a-bde0-0850aef7ff17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:41:02Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb466273-09cb-4d22-9212-41a12aeee8ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cff9f674ec1740b49e3dad4660349444',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:41:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:41:03Z,use_quota=True,user_id='ec853d25fe774258a3d056c74a7aa5af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bda21ad-0436-4f8a-991e-a07fa7afc43e),volume_type_id=9bda21ad-0436-4f8a-991e-a07fa7afc43e)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-accd0ce2-8994-45ca-ad56-c9f7859754f5 tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6325845-f6ea-416d-a73d-17355bdaa48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-accd0ce2-8994-45ca-ad56-c9f7859754f5 tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6325845-f6ea-416d-a73d-17355bdaa48d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-accd0ce2-8994-45ca-ad56-c9f7859754f5 tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d76ba82-b623-4030-af3a-7671989abb0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:02 devstack cinder-volume[87166]: DEBUG cinder.image.glance [None req-accd0ce2-8994-45ca-ad56-c9f7859754f5 tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] Creating Keystone auth plugin from conf {{(pid=87166) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 14 16:41:02 devstack sudo[104453]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9d6cbbeb-46be-4cca-afb7-cb5dde2a580e tempest-CreateVolumesFromSnapshotTest-860857562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cb2d2eb6-1175-495b-80e4-a0057f4d0dbe.16cbd470-bbab-499c-9ebe-fb383bb3f133" returned: 0 in 0.319s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:02 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a4ab319-ae9c-44a2-8626-f3db3da3530b tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:41:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4a4ab319-ae9c-44a2-8626-f3db3da3530b tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Flow 'volume_create_manager' (2f292829-ad55-4870-9734-4c6e5e99e0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:41:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4a4ab319-ae9c-44a2-8626-f3db3da3530b tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a1a9bbb-92fe-4e4e-9cf6-d8b785785efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9d6cbbeb-46be-4cca-afb7-cb5dde2a580e tempest-CreateVolumesFromSnapshotTest-860857562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cb2d2eb6-1175-495b-80e4-a0057f4d0dbe.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4a4ab319-ae9c-44a2-8626-f3db3da3530b tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a1a9bbb-92fe-4e4e-9cf6-d8b785785efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:41:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-135920939',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06e45220-7003-4249-9506-9fe46b9c8f55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa8cce6d04344298b32ee2746c8ad475',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:41:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:41:03Z,use_quota=True,user_id='0e95301afe7c4871a5ee550e46523691',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4a4ab319-ae9c-44a2-8626-f3db3da3530b tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9447e6ea-68db-4192-b313-097b92a7c0ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4a4ab319-ae9c-44a2-8626-f3db3da3530b tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9447e6ea-68db-4192-b313-097b92a7c0ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:03 devstack sudo[104457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cb2d2eb6-1175-495b-80e4-a0057f4d0dbe.info
Jul 14 16:41:03 devstack sudo[104457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4a4ab319-ae9c-44a2-8626-f3db3da3530b tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fd98d5d-f989-4398-815a-6f0dc1fb2881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4a4ab319-ae9c-44a2-8626-f3db3da3530b tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fd98d5d-f989-4398-815a-6f0dc1fb2881) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06e45220-7003-4249-9506-9fe46b9c8f55', 'volume_name': 'volume-06e45220-7003-4249-9506-9fe46b9c8f55', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4a4ab319-ae9c-44a2-8626-f3db3da3530b tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfe8c341-b2ed-4341-b3e1-a268d50125ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4a4ab319-ae9c-44a2-8626-f3db3da3530b tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfe8c341-b2ed-4341-b3e1-a268d50125ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4a4ab319-ae9c-44a2-8626-f3db3da3530b tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74316f6f-53ef-4998-bd19-2c8179286775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:03 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-4a4ab319-ae9c-44a2-8626-f3db3da3530b tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Volume 06e45220-7003-4249-9506-9fe46b9c8f55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06e45220-7003-4249-9506-9fe46b9c8f55', 'volume_size': 1}
Jul 14 16:41:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-4a4ab319-ae9c-44a2-8626-f3db3da3530b tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-accd0ce2-8994-45ca-ad56-c9f7859754f5 tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d76ba82-b623-4030-af3a-7671989abb0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fb466273-09cb-4d22-9212-41a12aeee8ef', 'volume_name': 'volume-fb466273-09cb-4d22-9212-41a12aeee8ef', 'volume_size': 1, 'image_id': '4ceb308d-0303-4f0e-9d05-c124719f1648', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4ceb308d-0303-4f0e-9d05-c124719f1648', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'dab4a1a49ce90d2eff5eadc9cf499d3f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cff9f674ec1740b49e3dad4660349444', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2645874b616e879618a05487c90c03beafed015132d18319de4d1eeeb0a300353dfdaee327aefc4bbf6e5f928c5d532e11e9ee025bf4ac126232d6d55bc7f128', 'id': '4ceb308d-0303-4f0e-9d05-c124719f1648', 'created_at': datetime.datetime(2026, 7, 14, 14, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 14, 41, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4ceb308d-0303-4f0e-9d05-c124719f1648/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74f78100e390>}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-accd0ce2-8994-45ca-ad56-c9f7859754f5 tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8eedfad-ccbd-4e58-b6ec-92b137bf66fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-accd0ce2-8994-45ca-ad56-c9f7859754f5 tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8eedfad-ccbd-4e58-b6ec-92b137bf66fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-accd0ce2-8994-45ca-ad56-c9f7859754f5 tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3370778a-99d5-4042-9aa6-95763c4203a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:03 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-accd0ce2-8994-45ca-ad56-c9f7859754f5 tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] Volume fb466273-09cb-4d22-9212-41a12aeee8ef: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fb466273-09cb-4d22-9212-41a12aeee8ef', 'volume_size': 1, 'image_id': '4ceb308d-0303-4f0e-9d05-c124719f1648', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4ceb308d-0303-4f0e-9d05-c124719f1648', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'dab4a1a49ce90d2eff5eadc9cf499d3f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cff9f674ec1740b49e3dad4660349444', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2645874b616e879618a05487c90c03beafed015132d18319de4d1eeeb0a300353dfdaee327aefc4bbf6e5f928c5d532e11e9ee025bf4ac126232d6d55bc7f128', 'id': '4ceb308d-0303-4f0e-9d05-c124719f1648', 'created_at': datetime.datetime(2026, 7, 14, 14, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 14, 41, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4ceb308d-0303-4f0e-9d05-c124719f1648/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74f78100e390>}
Jul 14 16:41:03 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-accd0ce2-8994-45ca-ad56-c9f7859754f5 tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] Trying to clone fb466273-09cb-4d22-9212-41a12aeee8ef from image 4ceb308d-0303-4f0e-9d05-c124719f1648 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4ceb308d-0303-4f0e-9d05-c124719f1648', 'metadata': {}}]). {{(pid=87166) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 14 16:41:03 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-accd0ce2-8994-45ca-ad56-c9f7859754f5 tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4ceb308d-0303-4f0e-9d05-c124719f1648_ob7t21o3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87166) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 14 16:41:03 devstack cinder-volume[87166]: INFO cinder.image.image_utils [None req-accd0ce2-8994-45ca-ad56-c9f7859754f5 tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] Image download 0.00 MB at 0.00 MB/s
Jul 14 16:41:03 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a28458-2809-41f0-baf8-1b790a8581fe]: (4, 'raw') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:41:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-accd0ce2-8994-45ca-ad56-c9f7859754f5 tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4ceb308d-0303-4f0e-9d05-c124719f1648_ob7t21o3devstack@QuobyteHD {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:03 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-48314197-2c85-433c-9f38-56dd33b2ad25 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:41:03 devstack sudo[104457]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-48314197-2c85-433c-9f38-56dd33b2ad25 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Flow 'volume_create_manager' (4dc577a6-e351-4818-bf6b-6b5e558d9e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:41:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-48314197-2c85-433c-9f38-56dd33b2ad25 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2ca742b-f99d-4eb6-a821-1a91286e12ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9d6cbbeb-46be-4cca-afb7-cb5dde2a580e tempest-CreateVolumesFromSnapshotTest-860857562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cb2d2eb6-1175-495b-80e4-a0057f4d0dbe.info" returned: 0 in 0.367s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:03 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-9d6cbbeb-46be-4cca-afb7-cb5dde2a580e tempest-CreateVolumesFromSnapshotTest-860857562 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cb2d2eb6-1175-495b-80e4-a0057f4d0dbe.info is being set with open permissions: ugo+rw
Jul 14 16:41:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9d6cbbeb-46be-4cca-afb7-cb5dde2a580e tempest-CreateVolumesFromSnapshotTest-860857562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cb2d2eb6-1175-495b-80e4-a0057f4d0dbe.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-48314197-2c85-433c-9f38-56dd33b2ad25 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2ca742b-f99d-4eb6-a821-1a91286e12ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:41:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-894338724',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40663ea6-b031-41dc-b51a-656314c0d687,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa8cce6d04344298b32ee2746c8ad475',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:41:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:41:03Z,use_quota=True,user_id='0e95301afe7c4871a5ee550e46523691',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:03 devstack sudo[104461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cb2d2eb6-1175-495b-80e4-a0057f4d0dbe.info
Jul 14 16:41:03 devstack sudo[104461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-48314197-2c85-433c-9f38-56dd33b2ad25 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c04b422-0717-49bf-bd8f-ed28108a15fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-48314197-2c85-433c-9f38-56dd33b2ad25 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c04b422-0717-49bf-bd8f-ed28108a15fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-48314197-2c85-433c-9f38-56dd33b2ad25 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (774f574d-92a4-4daa-9511-98640ae45dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-48314197-2c85-433c-9f38-56dd33b2ad25 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (774f574d-92a4-4daa-9511-98640ae45dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40663ea6-b031-41dc-b51a-656314c0d687', 'volume_name': 'volume-40663ea6-b031-41dc-b51a-656314c0d687', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-48314197-2c85-433c-9f38-56dd33b2ad25 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e46f21a-947e-4faf-b272-9211387a14cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-48314197-2c85-433c-9f38-56dd33b2ad25 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e46f21a-947e-4faf-b272-9211387a14cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-48314197-2c85-433c-9f38-56dd33b2ad25 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90fe1d4d-84a8-4c2f-b7ef-20c22d9d7268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:03 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-48314197-2c85-433c-9f38-56dd33b2ad25 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Volume 40663ea6-b031-41dc-b51a-656314c0d687: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40663ea6-b031-41dc-b51a-656314c0d687', 'volume_size': 1}
Jul 14 16:41:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-48314197-2c85-433c-9f38-56dd33b2ad25 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:03 devstack sudo[104460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4ceb308d-0303-4f0e-9d05-c124719f1648_ob7t21o3devstack@QuobyteHD
Jul 14 16:41:03 devstack sudo[104460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:03 devstack sudo[104461]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9d6cbbeb-46be-4cca-afb7-cb5dde2a580e tempest-CreateVolumesFromSnapshotTest-860857562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cb2d2eb6-1175-495b-80e4-a0057f4d0dbe.info" returned: 0 in 0.256s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9d6cbbeb-46be-4cca-afb7-cb5dde2a580e tempest-CreateVolumesFromSnapshotTest-860857562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.706s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c3035d6d-10f7-4159-b3cd-82b3cc248791 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.190s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-c3035d6d-10f7-4159-b3cd-82b3cc248791 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:41:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-263215519',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11917a9a-2508-49ad-81b9-5bb8f4038b74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa8cce6d04344298b32ee2746c8ad475',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:41:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:41:01Z,use_quota=True,user_id='0e95301afe7c4871a5ee550e46523691',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:41:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-c3035d6d-10f7-4159-b3cd-82b3cc248791 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Creating volume 11917a9a-2508-49ad-81b9-5bb8f4038b74 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:41:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c3035d6d-10f7-4159-b3cd-82b3cc248791 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c3035d6d-10f7-4159-b3cd-82b3cc248791 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-c3035d6d-10f7-4159-b3cd-82b3cc248791 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:41:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-c3035d6d-10f7-4159-b3cd-82b3cc248791 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:41:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c3035d6d-10f7-4159-b3cd-82b3cc248791 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-c3035d6d-10f7-4159-b3cd-82b3cc248791 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:41:03 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-c3035d6d-10f7-4159-b3cd-82b3cc248791 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:41:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c3035d6d-10f7-4159-b3cd-82b3cc248791 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-11917a9a-2508-49ad-81b9-5bb8f4038b74 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:03 devstack sudo[104467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-11917a9a-2508-49ad-81b9-5bb8f4038b74 1073741824
Jul 14 16:41:03 devstack sudo[104467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:03 devstack sudo[104460]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-accd0ce2-8994-45ca-ad56-c9f7859754f5 tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4ceb308d-0303-4f0e-9d05-c124719f1648_ob7t21o3devstack@QuobyteHD" returned: 0 in 0.374s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-accd0ce2-8994-45ca-ad56-c9f7859754f5 tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4ceb308d-0303-4f0e-9d05-c124719f1648_ob7t21o3devstack@QuobyteHD {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:03 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-9d6cbbeb-46be-4cca-afb7-cb5dde2a580e tempest-CreateVolumesFromSnapshotTest-860857562 None] Create snapshot completed successfully
Jul 14 16:41:03 devstack sudo[104469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4ceb308d-0303-4f0e-9d05-c124719f1648_ob7t21o3devstack@QuobyteHD
Jul 14 16:41:03 devstack sudo[104469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:04 devstack sudo[104469]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-accd0ce2-8994-45ca-ad56-c9f7859754f5 tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4ceb308d-0303-4f0e-9d05-c124719f1648_ob7t21o3devstack@QuobyteHD" returned: 1 in 0.364s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-accd0ce2-8994-45ca-ad56-c9f7859754f5 tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4ceb308d-0303-4f0e-9d05-c124719f1648_ob7t21o3devstack@QuobyteHD' failed. Not Retrying. {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 16:41:04 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-accd0ce2-8994-45ca-ad56-c9f7859754f5 tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] Temporary image 4ceb308d-0303-4f0e-9d05-c124719f1648 is fetched for user ec853d25fe774258a3d056c74a7aa5af. {{(pid=87166) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 14 16:41:04 devstack sudo[104467]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c3035d6d-10f7-4159-b3cd-82b3cc248791 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-11917a9a-2508-49ad-81b9-5bb8f4038b74 1073741824" returned: 0 in 0.420s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c3035d6d-10f7-4159-b3cd-82b3cc248791 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-11917a9a-2508-49ad-81b9-5bb8f4038b74 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:04 devstack sudo[104478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-11917a9a-2508-49ad-81b9-5bb8f4038b74
Jul 14 16:41:04 devstack sudo[104478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:04 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[b74472df-4ba3-4c48-8ae7-ade52e763834]: (4, 'raw') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:41:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-accd0ce2-8994-45ca-ad56-c9f7859754f5 tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4ceb308d-0303-4f0e-9d05-c124719f1648_ob7t21o3devstack@QuobyteHD {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:04 devstack sudo[104480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4ceb308d-0303-4f0e-9d05-c124719f1648_ob7t21o3devstack@QuobyteHD
Jul 14 16:41:04 devstack sudo[104480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:04 devstack sudo[104478]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c3035d6d-10f7-4159-b3cd-82b3cc248791 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-11917a9a-2508-49ad-81b9-5bb8f4038b74" returned: 0 in 0.254s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:04 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-c3035d6d-10f7-4159-b3cd-82b3cc248791 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] <== create_volume: return (725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:41:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c3035d6d-10f7-4159-b3cd-82b3cc248791 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.728s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5d9d523f-2b90-4794-ba86-7e57e7c549d9 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.553s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:04 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5d9d523f-2b90-4794-ba86-7e57e7c549d9 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:41:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1618421516',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=244d8be4-3958-4799-9edd-552e124eef76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa8cce6d04344298b32ee2746c8ad475',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:41:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:41:02Z,use_quota=True,user_id='0e95301afe7c4871a5ee550e46523691',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:41:04 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-5d9d523f-2b90-4794-ba86-7e57e7c549d9 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Creating volume 244d8be4-3958-4799-9edd-552e124eef76 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:41:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5d9d523f-2b90-4794-ba86-7e57e7c549d9 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5d9d523f-2b90-4794-ba86-7e57e7c549d9 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:04 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5d9d523f-2b90-4794-ba86-7e57e7c549d9 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:41:04 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5d9d523f-2b90-4794-ba86-7e57e7c549d9 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:41:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5d9d523f-2b90-4794-ba86-7e57e7c549d9 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:04 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5d9d523f-2b90-4794-ba86-7e57e7c549d9 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:41:04 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-5d9d523f-2b90-4794-ba86-7e57e7c549d9 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:41:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5d9d523f-2b90-4794-ba86-7e57e7c549d9 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-244d8be4-3958-4799-9edd-552e124eef76 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c3035d6d-10f7-4159-b3cd-82b3cc248791 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a571731f-0f93-48d0-9ee7-9b6b919b1831) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11917a9a-2508-49ad-81b9-5bb8f4038b74', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:04 devstack sudo[104483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-244d8be4-3958-4799-9edd-552e124eef76 1073741824
Jul 14 16:41:04 devstack sudo[104483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c3035d6d-10f7-4159-b3cd-82b3cc248791 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7093bf4e-790c-47bb-8b54-aeb3ffc08860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:04 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-c3035d6d-10f7-4159-b3cd-82b3cc248791 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Volume volume-11917a9a-2508-49ad-81b9-5bb8f4038b74 (11917a9a-2508-49ad-81b9-5bb8f4038b74): created successfully
Jul 14 16:41:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c3035d6d-10f7-4159-b3cd-82b3cc248791 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7093bf4e-790c-47bb-8b54-aeb3ffc08860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c3035d6d-10f7-4159-b3cd-82b3cc248791 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Flow 'volume_create_manager' (264b8956-0960-4605-92bc-baeb7d742212) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:41:04 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-c3035d6d-10f7-4159-b3cd-82b3cc248791 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Created volume successfully.
Jul 14 16:41:04 devstack sudo[104480]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-accd0ce2-8994-45ca-ad56-c9f7859754f5 tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4ceb308d-0303-4f0e-9d05-c124719f1648_ob7t21o3devstack@QuobyteHD" returned: 0 in 0.433s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-accd0ce2-8994-45ca-ad56-c9f7859754f5 tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4ceb308d-0303-4f0e-9d05-c124719f1648_ob7t21o3devstack@QuobyteHD {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:04 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-65c6775e-d4ea-4fa9-ac24-30fb42620f30 tempest-CreateVolumesFromSnapshotTest-860857562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:41:04 devstack sudo[104487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4ceb308d-0303-4f0e-9d05-c124719f1648_ob7t21o3devstack@QuobyteHD
Jul 14 16:41:04 devstack sudo[104487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-65c6775e-d4ea-4fa9-ac24-30fb42620f30 tempest-CreateVolumesFromSnapshotTest-860857562 None] Flow 'volume_create_manager' (ad9409c2-bbac-433f-b273-ccf3f34cdfc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:41:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-65c6775e-d4ea-4fa9-ac24-30fb42620f30 tempest-CreateVolumesFromSnapshotTest-860857562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8d4a8de-9d92-4349-b0f5-0e790e7befcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-65c6775e-d4ea-4fa9-ac24-30fb42620f30 tempest-CreateVolumesFromSnapshotTest-860857562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8d4a8de-9d92-4349-b0f5-0e790e7befcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:41:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-447089626',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd2a3da3-1370-48f3-beed-8d04840a309f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e08a088459f34bb891367dfbb94a6f83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:41:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:41:05Z,use_quota=True,user_id='1e6fa70abe9c48e2a52755e148363909',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-65c6775e-d4ea-4fa9-ac24-30fb42620f30 tempest-CreateVolumesFromSnapshotTest-860857562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39b8ae4d-4912-44e8-b2e8-9f0d77b62ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-65c6775e-d4ea-4fa9-ac24-30fb42620f30 tempest-CreateVolumesFromSnapshotTest-860857562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39b8ae4d-4912-44e8-b2e8-9f0d77b62ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-65c6775e-d4ea-4fa9-ac24-30fb42620f30 tempest-CreateVolumesFromSnapshotTest-860857562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22affb8e-970b-428b-b8b2-666cb461cd9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-65c6775e-d4ea-4fa9-ac24-30fb42620f30 tempest-CreateVolumesFromSnapshotTest-860857562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22affb8e-970b-428b-b8b2-666cb461cd9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd2a3da3-1370-48f3-beed-8d04840a309f', 'volume_name': 'volume-cd2a3da3-1370-48f3-beed-8d04840a309f', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-65c6775e-d4ea-4fa9-ac24-30fb42620f30 tempest-CreateVolumesFromSnapshotTest-860857562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b60bf99-10ae-44c3-9592-19ff1a8179bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-65c6775e-d4ea-4fa9-ac24-30fb42620f30 tempest-CreateVolumesFromSnapshotTest-860857562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b60bf99-10ae-44c3-9592-19ff1a8179bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-65c6775e-d4ea-4fa9-ac24-30fb42620f30 tempest-CreateVolumesFromSnapshotTest-860857562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71dbfb71-a5f6-4822-a067-b58b36c40f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:04 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-65c6775e-d4ea-4fa9-ac24-30fb42620f30 tempest-CreateVolumesFromSnapshotTest-860857562 None] Volume cd2a3da3-1370-48f3-beed-8d04840a309f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd2a3da3-1370-48f3-beed-8d04840a309f', 'volume_size': 1}
Jul 14 16:41:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-65c6775e-d4ea-4fa9-ac24-30fb42620f30 tempest-CreateVolumesFromSnapshotTest-860857562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:05 devstack sudo[104483]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:05 devstack sudo[104487]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5d9d523f-2b90-4794-ba86-7e57e7c549d9 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-244d8be4-3958-4799-9edd-552e124eef76 1073741824" returned: 0 in 0.586s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-accd0ce2-8994-45ca-ad56-c9f7859754f5 tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4ceb308d-0303-4f0e-9d05-c124719f1648_ob7t21o3devstack@QuobyteHD" returned: 1 in 0.391s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-accd0ce2-8994-45ca-ad56-c9f7859754f5 tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4ceb308d-0303-4f0e-9d05-c124719f1648_ob7t21o3devstack@QuobyteHD' failed. Not Retrying. {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 16:41:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-accd0ce2-8994-45ca-ad56-c9f7859754f5 tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5d9d523f-2b90-4794-ba86-7e57e7c549d9 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-244d8be4-3958-4799-9edd-552e124eef76 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:05 devstack sudo[104496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-244d8be4-3958-4799-9edd-552e124eef76
Jul 14 16:41:05 devstack sudo[104496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:05 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-519ad6bf-7e91-4a41-b344-d71c5f9ae727 tempest-CreateVolumesFromSnapshotTest-860857562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:41:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-519ad6bf-7e91-4a41-b344-d71c5f9ae727 tempest-CreateVolumesFromSnapshotTest-860857562 None] Flow 'volume_create_manager' (ca6b0619-741b-496f-a5ff-60fab1ddcba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:41:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-519ad6bf-7e91-4a41-b344-d71c5f9ae727 tempest-CreateVolumesFromSnapshotTest-860857562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e401e032-9132-42d4-9dd6-8f6fec764ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-519ad6bf-7e91-4a41-b344-d71c5f9ae727 tempest-CreateVolumesFromSnapshotTest-860857562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e401e032-9132-42d4-9dd6-8f6fec764ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:41:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-761149262',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aae6fc0b-4a87-4c3e-bbe6-828a5344bbbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e08a088459f34bb891367dfbb94a6f83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:41:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:41:05Z,use_quota=True,user_id='1e6fa70abe9c48e2a52755e148363909',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-519ad6bf-7e91-4a41-b344-d71c5f9ae727 tempest-CreateVolumesFromSnapshotTest-860857562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d3a3b16-a467-4fee-940f-705ab92207e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-519ad6bf-7e91-4a41-b344-d71c5f9ae727 tempest-CreateVolumesFromSnapshotTest-860857562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d3a3b16-a467-4fee-940f-705ab92207e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-519ad6bf-7e91-4a41-b344-d71c5f9ae727 tempest-CreateVolumesFromSnapshotTest-860857562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ae46ba3-2b9f-4ba2-bd1d-cdf22e760972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-519ad6bf-7e91-4a41-b344-d71c5f9ae727 tempest-CreateVolumesFromSnapshotTest-860857562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ae46ba3-2b9f-4ba2-bd1d-cdf22e760972) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aae6fc0b-4a87-4c3e-bbe6-828a5344bbbb', 'volume_name': 'volume-aae6fc0b-4a87-4c3e-bbe6-828a5344bbbb', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-519ad6bf-7e91-4a41-b344-d71c5f9ae727 tempest-CreateVolumesFromSnapshotTest-860857562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3892d07-806b-4e53-a9b8-0446fea07eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-519ad6bf-7e91-4a41-b344-d71c5f9ae727 tempest-CreateVolumesFromSnapshotTest-860857562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3892d07-806b-4e53-a9b8-0446fea07eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-519ad6bf-7e91-4a41-b344-d71c5f9ae727 tempest-CreateVolumesFromSnapshotTest-860857562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b69d778b-60de-4597-8df1-5d7948262973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:05 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-519ad6bf-7e91-4a41-b344-d71c5f9ae727 tempest-CreateVolumesFromSnapshotTest-860857562 None] Volume aae6fc0b-4a87-4c3e-bbe6-828a5344bbbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aae6fc0b-4a87-4c3e-bbe6-828a5344bbbb', 'volume_size': 1}
Jul 14 16:41:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-519ad6bf-7e91-4a41-b344-d71c5f9ae727 tempest-CreateVolumesFromSnapshotTest-860857562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:05 devstack sudo[104496]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5d9d523f-2b90-4794-ba86-7e57e7c549d9 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-244d8be4-3958-4799-9edd-552e124eef76" returned: 0 in 0.298s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:05 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5d9d523f-2b90-4794-ba86-7e57e7c549d9 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:41:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5d9d523f-2b90-4794-ba86-7e57e7c549d9 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-789d298f-47c5-4933-bf27-95a11876082f tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.848s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:05 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-789d298f-47c5-4933-bf27-95a11876082f tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:41:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1715910438',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05e8d4bf-bdf0-4bc4-aee0-0d95d9b37b6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa8cce6d04344298b32ee2746c8ad475',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:41:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:41:02Z,use_quota=True,user_id='0e95301afe7c4871a5ee550e46523691',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:41:05 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-789d298f-47c5-4933-bf27-95a11876082f tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Creating volume 05e8d4bf-bdf0-4bc4-aee0-0d95d9b37b6f {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:41:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-789d298f-47c5-4933-bf27-95a11876082f tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-789d298f-47c5-4933-bf27-95a11876082f tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:05 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-789d298f-47c5-4933-bf27-95a11876082f tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:41:05 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-789d298f-47c5-4933-bf27-95a11876082f tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:41:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-789d298f-47c5-4933-bf27-95a11876082f tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:05 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-789d298f-47c5-4933-bf27-95a11876082f tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:41:05 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-789d298f-47c5-4933-bf27-95a11876082f tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:41:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-789d298f-47c5-4933-bf27-95a11876082f tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-05e8d4bf-bdf0-4bc4-aee0-0d95d9b37b6f 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5d9d523f-2b90-4794-ba86-7e57e7c549d9 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c37bb314-ec8e-4f08-9df7-3b50a6b33f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-244d8be4-3958-4799-9edd-552e124eef76', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5d9d523f-2b90-4794-ba86-7e57e7c549d9 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef256eae-a4cb-482b-870b-1a29a0a7fe91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:05 devstack sudo[104499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-05e8d4bf-bdf0-4bc4-aee0-0d95d9b37b6f 1073741824
Jul 14 16:41:05 devstack sudo[104499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:05 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-5d9d523f-2b90-4794-ba86-7e57e7c549d9 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Volume volume-244d8be4-3958-4799-9edd-552e124eef76 (244d8be4-3958-4799-9edd-552e124eef76): created successfully
Jul 14 16:41:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5d9d523f-2b90-4794-ba86-7e57e7c549d9 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef256eae-a4cb-482b-870b-1a29a0a7fe91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5d9d523f-2b90-4794-ba86-7e57e7c549d9 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Flow 'volume_create_manager' (4d6c50f5-7aa4-4ab4-8bd5-6cedc042af6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:41:05 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-5d9d523f-2b90-4794-ba86-7e57e7c549d9 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Created volume successfully.
Jul 14 16:41:05 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-c127c249-cadf-4b07-be0c-b26bf0a88c4f tempest-CreateVolumesFromSnapshotTest-860857562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:41:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c127c249-cadf-4b07-be0c-b26bf0a88c4f tempest-CreateVolumesFromSnapshotTest-860857562 None] Flow 'volume_create_manager' (69eb228b-caef-4b0b-8488-ed81e2d64921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:41:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c127c249-cadf-4b07-be0c-b26bf0a88c4f tempest-CreateVolumesFromSnapshotTest-860857562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f52959a-eed6-4860-aeb1-5743b28babbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c127c249-cadf-4b07-be0c-b26bf0a88c4f tempest-CreateVolumesFromSnapshotTest-860857562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f52959a-eed6-4860-aeb1-5743b28babbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:41:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1180288437',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04d45231-9072-49b3-b2ce-ef3920fd8177,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e08a088459f34bb891367dfbb94a6f83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:41:06Z,use_quota=True,user_id='1e6fa70abe9c48e2a52755e148363909',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c127c249-cadf-4b07-be0c-b26bf0a88c4f tempest-CreateVolumesFromSnapshotTest-860857562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (630c083a-c557-4a5c-9d6f-fbb58cad4c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c127c249-cadf-4b07-be0c-b26bf0a88c4f tempest-CreateVolumesFromSnapshotTest-860857562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (630c083a-c557-4a5c-9d6f-fbb58cad4c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c127c249-cadf-4b07-be0c-b26bf0a88c4f tempest-CreateVolumesFromSnapshotTest-860857562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4acbbd5c-9de4-4ae0-9ca9-2fe7a25ebfe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c127c249-cadf-4b07-be0c-b26bf0a88c4f tempest-CreateVolumesFromSnapshotTest-860857562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4acbbd5c-9de4-4ae0-9ca9-2fe7a25ebfe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04d45231-9072-49b3-b2ce-ef3920fd8177', 'volume_name': 'volume-04d45231-9072-49b3-b2ce-ef3920fd8177', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c127c249-cadf-4b07-be0c-b26bf0a88c4f tempest-CreateVolumesFromSnapshotTest-860857562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8d654fb-39b5-4b63-a168-a73244c5ff89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c127c249-cadf-4b07-be0c-b26bf0a88c4f tempest-CreateVolumesFromSnapshotTest-860857562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8d654fb-39b5-4b63-a168-a73244c5ff89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c127c249-cadf-4b07-be0c-b26bf0a88c4f tempest-CreateVolumesFromSnapshotTest-860857562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4bd86d0-35c5-456a-b1e7-5ed81ce010b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:05 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-c127c249-cadf-4b07-be0c-b26bf0a88c4f tempest-CreateVolumesFromSnapshotTest-860857562 None] Volume 04d45231-9072-49b3-b2ce-ef3920fd8177: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04d45231-9072-49b3-b2ce-ef3920fd8177', 'volume_size': 1}
Jul 14 16:41:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c127c249-cadf-4b07-be0c-b26bf0a88c4f tempest-CreateVolumesFromSnapshotTest-860857562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:05 devstack sudo[104499]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-789d298f-47c5-4933-bf27-95a11876082f tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-05e8d4bf-bdf0-4bc4-aee0-0d95d9b37b6f 1073741824" returned: 0 in 0.514s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:05 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-121485d4-0616-4cfb-9f3c-c9507d7f2499 tempest-CreateVolumesFromSnapshotTest-860857562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:41:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-121485d4-0616-4cfb-9f3c-c9507d7f2499 tempest-CreateVolumesFromSnapshotTest-860857562 None] Flow 'volume_create_manager' (7c970b25-094d-48d8-8b37-da5d81d4eb1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:41:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-121485d4-0616-4cfb-9f3c-c9507d7f2499 tempest-CreateVolumesFromSnapshotTest-860857562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90753baf-dc97-42d4-ac57-e5909997347a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-789d298f-47c5-4933-bf27-95a11876082f tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-05e8d4bf-bdf0-4bc4-aee0-0d95d9b37b6f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-121485d4-0616-4cfb-9f3c-c9507d7f2499 tempest-CreateVolumesFromSnapshotTest-860857562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90753baf-dc97-42d4-ac57-e5909997347a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:41:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-293854763',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22f06f16-f4a0-4cb6-a1fd-d1751846e892,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e08a088459f34bb891367dfbb94a6f83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:41:06Z,use_quota=True,user_id='1e6fa70abe9c48e2a52755e148363909',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:05 devstack sudo[104505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-05e8d4bf-bdf0-4bc4-aee0-0d95d9b37b6f
Jul 14 16:41:05 devstack sudo[104505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:06 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-121485d4-0616-4cfb-9f3c-c9507d7f2499 tempest-CreateVolumesFromSnapshotTest-860857562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afa2d219-b899-4e23-bd08-5f42eea4be8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:06 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-121485d4-0616-4cfb-9f3c-c9507d7f2499 tempest-CreateVolumesFromSnapshotTest-860857562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afa2d219-b899-4e23-bd08-5f42eea4be8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:06 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-121485d4-0616-4cfb-9f3c-c9507d7f2499 tempest-CreateVolumesFromSnapshotTest-860857562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (991b7cf0-75e5-4082-84f7-e4c22b3c9a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:06 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-121485d4-0616-4cfb-9f3c-c9507d7f2499 tempest-CreateVolumesFromSnapshotTest-860857562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (991b7cf0-75e5-4082-84f7-e4c22b3c9a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22f06f16-f4a0-4cb6-a1fd-d1751846e892', 'volume_name': 'volume-22f06f16-f4a0-4cb6-a1fd-d1751846e892', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:06 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-121485d4-0616-4cfb-9f3c-c9507d7f2499 tempest-CreateVolumesFromSnapshotTest-860857562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fcde160-e796-413d-b857-64671d52eac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:06 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-121485d4-0616-4cfb-9f3c-c9507d7f2499 tempest-CreateVolumesFromSnapshotTest-860857562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fcde160-e796-413d-b857-64671d52eac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:06 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-121485d4-0616-4cfb-9f3c-c9507d7f2499 tempest-CreateVolumesFromSnapshotTest-860857562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (364c1cc0-f3c5-4daa-84f9-3447662ed92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:06 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-121485d4-0616-4cfb-9f3c-c9507d7f2499 tempest-CreateVolumesFromSnapshotTest-860857562 None] Volume 22f06f16-f4a0-4cb6-a1fd-d1751846e892: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22f06f16-f4a0-4cb6-a1fd-d1751846e892', 'volume_size': 1}
Jul 14 16:41:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-121485d4-0616-4cfb-9f3c-c9507d7f2499 tempest-CreateVolumesFromSnapshotTest-860857562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:06 devstack sudo[104505]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-789d298f-47c5-4933-bf27-95a11876082f tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-05e8d4bf-bdf0-4bc4-aee0-0d95d9b37b6f" returned: 0 in 0.283s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:06 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-789d298f-47c5-4933-bf27-95a11876082f tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:41:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-789d298f-47c5-4933-bf27-95a11876082f tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-04d55288-6fda-4fab-b85e-ad889de568e3 tempest-ProjectReaderTests-1127203843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.573s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:06 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-789d298f-47c5-4933-bf27-95a11876082f tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fee8ca23-b45d-4cf4-a233-8064d4628fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05e8d4bf-bdf0-4bc4-aee0-0d95d9b37b6f', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:06 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-789d298f-47c5-4933-bf27-95a11876082f tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dd43c2b-68a8-43ef-9741-33f66d567e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:06 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-04d55288-6fda-4fab-b85e-ad889de568e3 tempest-ProjectReaderTests-1127203843 None] Creating offline snapshot e7a8284e-9222-4ceb-88b6-31df0b381032 of volume c7644d56-9f5e-41f5-9a04-1bc617bea51e {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 16:41:06 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-789d298f-47c5-4933-bf27-95a11876082f tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Volume volume-05e8d4bf-bdf0-4bc4-aee0-0d95d9b37b6f (05e8d4bf-bdf0-4bc4-aee0-0d95d9b37b6f): created successfully
Jul 14 16:41:06 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-789d298f-47c5-4933-bf27-95a11876082f tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dd43c2b-68a8-43ef-9741-33f66d567e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:06 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-789d298f-47c5-4933-bf27-95a11876082f tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Flow 'volume_create_manager' (8a0f7203-08d5-438e-91d7-261d5c31d2d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:41:06 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[931cb3ad-0605-4d2e-9e6b-3bbd45627c22]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:41:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-04d55288-6fda-4fab-b85e-ad889de568e3 tempest-ProjectReaderTests-1127203843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c7644d56-9f5e-41f5-9a04-1bc617bea51e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:06 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-789d298f-47c5-4933-bf27-95a11876082f tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Created volume successfully.
Jul 14 16:41:06 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-af937450-3199-4ba7-be4a-8b39d4f96f1f tempest-CreateVolumesFromSnapshotTest-860857562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:41:06 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-af937450-3199-4ba7-be4a-8b39d4f96f1f tempest-CreateVolumesFromSnapshotTest-860857562 None] Flow 'volume_create_manager' (193c706d-ee1d-4326-8c1d-02f864765762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:41:06 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-af937450-3199-4ba7-be4a-8b39d4f96f1f tempest-CreateVolumesFromSnapshotTest-860857562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ba94ee4-ad1c-453b-9d52-6c942685d14d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:06 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-af937450-3199-4ba7-be4a-8b39d4f96f1f tempest-CreateVolumesFromSnapshotTest-860857562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ba94ee4-ad1c-453b-9d52-6c942685d14d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:41:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1398894365',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18475d06-503e-471b-a2a1-eeecfb93b990,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e08a088459f34bb891367dfbb94a6f83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:41:06Z,use_quota=True,user_id='1e6fa70abe9c48e2a52755e148363909',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:06 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-af937450-3199-4ba7-be4a-8b39d4f96f1f tempest-CreateVolumesFromSnapshotTest-860857562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed34dfee-ef39-40e8-8b6a-e46eeee75976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:06 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-af937450-3199-4ba7-be4a-8b39d4f96f1f tempest-CreateVolumesFromSnapshotTest-860857562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed34dfee-ef39-40e8-8b6a-e46eeee75976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:06 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-af937450-3199-4ba7-be4a-8b39d4f96f1f tempest-CreateVolumesFromSnapshotTest-860857562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14d321b2-6a41-4de7-864b-3ea7ed2f84ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:06 devstack sudo[104508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c7644d56-9f5e-41f5-9a04-1bc617bea51e
Jul 14 16:41:06 devstack sudo[104508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:06 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-af937450-3199-4ba7-be4a-8b39d4f96f1f tempest-CreateVolumesFromSnapshotTest-860857562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14d321b2-6a41-4de7-864b-3ea7ed2f84ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18475d06-503e-471b-a2a1-eeecfb93b990', 'volume_name': 'volume-18475d06-503e-471b-a2a1-eeecfb93b990', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:06 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-af937450-3199-4ba7-be4a-8b39d4f96f1f tempest-CreateVolumesFromSnapshotTest-860857562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96da4d42-0885-4af9-9578-da34ba4c580f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:06 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-af937450-3199-4ba7-be4a-8b39d4f96f1f tempest-CreateVolumesFromSnapshotTest-860857562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96da4d42-0885-4af9-9578-da34ba4c580f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:06 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-af937450-3199-4ba7-be4a-8b39d4f96f1f tempest-CreateVolumesFromSnapshotTest-860857562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad08c561-5f87-4a8d-891d-2941597cc6a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:06 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-af937450-3199-4ba7-be4a-8b39d4f96f1f tempest-CreateVolumesFromSnapshotTest-860857562 None] Volume 18475d06-503e-471b-a2a1-eeecfb93b990: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18475d06-503e-471b-a2a1-eeecfb93b990', 'volume_size': 1}
Jul 14 16:41:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-af937450-3199-4ba7-be4a-8b39d4f96f1f tempest-CreateVolumesFromSnapshotTest-860857562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:06 devstack sudo[104508]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-04d55288-6fda-4fab-b85e-ad889de568e3 tempest-ProjectReaderTests-1127203843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c7644d56-9f5e-41f5-9a04-1bc617bea51e" returned: 0 in 0.381s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-04d55288-6fda-4fab-b85e-ad889de568e3 tempest-ProjectReaderTests-1127203843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c7644d56-9f5e-41f5-9a04-1bc617bea51e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c7644d56-9f5e-41f5-9a04-1bc617bea51e.e7a8284e-9222-4ceb-88b6-31df0b381032 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:06 devstack sudo[104513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c7644d56-9f5e-41f5-9a04-1bc617bea51e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c7644d56-9f5e-41f5-9a04-1bc617bea51e.e7a8284e-9222-4ceb-88b6-31df0b381032 1G
Jul 14 16:41:06 devstack sudo[104513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:07 devstack sudo[104513]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-04d55288-6fda-4fab-b85e-ad889de568e3 tempest-ProjectReaderTests-1127203843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c7644d56-9f5e-41f5-9a04-1bc617bea51e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c7644d56-9f5e-41f5-9a04-1bc617bea51e.e7a8284e-9222-4ceb-88b6-31df0b381032 1G" returned: 0 in 0.388s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-04d55288-6fda-4fab-b85e-ad889de568e3 tempest-ProjectReaderTests-1127203843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7644d56-9f5e-41f5-9a04-1bc617bea51e -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c7644d56-9f5e-41f5-9a04-1bc617bea51e.e7a8284e-9222-4ceb-88b6-31df0b381032 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:07 devstack sudo[104518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7644d56-9f5e-41f5-9a04-1bc617bea51e -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c7644d56-9f5e-41f5-9a04-1bc617bea51e.e7a8284e-9222-4ceb-88b6-31df0b381032
Jul 14 16:41:07 devstack sudo[104518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:07 devstack sudo[104518]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-04d55288-6fda-4fab-b85e-ad889de568e3 tempest-ProjectReaderTests-1127203843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7644d56-9f5e-41f5-9a04-1bc617bea51e -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c7644d56-9f5e-41f5-9a04-1bc617bea51e.e7a8284e-9222-4ceb-88b6-31df0b381032" returned: 0 in 0.299s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:07 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-04d55288-6fda-4fab-b85e-ad889de568e3 tempest-ProjectReaderTests-1127203843 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c7644d56-9f5e-41f5-9a04-1bc617bea51e.e7a8284e-9222-4ceb-88b6-31df0b381032 is being set with open permissions: ugo+rw
Jul 14 16:41:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-04d55288-6fda-4fab-b85e-ad889de568e3 tempest-ProjectReaderTests-1127203843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c7644d56-9f5e-41f5-9a04-1bc617bea51e.e7a8284e-9222-4ceb-88b6-31df0b381032 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:07 devstack sudo[104523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c7644d56-9f5e-41f5-9a04-1bc617bea51e.e7a8284e-9222-4ceb-88b6-31df0b381032
Jul 14 16:41:07 devstack sudo[104523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:07 devstack sudo[104523]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-04d55288-6fda-4fab-b85e-ad889de568e3 tempest-ProjectReaderTests-1127203843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c7644d56-9f5e-41f5-9a04-1bc617bea51e.e7a8284e-9222-4ceb-88b6-31df0b381032" returned: 0 in 0.244s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-04d55288-6fda-4fab-b85e-ad889de568e3 tempest-ProjectReaderTests-1127203843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c7644d56-9f5e-41f5-9a04-1bc617bea51e.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:07 devstack sudo[104526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c7644d56-9f5e-41f5-9a04-1bc617bea51e.info
Jul 14 16:41:07 devstack sudo[104526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:07 devstack sudo[104526]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-04d55288-6fda-4fab-b85e-ad889de568e3 tempest-ProjectReaderTests-1127203843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c7644d56-9f5e-41f5-9a04-1bc617bea51e.info" returned: 0 in 0.259s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:07 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-04d55288-6fda-4fab-b85e-ad889de568e3 tempest-ProjectReaderTests-1127203843 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c7644d56-9f5e-41f5-9a04-1bc617bea51e.info is being set with open permissions: ugo+rw
Jul 14 16:41:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-04d55288-6fda-4fab-b85e-ad889de568e3 tempest-ProjectReaderTests-1127203843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c7644d56-9f5e-41f5-9a04-1bc617bea51e.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:07 devstack sudo[104543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c7644d56-9f5e-41f5-9a04-1bc617bea51e.info
Jul 14 16:41:07 devstack sudo[104543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:08 devstack sudo[104543]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-04d55288-6fda-4fab-b85e-ad889de568e3 tempest-ProjectReaderTests-1127203843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c7644d56-9f5e-41f5-9a04-1bc617bea51e.info" returned: 0 in 0.293s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-04d55288-6fda-4fab-b85e-ad889de568e3 tempest-ProjectReaderTests-1127203843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.969s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-4a4ab319-ae9c-44a2-8626-f3db3da3530b tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.115s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:08 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-4a4ab319-ae9c-44a2-8626-f3db3da3530b tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:41:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-135920939',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06e45220-7003-4249-9506-9fe46b9c8f55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa8cce6d04344298b32ee2746c8ad475',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:41:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:41:03Z,use_quota=True,user_id='0e95301afe7c4871a5ee550e46523691',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:41:08 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-4a4ab319-ae9c-44a2-8626-f3db3da3530b tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Creating volume 06e45220-7003-4249-9506-9fe46b9c8f55 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:41:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-4a4ab319-ae9c-44a2-8626-f3db3da3530b tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-4a4ab319-ae9c-44a2-8626-f3db3da3530b tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:08 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-4a4ab319-ae9c-44a2-8626-f3db3da3530b tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:41:08 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-4a4ab319-ae9c-44a2-8626-f3db3da3530b tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:41:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-4a4ab319-ae9c-44a2-8626-f3db3da3530b tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:08 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-4a4ab319-ae9c-44a2-8626-f3db3da3530b tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:41:08 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-4a4ab319-ae9c-44a2-8626-f3db3da3530b tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:41:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4a4ab319-ae9c-44a2-8626-f3db3da3530b tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-06e45220-7003-4249-9506-9fe46b9c8f55 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:08 devstack sudo[104568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-06e45220-7003-4249-9506-9fe46b9c8f55 1073741824
Jul 14 16:41:08 devstack sudo[104568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:08 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-04d55288-6fda-4fab-b85e-ad889de568e3 tempest-ProjectReaderTests-1127203843 None] Create snapshot completed successfully
Jul 14 16:41:08 devstack sudo[104568]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4a4ab319-ae9c-44a2-8626-f3db3da3530b tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-06e45220-7003-4249-9506-9fe46b9c8f55 1073741824" returned: 0 in 0.417s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4a4ab319-ae9c-44a2-8626-f3db3da3530b tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-06e45220-7003-4249-9506-9fe46b9c8f55 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:08 devstack sudo[104574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-06e45220-7003-4249-9506-9fe46b9c8f55
Jul 14 16:41:08 devstack sudo[104574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:08 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-25a8f8cf-f46a-41f5-bd75-d9a443e39b26 tempest-ProjectReaderTests-1127203843 None] Acquiring lock "cinder-e7a8284e-9222-4ceb-88b6-31df0b381032-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:41:08 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-25a8f8cf-f46a-41f5-bd75-d9a443e39b26 tempest-ProjectReaderTests-1127203843 None] Lock "cinder-e7a8284e-9222-4ceb-88b6-31df0b381032-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:41:08 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-25a8f8cf-f46a-41f5-bd75-d9a443e39b26 tempest-ProjectReaderTests-1127203843 None] Acquiring lock "cinder-quobyte-c7644d56-9f5e-41f5-9a04-1bc617bea51e" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:41:08 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-25a8f8cf-f46a-41f5-bd75-d9a443e39b26 tempest-ProjectReaderTests-1127203843 None] Lock "cinder-quobyte-c7644d56-9f5e-41f5-9a04-1bc617bea51e" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:41:08 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-25a8f8cf-f46a-41f5-bd75-d9a443e39b26 tempest-ProjectReaderTests-1127203843 None] Acquiring lock "cinder-quobyte-e7a8284e-9222-4ceb-88b6-31df0b381032" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:41:08 devstack sudo[104574]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4a4ab319-ae9c-44a2-8626-f3db3da3530b tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-06e45220-7003-4249-9506-9fe46b9c8f55" returned: 0 in 0.282s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:08 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-4a4ab319-ae9c-44a2-8626-f3db3da3530b tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:41:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-4a4ab319-ae9c-44a2-8626-f3db3da3530b tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.747s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:08 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-25a8f8cf-f46a-41f5-bd75-d9a443e39b26 tempest-ProjectReaderTests-1127203843 None] Lock "cinder-quobyte-e7a8284e-9222-4ceb-88b6-31df0b381032" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:41:08 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-25a8f8cf-f46a-41f5-bd75-d9a443e39b26 tempest-ProjectReaderTests-1127203843 None] Deleting offline snapshot e7a8284e-9222-4ceb-88b6-31df0b381032 of volume c7644d56-9f5e-41f5-9a04-1bc617bea51e {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 16:41:08 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-25a8f8cf-f46a-41f5-bd75-d9a443e39b26 tempest-ProjectReaderTests-1127203843 None] snapshot_file for this snap is: volume-c7644d56-9f5e-41f5-9a04-1bc617bea51e.e7a8284e-9222-4ceb-88b6-31df0b381032 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 16:41:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-48314197-2c85-433c-9f38-56dd33b2ad25 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.506s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:08 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-48314197-2c85-433c-9f38-56dd33b2ad25 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:41:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-894338724',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40663ea6-b031-41dc-b51a-656314c0d687,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa8cce6d04344298b32ee2746c8ad475',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:41:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:41:03Z,use_quota=True,user_id='0e95301afe7c4871a5ee550e46523691',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:41:08 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-48314197-2c85-433c-9f38-56dd33b2ad25 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Creating volume 40663ea6-b031-41dc-b51a-656314c0d687 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:41:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-48314197-2c85-433c-9f38-56dd33b2ad25 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-48314197-2c85-433c-9f38-56dd33b2ad25 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:08 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-48314197-2c85-433c-9f38-56dd33b2ad25 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:41:09 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-48314197-2c85-433c-9f38-56dd33b2ad25 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:41:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-48314197-2c85-433c-9f38-56dd33b2ad25 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:09 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-48314197-2c85-433c-9f38-56dd33b2ad25 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:41:09 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-48314197-2c85-433c-9f38-56dd33b2ad25 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:41:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-48314197-2c85-433c-9f38-56dd33b2ad25 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-40663ea6-b031-41dc-b51a-656314c0d687 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:09 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b7a211a-1dd9-4005-8677-3e33d3bf56c5]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:41:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-25a8f8cf-f46a-41f5-bd75-d9a443e39b26 tempest-ProjectReaderTests-1127203843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c7644d56-9f5e-41f5-9a04-1bc617bea51e.e7a8284e-9222-4ceb-88b6-31df0b381032 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:09 devstack sudo[104577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-40663ea6-b031-41dc-b51a-656314c0d687 1073741824
Jul 14 16:41:09 devstack sudo[104577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:09 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4a4ab319-ae9c-44a2-8626-f3db3da3530b tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74316f6f-53ef-4998-bd19-2c8179286775) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06e45220-7003-4249-9506-9fe46b9c8f55', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:09 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4a4ab319-ae9c-44a2-8626-f3db3da3530b tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b029272e-dda1-4abc-bc60-997379379c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:09 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-4a4ab319-ae9c-44a2-8626-f3db3da3530b tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Volume volume-06e45220-7003-4249-9506-9fe46b9c8f55 (06e45220-7003-4249-9506-9fe46b9c8f55): created successfully
Jul 14 16:41:09 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4a4ab319-ae9c-44a2-8626-f3db3da3530b tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b029272e-dda1-4abc-bc60-997379379c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:09 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4a4ab319-ae9c-44a2-8626-f3db3da3530b tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Flow 'volume_create_manager' (2f292829-ad55-4870-9734-4c6e5e99e0de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:41:09 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-4a4ab319-ae9c-44a2-8626-f3db3da3530b tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Created volume successfully.
Jul 14 16:41:09 devstack sudo[104578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c7644d56-9f5e-41f5-9a04-1bc617bea51e.e7a8284e-9222-4ceb-88b6-31df0b381032
Jul 14 16:41:09 devstack sudo[104578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:09 devstack sudo[104578]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-25a8f8cf-f46a-41f5-bd75-d9a443e39b26 tempest-ProjectReaderTests-1127203843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c7644d56-9f5e-41f5-9a04-1bc617bea51e.e7a8284e-9222-4ceb-88b6-31df0b381032" returned: 0 in 0.426s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:09 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-25a8f8cf-f46a-41f5-bd75-d9a443e39b26 tempest-ProjectReaderTests-1127203843 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7644d56-9f5e-41f5-9a04-1bc617bea51e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 16:41:09 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[4255bab2-9385-4ba7-b1bb-14141719d705]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:41:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-25a8f8cf-f46a-41f5-bd75-d9a443e39b26 tempest-ProjectReaderTests-1127203843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c7644d56-9f5e-41f5-9a04-1bc617bea51e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:09 devstack sudo[104577]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-48314197-2c85-433c-9f38-56dd33b2ad25 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-40663ea6-b031-41dc-b51a-656314c0d687 1073741824" returned: 0 in 0.489s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-48314197-2c85-433c-9f38-56dd33b2ad25 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-40663ea6-b031-41dc-b51a-656314c0d687 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:09 devstack sudo[104591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-40663ea6-b031-41dc-b51a-656314c0d687
Jul 14 16:41:09 devstack sudo[104591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:09 devstack sudo[104589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c7644d56-9f5e-41f5-9a04-1bc617bea51e
Jul 14 16:41:09 devstack sudo[104589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:09 devstack sudo[104591]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-48314197-2c85-433c-9f38-56dd33b2ad25 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-40663ea6-b031-41dc-b51a-656314c0d687" returned: 0 in 0.250s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:09 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-48314197-2c85-433c-9f38-56dd33b2ad25 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:41:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-48314197-2c85-433c-9f38-56dd33b2ad25 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-65c6775e-d4ea-4fa9-ac24-30fb42620f30 tempest-CreateVolumesFromSnapshotTest-860857562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.928s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:09 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-65c6775e-d4ea-4fa9-ac24-30fb42620f30 tempest-CreateVolumesFromSnapshotTest-860857562 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:41:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-447089626',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd2a3da3-1370-48f3-beed-8d04840a309f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e08a088459f34bb891367dfbb94a6f83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:41:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:41:05Z,use_quota=True,user_id='1e6fa70abe9c48e2a52755e148363909',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:41:09 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-65c6775e-d4ea-4fa9-ac24-30fb42620f30 tempest-CreateVolumesFromSnapshotTest-860857562 None] Creating volume cd2a3da3-1370-48f3-beed-8d04840a309f {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:41:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-65c6775e-d4ea-4fa9-ac24-30fb42620f30 tempest-CreateVolumesFromSnapshotTest-860857562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-65c6775e-d4ea-4fa9-ac24-30fb42620f30 tempest-CreateVolumesFromSnapshotTest-860857562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:09 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-65c6775e-d4ea-4fa9-ac24-30fb42620f30 tempest-CreateVolumesFromSnapshotTest-860857562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:41:09 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-65c6775e-d4ea-4fa9-ac24-30fb42620f30 tempest-CreateVolumesFromSnapshotTest-860857562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:41:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-65c6775e-d4ea-4fa9-ac24-30fb42620f30 tempest-CreateVolumesFromSnapshotTest-860857562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:09 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-65c6775e-d4ea-4fa9-ac24-30fb42620f30 tempest-CreateVolumesFromSnapshotTest-860857562 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:41:09 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-65c6775e-d4ea-4fa9-ac24-30fb42620f30 tempest-CreateVolumesFromSnapshotTest-860857562 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:41:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-65c6775e-d4ea-4fa9-ac24-30fb42620f30 tempest-CreateVolumesFromSnapshotTest-860857562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cd2a3da3-1370-48f3-beed-8d04840a309f 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:09 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-48314197-2c85-433c-9f38-56dd33b2ad25 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90fe1d4d-84a8-4c2f-b7ef-20c22d9d7268) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40663ea6-b031-41dc-b51a-656314c0d687', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:09 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-48314197-2c85-433c-9f38-56dd33b2ad25 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (805628f8-a044-45a4-a6da-52470f1d4b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:09 devstack sudo[104597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cd2a3da3-1370-48f3-beed-8d04840a309f 1073741824
Jul 14 16:41:09 devstack sudo[104597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:09 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-48314197-2c85-433c-9f38-56dd33b2ad25 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Volume volume-40663ea6-b031-41dc-b51a-656314c0d687 (40663ea6-b031-41dc-b51a-656314c0d687): created successfully
Jul 14 16:41:09 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-48314197-2c85-433c-9f38-56dd33b2ad25 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (805628f8-a044-45a4-a6da-52470f1d4b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:09 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-48314197-2c85-433c-9f38-56dd33b2ad25 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Flow 'volume_create_manager' (4dc577a6-e351-4818-bf6b-6b5e558d9e41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:41:09 devstack sudo[104589]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:09 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-48314197-2c85-433c-9f38-56dd33b2ad25 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Created volume successfully.
Jul 14 16:41:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-25a8f8cf-f46a-41f5-bd75-d9a443e39b26 tempest-ProjectReaderTests-1127203843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c7644d56-9f5e-41f5-9a04-1bc617bea51e" returned: 0 in 0.400s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-25a8f8cf-f46a-41f5-bd75-d9a443e39b26 tempest-ProjectReaderTests-1127203843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c7644d56-9f5e-41f5-9a04-1bc617bea51e.e7a8284e-9222-4ceb-88b6-31df0b381032 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:09 devstack sudo[104600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c7644d56-9f5e-41f5-9a04-1bc617bea51e.e7a8284e-9222-4ceb-88b6-31df0b381032
Jul 14 16:41:09 devstack sudo[104600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:10 devstack sudo[104597]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:10 devstack sudo[104600]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-65c6775e-d4ea-4fa9-ac24-30fb42620f30 tempest-CreateVolumesFromSnapshotTest-860857562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cd2a3da3-1370-48f3-beed-8d04840a309f 1073741824" returned: 0 in 0.449s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-25a8f8cf-f46a-41f5-bd75-d9a443e39b26 tempest-ProjectReaderTests-1127203843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c7644d56-9f5e-41f5-9a04-1bc617bea51e.e7a8284e-9222-4ceb-88b6-31df0b381032" returned: 0 in 0.373s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-25a8f8cf-f46a-41f5-bd75-d9a443e39b26 tempest-ProjectReaderTests-1127203843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c7644d56-9f5e-41f5-9a04-1bc617bea51e.e7a8284e-9222-4ceb-88b6-31df0b381032 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:10 devstack sudo[104609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c7644d56-9f5e-41f5-9a04-1bc617bea51e.e7a8284e-9222-4ceb-88b6-31df0b381032
Jul 14 16:41:10 devstack sudo[104609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-65c6775e-d4ea-4fa9-ac24-30fb42620f30 tempest-CreateVolumesFromSnapshotTest-860857562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cd2a3da3-1370-48f3-beed-8d04840a309f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:10 devstack sudo[104611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cd2a3da3-1370-48f3-beed-8d04840a309f
Jul 14 16:41:10 devstack sudo[104611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:10 devstack sudo[104609]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-25a8f8cf-f46a-41f5-bd75-d9a443e39b26 tempest-ProjectReaderTests-1127203843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c7644d56-9f5e-41f5-9a04-1bc617bea51e.e7a8284e-9222-4ceb-88b6-31df0b381032" returned: 0 in 0.269s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:10 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-25a8f8cf-f46a-41f5-bd75-d9a443e39b26 tempest-ProjectReaderTests-1127203843 None] Lock "cinder-quobyte-e7a8284e-9222-4ceb-88b6-31df0b381032" released by "_delete_snapshot" :: held 1.583s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:41:10 devstack sudo[104611]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:10 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-25a8f8cf-f46a-41f5-bd75-d9a443e39b26 tempest-ProjectReaderTests-1127203843 None] Lock "cinder-quobyte-c7644d56-9f5e-41f5-9a04-1bc617bea51e" released by "delete_snapshot" :: held 1.613s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:41:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-65c6775e-d4ea-4fa9-ac24-30fb42620f30 tempest-CreateVolumesFromSnapshotTest-860857562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cd2a3da3-1370-48f3-beed-8d04840a309f" returned: 0 in 0.271s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:10 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-65c6775e-d4ea-4fa9-ac24-30fb42620f30 tempest-CreateVolumesFromSnapshotTest-860857562 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:41:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-65c6775e-d4ea-4fa9-ac24-30fb42620f30 tempest-CreateVolumesFromSnapshotTest-860857562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-accd0ce2-8994-45ca-ad56-c9f7859754f5 tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.562s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:10 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-accd0ce2-8994-45ca-ad56-c9f7859754f5 tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:41:02Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb466273-09cb-4d22-9212-41a12aeee8ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cff9f674ec1740b49e3dad4660349444',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:41:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:41:03Z,use_quota=True,user_id='ec853d25fe774258a3d056c74a7aa5af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bda21ad-0436-4f8a-991e-a07fa7afc43e),volume_type_id=9bda21ad-0436-4f8a-991e-a07fa7afc43e)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:41:10 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-accd0ce2-8994-45ca-ad56-c9f7859754f5 tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] Creating volume fb466273-09cb-4d22-9212-41a12aeee8ef {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:41:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-accd0ce2-8994-45ca-ad56-c9f7859754f5 tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-accd0ce2-8994-45ca-ad56-c9f7859754f5 tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:10 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-accd0ce2-8994-45ca-ad56-c9f7859754f5 tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:41:10 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-accd0ce2-8994-45ca-ad56-c9f7859754f5 tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:41:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-accd0ce2-8994-45ca-ad56-c9f7859754f5 tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:10 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-accd0ce2-8994-45ca-ad56-c9f7859754f5 tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:41:10 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-accd0ce2-8994-45ca-ad56-c9f7859754f5 tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:41:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-accd0ce2-8994-45ca-ad56-c9f7859754f5 tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fb466273-09cb-4d22-9212-41a12aeee8ef 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:10 devstack sudo[104615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fb466273-09cb-4d22-9212-41a12aeee8ef 1073741824
Jul 14 16:41:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-65c6775e-d4ea-4fa9-ac24-30fb42620f30 tempest-CreateVolumesFromSnapshotTest-860857562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71dbfb71-a5f6-4822-a067-b58b36c40f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd2a3da3-1370-48f3-beed-8d04840a309f', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:10 devstack sudo[104615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-65c6775e-d4ea-4fa9-ac24-30fb42620f30 tempest-CreateVolumesFromSnapshotTest-860857562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc15e5ca-e1f3-4698-860c-9ac33514e21e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:10 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-65c6775e-d4ea-4fa9-ac24-30fb42620f30 tempest-CreateVolumesFromSnapshotTest-860857562 None] Volume volume-cd2a3da3-1370-48f3-beed-8d04840a309f (cd2a3da3-1370-48f3-beed-8d04840a309f): created successfully
Jul 14 16:41:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-65c6775e-d4ea-4fa9-ac24-30fb42620f30 tempest-CreateVolumesFromSnapshotTest-860857562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc15e5ca-e1f3-4698-860c-9ac33514e21e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-65c6775e-d4ea-4fa9-ac24-30fb42620f30 tempest-CreateVolumesFromSnapshotTest-860857562 None] Flow 'volume_create_manager' (ad9409c2-bbac-433f-b273-ccf3f34cdfc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:41:10 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-65c6775e-d4ea-4fa9-ac24-30fb42620f30 tempest-CreateVolumesFromSnapshotTest-860857562 None] Created volume successfully.
Jul 14 16:41:10 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-25a8f8cf-f46a-41f5-bd75-d9a443e39b26 tempest-ProjectReaderTests-1127203843 None] Created reservations ['4dda053a-ce7d-4960-8632-ff774ee31b38', '27635393-fe45-4fe3-bf53-8193420e1ddc', '98be3561-e56e-4f07-abc5-fca319f8fc7c', '0c3e92c8-b3cf-4f8d-bf08-8b3e9800e56d'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:41:10 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-25a8f8cf-f46a-41f5-bd75-d9a443e39b26 tempest-ProjectReaderTests-1127203843 None] Delete snapshot completed successfully.
Jul 14 16:41:10 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-25a8f8cf-f46a-41f5-bd75-d9a443e39b26 tempest-ProjectReaderTests-1127203843 None] Lock "cinder-e7a8284e-9222-4ceb-88b6-31df0b381032-delete_snapshot" released by "delete_snapshot" :: held 1.817s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:41:11 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-207eb739-64e2-4205-9d75-6369085ca355 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Acquiring lock "cinder-40663ea6-b031-41dc-b51a-656314c0d687-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:41:11 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-207eb739-64e2-4205-9d75-6369085ca355 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Lock "cinder-40663ea6-b031-41dc-b51a-656314c0d687-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:41:11 devstack sudo[104615]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-accd0ce2-8994-45ca-ad56-c9f7859754f5 tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fb466273-09cb-4d22-9212-41a12aeee8ef 1073741824" returned: 0 in 0.475s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:11 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-207eb739-64e2-4205-9d75-6369085ca355 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Acquiring lock "cinder-quobyte-40663ea6-b031-41dc-b51a-656314c0d687" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:41:11 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-207eb739-64e2-4205-9d75-6369085ca355 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Lock "cinder-quobyte-40663ea6-b031-41dc-b51a-656314c0d687" acquired by "delete_volume" :: waited 0.027s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:41:11 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e788975d-df20-45a6-8cfd-890f25e9d77e tempest-ProjectReaderTests-1127203843 None] Acquiring lock "cinder-c7644d56-9f5e-41f5-9a04-1bc617bea51e-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:41:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-accd0ce2-8994-45ca-ad56-c9f7859754f5 tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fb466273-09cb-4d22-9212-41a12aeee8ef {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:11 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[7020cd9b-a379-46b9-9397-74e8b2d637c3]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:41:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-207eb739-64e2-4205-9d75-6369085ca355 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-40663ea6-b031-41dc-b51a-656314c0d687 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:11 devstack sudo[104621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fb466273-09cb-4d22-9212-41a12aeee8ef
Jul 14 16:41:11 devstack sudo[104621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:11 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e788975d-df20-45a6-8cfd-890f25e9d77e tempest-ProjectReaderTests-1127203843 None] Lock "cinder-c7644d56-9f5e-41f5-9a04-1bc617bea51e-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:41:11 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e788975d-df20-45a6-8cfd-890f25e9d77e tempest-ProjectReaderTests-1127203843 None] Acquiring lock "cinder-quobyte-c7644d56-9f5e-41f5-9a04-1bc617bea51e" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:41:11 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e788975d-df20-45a6-8cfd-890f25e9d77e tempest-ProjectReaderTests-1127203843 None] Lock "cinder-quobyte-c7644d56-9f5e-41f5-9a04-1bc617bea51e" acquired by "delete_volume" :: waited 0.017s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:41:11 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[a509d3d4-d4f0-4de9-8980-c50c117b4e01]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:41:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e788975d-df20-45a6-8cfd-890f25e9d77e tempest-ProjectReaderTests-1127203843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c7644d56-9f5e-41f5-9a04-1bc617bea51e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:11 devstack sudo[104622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-40663ea6-b031-41dc-b51a-656314c0d687
Jul 14 16:41:11 devstack sudo[104622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:11 devstack sudo[104624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c7644d56-9f5e-41f5-9a04-1bc617bea51e
Jul 14 16:41:11 devstack sudo[104624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:11 devstack sudo[104621]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-accd0ce2-8994-45ca-ad56-c9f7859754f5 tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fb466273-09cb-4d22-9212-41a12aeee8ef" returned: 0 in 0.300s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:11 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-accd0ce2-8994-45ca-ad56-c9f7859754f5 tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:41:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-accd0ce2-8994-45ca-ad56-c9f7859754f5 tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-519ad6bf-7e91-4a41-b344-d71c5f9ae727 tempest-CreateVolumesFromSnapshotTest-860857562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.237s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:11 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-519ad6bf-7e91-4a41-b344-d71c5f9ae727 tempest-CreateVolumesFromSnapshotTest-860857562 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:41:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-761149262',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aae6fc0b-4a87-4c3e-bbe6-828a5344bbbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e08a088459f34bb891367dfbb94a6f83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:41:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:41:05Z,use_quota=True,user_id='1e6fa70abe9c48e2a52755e148363909',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:41:11 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-519ad6bf-7e91-4a41-b344-d71c5f9ae727 tempest-CreateVolumesFromSnapshotTest-860857562 None] Creating volume aae6fc0b-4a87-4c3e-bbe6-828a5344bbbb {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:41:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-519ad6bf-7e91-4a41-b344-d71c5f9ae727 tempest-CreateVolumesFromSnapshotTest-860857562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-519ad6bf-7e91-4a41-b344-d71c5f9ae727 tempest-CreateVolumesFromSnapshotTest-860857562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:11 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-519ad6bf-7e91-4a41-b344-d71c5f9ae727 tempest-CreateVolumesFromSnapshotTest-860857562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:41:11 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-519ad6bf-7e91-4a41-b344-d71c5f9ae727 tempest-CreateVolumesFromSnapshotTest-860857562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:41:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-519ad6bf-7e91-4a41-b344-d71c5f9ae727 tempest-CreateVolumesFromSnapshotTest-860857562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:11 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-519ad6bf-7e91-4a41-b344-d71c5f9ae727 tempest-CreateVolumesFromSnapshotTest-860857562 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:41:11 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-519ad6bf-7e91-4a41-b344-d71c5f9ae727 tempest-CreateVolumesFromSnapshotTest-860857562 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:41:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-519ad6bf-7e91-4a41-b344-d71c5f9ae727 tempest-CreateVolumesFromSnapshotTest-860857562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-aae6fc0b-4a87-4c3e-bbe6-828a5344bbbb 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:11 devstack sudo[104628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-aae6fc0b-4a87-4c3e-bbe6-828a5344bbbb 1073741824
Jul 14 16:41:11 devstack sudo[104628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:11 devstack cinder-volume[87166]: DEBUG cinder.volume.volume_utils [None req-accd0ce2-8994-45ca-ad56-c9f7859754f5 tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] Attempting download of 4ceb308d-0303-4f0e-9d05-c124719f1648 ((None, [{'url': 'file:///opt/stack/data/glance/images/4ceb308d-0303-4f0e-9d05-c124719f1648', 'metadata': {}}])) to volume fb466273-09cb-4d22-9212-41a12aeee8ef. {{(pid=87166) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 14 16:41:11 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab221f78-1ff5-46b0-9902-c9f4b606e10b]: (4, 'raw') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:41:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-accd0ce2-8994-45ca-ad56-c9f7859754f5 tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4ceb308d-0303-4f0e-9d05-c124719f1648_b9phn48a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:11 devstack sudo[104622]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-207eb739-64e2-4205-9d75-6369085ca355 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-40663ea6-b031-41dc-b51a-656314c0d687" returned: 0 in 0.464s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-207eb739-64e2-4205-9d75-6369085ca355 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-40663ea6-b031-41dc-b51a-656314c0d687 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:11 devstack sudo[104636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-40663ea6-b031-41dc-b51a-656314c0d687
Jul 14 16:41:11 devstack sudo[104636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:11 devstack sudo[104633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4ceb308d-0303-4f0e-9d05-c124719f1648_b9phn48a
Jul 14 16:41:11 devstack sudo[104624]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:11 devstack sudo[104633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e788975d-df20-45a6-8cfd-890f25e9d77e tempest-ProjectReaderTests-1127203843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c7644d56-9f5e-41f5-9a04-1bc617bea51e" returned: 0 in 0.471s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e788975d-df20-45a6-8cfd-890f25e9d77e tempest-ProjectReaderTests-1127203843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c7644d56-9f5e-41f5-9a04-1bc617bea51e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:11 devstack sudo[104642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c7644d56-9f5e-41f5-9a04-1bc617bea51e
Jul 14 16:41:11 devstack sudo[104642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:11 devstack sudo[104636]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-207eb739-64e2-4205-9d75-6369085ca355 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-40663ea6-b031-41dc-b51a-656314c0d687" returned: 0 in 0.320s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:11 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-207eb739-64e2-4205-9d75-6369085ca355 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Lock "cinder-quobyte-40663ea6-b031-41dc-b51a-656314c0d687" released by "delete_volume" :: held 0.860s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:41:11 devstack sudo[104633]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-accd0ce2-8994-45ca-ad56-c9f7859754f5 tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4ceb308d-0303-4f0e-9d05-c124719f1648_b9phn48a" returned: 0 in 0.385s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-accd0ce2-8994-45ca-ad56-c9f7859754f5 tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ceb308d-0303-4f0e-9d05-c124719f1648_b9phn48a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:11 devstack sudo[104628]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-519ad6bf-7e91-4a41-b344-d71c5f9ae727 tempest-CreateVolumesFromSnapshotTest-860857562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-aae6fc0b-4a87-4c3e-bbe6-828a5344bbbb 1073741824" returned: 0 in 0.542s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-519ad6bf-7e91-4a41-b344-d71c5f9ae727 tempest-CreateVolumesFromSnapshotTest-860857562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-aae6fc0b-4a87-4c3e-bbe6-828a5344bbbb {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:12 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-207eb739-64e2-4205-9d75-6369085ca355 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Created reservations ['0fc3d2c5-283d-4f64-8d25-26476e3e0fff', 'c52a0911-b676-4fcc-ab7f-c44f54c24d4a', 'a7f1437b-0811-467b-aad7-978dc3007963', '9f88f6bd-010c-43eb-bb82-b4a1c162de6d'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:41:12 devstack sudo[104642]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:12 devstack sudo[104650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-aae6fc0b-4a87-4c3e-bbe6-828a5344bbbb
Jul 14 16:41:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e788975d-df20-45a6-8cfd-890f25e9d77e tempest-ProjectReaderTests-1127203843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c7644d56-9f5e-41f5-9a04-1bc617bea51e" returned: 0 in 0.352s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:12 devstack sudo[104650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:12 devstack sudo[104648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ceb308d-0303-4f0e-9d05-c124719f1648_b9phn48a
Jul 14 16:41:12 devstack sudo[104648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:12 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e788975d-df20-45a6-8cfd-890f25e9d77e tempest-ProjectReaderTests-1127203843 None] Lock "cinder-quobyte-c7644d56-9f5e-41f5-9a04-1bc617bea51e" released by "delete_volume" :: held 0.899s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:41:12 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d93a9236-6c20-462d-b71f-99170b5fba62 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Acquiring lock "cinder-06e45220-7003-4249-9506-9fe46b9c8f55-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:41:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-207eb739-64e2-4205-9d75-6369085ca355 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-207eb739-64e2-4205-9d75-6369085ca355 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:12 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-207eb739-64e2-4205-9d75-6369085ca355 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:41:12 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-207eb739-64e2-4205-9d75-6369085ca355 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:41:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-207eb739-64e2-4205-9d75-6369085ca355 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-207eb739-64e2-4205-9d75-6369085ca355 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:12 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d93a9236-6c20-462d-b71f-99170b5fba62 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Lock "cinder-06e45220-7003-4249-9506-9fe46b9c8f55-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:41:12 devstack sudo[104659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:41:12 devstack sudo[104659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:12 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-e788975d-df20-45a6-8cfd-890f25e9d77e tempest-ProjectReaderTests-1127203843 None] Created reservations ['e0bac07d-141d-458e-a760-3662a510fc0d', '55bfa4cc-09b3-46a6-9baa-4cfda12c25ac', 'c23fad3f-e446-4ea8-a031-7ca938fae6bd', '5dd96b70-31cc-4273-9c58-622ba4fe930f'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:41:12 devstack sudo[104648]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:12 devstack sudo[104650]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-accd0ce2-8994-45ca-ad56-c9f7859754f5 tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ceb308d-0303-4f0e-9d05-c124719f1648_b9phn48a" returned: 1 in 0.458s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-accd0ce2-8994-45ca-ad56-c9f7859754f5 tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ceb308d-0303-4f0e-9d05-c124719f1648_b9phn48a' failed. Not Retrying. {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 16:41:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-519ad6bf-7e91-4a41-b344-d71c5f9ae727 tempest-CreateVolumesFromSnapshotTest-860857562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-aae6fc0b-4a87-4c3e-bbe6-828a5344bbbb" returned: 0 in 0.399s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:12 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-519ad6bf-7e91-4a41-b344-d71c5f9ae727 tempest-CreateVolumesFromSnapshotTest-860857562 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:41:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-519ad6bf-7e91-4a41-b344-d71c5f9ae727 tempest-CreateVolumesFromSnapshotTest-860857562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:12 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[a17bf93f-02dc-4be3-8e02-763335f80cbf]: (4, 'raw') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:41:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c127c249-cadf-4b07-be0c-b26bf0a88c4f tempest-CreateVolumesFromSnapshotTest-860857562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.779s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:12 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-c127c249-cadf-4b07-be0c-b26bf0a88c4f tempest-CreateVolumesFromSnapshotTest-860857562 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:41:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1180288437',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04d45231-9072-49b3-b2ce-ef3920fd8177,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e08a088459f34bb891367dfbb94a6f83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:41:06Z,use_quota=True,user_id='1e6fa70abe9c48e2a52755e148363909',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:41:12 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-c127c249-cadf-4b07-be0c-b26bf0a88c4f tempest-CreateVolumesFromSnapshotTest-860857562 None] Creating volume 04d45231-9072-49b3-b2ce-ef3920fd8177 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:41:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c127c249-cadf-4b07-be0c-b26bf0a88c4f tempest-CreateVolumesFromSnapshotTest-860857562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c127c249-cadf-4b07-be0c-b26bf0a88c4f tempest-CreateVolumesFromSnapshotTest-860857562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:12 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-c127c249-cadf-4b07-be0c-b26bf0a88c4f tempest-CreateVolumesFromSnapshotTest-860857562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:41:12 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-c127c249-cadf-4b07-be0c-b26bf0a88c4f tempest-CreateVolumesFromSnapshotTest-860857562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:41:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c127c249-cadf-4b07-be0c-b26bf0a88c4f tempest-CreateVolumesFromSnapshotTest-860857562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:12 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-c127c249-cadf-4b07-be0c-b26bf0a88c4f tempest-CreateVolumesFromSnapshotTest-860857562 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:41:12 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-c127c249-cadf-4b07-be0c-b26bf0a88c4f tempest-CreateVolumesFromSnapshotTest-860857562 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:41:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c127c249-cadf-4b07-be0c-b26bf0a88c4f tempest-CreateVolumesFromSnapshotTest-860857562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-04d45231-9072-49b3-b2ce-ef3920fd8177 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-accd0ce2-8994-45ca-ad56-c9f7859754f5 tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4ceb308d-0303-4f0e-9d05-c124719f1648_ob7t21o3devstack@QuobyteHD {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:12 devstack sudo[104664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-04d45231-9072-49b3-b2ce-ef3920fd8177 1073741824
Jul 14 16:41:12 devstack sudo[104664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:12 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d93a9236-6c20-462d-b71f-99170b5fba62 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Acquiring lock "cinder-quobyte-06e45220-7003-4249-9506-9fe46b9c8f55" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:41:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-519ad6bf-7e91-4a41-b344-d71c5f9ae727 tempest-CreateVolumesFromSnapshotTest-860857562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b69d778b-60de-4597-8df1-5d7948262973) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aae6fc0b-4a87-4c3e-bbe6-828a5344bbbb', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-519ad6bf-7e91-4a41-b344-d71c5f9ae727 tempest-CreateVolumesFromSnapshotTest-860857562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3dbc135-7152-42aa-8164-0db2118c693e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:12 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d93a9236-6c20-462d-b71f-99170b5fba62 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Lock "cinder-quobyte-06e45220-7003-4249-9506-9fe46b9c8f55" acquired by "delete_volume" :: waited 0.045s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:41:12 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-519ad6bf-7e91-4a41-b344-d71c5f9ae727 tempest-CreateVolumesFromSnapshotTest-860857562 None] Volume volume-aae6fc0b-4a87-4c3e-bbe6-828a5344bbbb (aae6fc0b-4a87-4c3e-bbe6-828a5344bbbb): created successfully
Jul 14 16:41:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-519ad6bf-7e91-4a41-b344-d71c5f9ae727 tempest-CreateVolumesFromSnapshotTest-860857562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3dbc135-7152-42aa-8164-0db2118c693e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-519ad6bf-7e91-4a41-b344-d71c5f9ae727 tempest-CreateVolumesFromSnapshotTest-860857562 None] Flow 'volume_create_manager' (ca6b0619-741b-496f-a5ff-60fab1ddcba6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:41:12 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[020c42af-7d6b-486d-9506-d2fe321b33a0]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:41:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d93a9236-6c20-462d-b71f-99170b5fba62 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-06e45220-7003-4249-9506-9fe46b9c8f55 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:12 devstack sudo[104665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4ceb308d-0303-4f0e-9d05-c124719f1648_ob7t21o3devstack@QuobyteHD
Jul 14 16:41:12 devstack sudo[104665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:12 devstack sudo[104659]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e788975d-df20-45a6-8cfd-890f25e9d77e tempest-ProjectReaderTests-1127203843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e788975d-df20-45a6-8cfd-890f25e9d77e tempest-ProjectReaderTests-1127203843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:12 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-e788975d-df20-45a6-8cfd-890f25e9d77e tempest-ProjectReaderTests-1127203843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:41:12 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-e788975d-df20-45a6-8cfd-890f25e9d77e tempest-ProjectReaderTests-1127203843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:41:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e788975d-df20-45a6-8cfd-890f25e9d77e tempest-ProjectReaderTests-1127203843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e788975d-df20-45a6-8cfd-890f25e9d77e tempest-ProjectReaderTests-1127203843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:12 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-519ad6bf-7e91-4a41-b344-d71c5f9ae727 tempest-CreateVolumesFromSnapshotTest-860857562 None] Created volume successfully.
Jul 14 16:41:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-207eb739-64e2-4205-9d75-6369085ca355 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.352s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:12 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-207eb739-64e2-4205-9d75-6369085ca355 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:41:12 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-207eb739-64e2-4205-9d75-6369085ca355 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Deleted volume successfully.
Jul 14 16:41:12 devstack sudo[104670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:41:12 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-207eb739-64e2-4205-9d75-6369085ca355 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Lock "cinder-40663ea6-b031-41dc-b51a-656314c0d687-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:41:12 devstack sudo[104670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:12 devstack sudo[104668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-06e45220-7003-4249-9506-9fe46b9c8f55
Jul 14 16:41:12 devstack sudo[104668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:12 devstack sudo[104665]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-accd0ce2-8994-45ca-ad56-c9f7859754f5 tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4ceb308d-0303-4f0e-9d05-c124719f1648_ob7t21o3devstack@QuobyteHD" returned: 0 in 0.443s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-accd0ce2-8994-45ca-ad56-c9f7859754f5 tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4ceb308d-0303-4f0e-9d05-c124719f1648_ob7t21o3devstack@QuobyteHD {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:13 devstack sudo[104670]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e788975d-df20-45a6-8cfd-890f25e9d77e tempest-ProjectReaderTests-1127203843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.375s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:13 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-e788975d-df20-45a6-8cfd-890f25e9d77e tempest-ProjectReaderTests-1127203843 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:41:13 devstack sudo[104679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4ceb308d-0303-4f0e-9d05-c124719f1648_ob7t21o3devstack@QuobyteHD
Jul 14 16:41:13 devstack sudo[104679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:13 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-e788975d-df20-45a6-8cfd-890f25e9d77e tempest-ProjectReaderTests-1127203843 None] Deleted volume successfully.
Jul 14 16:41:13 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e788975d-df20-45a6-8cfd-890f25e9d77e tempest-ProjectReaderTests-1127203843 None] Lock "cinder-c7644d56-9f5e-41f5-9a04-1bc617bea51e-delete_volume" released by "delete_volume" :: held 1.904s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:41:13 devstack sudo[104664]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c127c249-cadf-4b07-be0c-b26bf0a88c4f tempest-CreateVolumesFromSnapshotTest-860857562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-04d45231-9072-49b3-b2ce-ef3920fd8177 1073741824" returned: 0 in 0.642s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:13 devstack sudo[104668]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d93a9236-6c20-462d-b71f-99170b5fba62 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-06e45220-7003-4249-9506-9fe46b9c8f55" returned: 0 in 0.502s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d93a9236-6c20-462d-b71f-99170b5fba62 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-06e45220-7003-4249-9506-9fe46b9c8f55 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:13 devstack sudo[104685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-06e45220-7003-4249-9506-9fe46b9c8f55
Jul 14 16:41:13 devstack sudo[104685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c127c249-cadf-4b07-be0c-b26bf0a88c4f tempest-CreateVolumesFromSnapshotTest-860857562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-04d45231-9072-49b3-b2ce-ef3920fd8177 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:13 devstack sudo[104687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-04d45231-9072-49b3-b2ce-ef3920fd8177
Jul 14 16:41:13 devstack sudo[104687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:13 devstack sudo[104679]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-accd0ce2-8994-45ca-ad56-c9f7859754f5 tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4ceb308d-0303-4f0e-9d05-c124719f1648_ob7t21o3devstack@QuobyteHD" returned: 1 in 0.372s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-accd0ce2-8994-45ca-ad56-c9f7859754f5 tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4ceb308d-0303-4f0e-9d05-c124719f1648_ob7t21o3devstack@QuobyteHD' failed. Not Retrying. {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 16:41:13 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-accd0ce2-8994-45ca-ad56-c9f7859754f5 tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] 4ceb308d-0303-4f0e-9d05-c124719f1648 was raw, converting to raw {{(pid=87166) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 14 16:41:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-accd0ce2-8994-45ca-ad56-c9f7859754f5 tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_4ceb308d-0303-4f0e-9d05-c124719f1648_ob7t21o3devstack@QuobyteHD /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fb466273-09cb-4d22-9212-41a12aeee8ef {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:13 devstack sudo[104692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_4ceb308d-0303-4f0e-9d05-c124719f1648_ob7t21o3devstack@QuobyteHD /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fb466273-09cb-4d22-9212-41a12aeee8ef
Jul 14 16:41:13 devstack sudo[104692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:13 devstack sudo[104685]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d93a9236-6c20-462d-b71f-99170b5fba62 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-06e45220-7003-4249-9506-9fe46b9c8f55" returned: 0 in 0.290s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:13 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d93a9236-6c20-462d-b71f-99170b5fba62 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Lock "cinder-quobyte-06e45220-7003-4249-9506-9fe46b9c8f55" released by "delete_volume" :: held 0.873s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:41:13 devstack sudo[104687]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c127c249-cadf-4b07-be0c-b26bf0a88c4f tempest-CreateVolumesFromSnapshotTest-860857562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-04d45231-9072-49b3-b2ce-ef3920fd8177" returned: 0 in 0.301s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:13 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-c127c249-cadf-4b07-be0c-b26bf0a88c4f tempest-CreateVolumesFromSnapshotTest-860857562 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:41:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c127c249-cadf-4b07-be0c-b26bf0a88c4f tempest-CreateVolumesFromSnapshotTest-860857562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-121485d4-0616-4cfb-9f3c-c9507d7f2499 tempest-CreateVolumesFromSnapshotTest-860857562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.452s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:13 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-121485d4-0616-4cfb-9f3c-c9507d7f2499 tempest-CreateVolumesFromSnapshotTest-860857562 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:41:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-293854763',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22f06f16-f4a0-4cb6-a1fd-d1751846e892,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e08a088459f34bb891367dfbb94a6f83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:41:06Z,use_quota=True,user_id='1e6fa70abe9c48e2a52755e148363909',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:41:13 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-121485d4-0616-4cfb-9f3c-c9507d7f2499 tempest-CreateVolumesFromSnapshotTest-860857562 None] Creating volume 22f06f16-f4a0-4cb6-a1fd-d1751846e892 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:41:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-121485d4-0616-4cfb-9f3c-c9507d7f2499 tempest-CreateVolumesFromSnapshotTest-860857562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-121485d4-0616-4cfb-9f3c-c9507d7f2499 tempest-CreateVolumesFromSnapshotTest-860857562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:13 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-121485d4-0616-4cfb-9f3c-c9507d7f2499 tempest-CreateVolumesFromSnapshotTest-860857562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:41:13 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-121485d4-0616-4cfb-9f3c-c9507d7f2499 tempest-CreateVolumesFromSnapshotTest-860857562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:41:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-121485d4-0616-4cfb-9f3c-c9507d7f2499 tempest-CreateVolumesFromSnapshotTest-860857562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:13 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-121485d4-0616-4cfb-9f3c-c9507d7f2499 tempest-CreateVolumesFromSnapshotTest-860857562 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:41:13 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-121485d4-0616-4cfb-9f3c-c9507d7f2499 tempest-CreateVolumesFromSnapshotTest-860857562 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:41:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-121485d4-0616-4cfb-9f3c-c9507d7f2499 tempest-CreateVolumesFromSnapshotTest-860857562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-22f06f16-f4a0-4cb6-a1fd-d1751846e892 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:13 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c127c249-cadf-4b07-be0c-b26bf0a88c4f tempest-CreateVolumesFromSnapshotTest-860857562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4bd86d0-35c5-456a-b1e7-5ed81ce010b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04d45231-9072-49b3-b2ce-ef3920fd8177', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:13 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c127c249-cadf-4b07-be0c-b26bf0a88c4f tempest-CreateVolumesFromSnapshotTest-860857562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea910570-b2d7-4dc9-bf9b-b4c49d3d5d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:13 devstack sudo[104696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-22f06f16-f4a0-4cb6-a1fd-d1751846e892 1073741824
Jul 14 16:41:13 devstack sudo[104696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:13 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-c127c249-cadf-4b07-be0c-b26bf0a88c4f tempest-CreateVolumesFromSnapshotTest-860857562 None] Volume volume-04d45231-9072-49b3-b2ce-ef3920fd8177 (04d45231-9072-49b3-b2ce-ef3920fd8177): created successfully
Jul 14 16:41:13 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c127c249-cadf-4b07-be0c-b26bf0a88c4f tempest-CreateVolumesFromSnapshotTest-860857562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea910570-b2d7-4dc9-bf9b-b4c49d3d5d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:13 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c127c249-cadf-4b07-be0c-b26bf0a88c4f tempest-CreateVolumesFromSnapshotTest-860857562 None] Flow 'volume_create_manager' (69eb228b-caef-4b0b-8488-ed81e2d64921) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:41:13 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-d93a9236-6c20-462d-b71f-99170b5fba62 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Created reservations ['ed0d5217-24b8-47cb-a140-1438a7a9f8e3', '8b729980-cb97-4e66-b3d6-b956bf480efd', '3886f084-14c6-4b86-8b52-de2398a631e7', '2bf6f188-b08a-446b-860b-411770ad5c5a'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:41:13 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-c127c249-cadf-4b07-be0c-b26bf0a88c4f tempest-CreateVolumesFromSnapshotTest-860857562 None] Created volume successfully.
Jul 14 16:41:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d93a9236-6c20-462d-b71f-99170b5fba62 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d93a9236-6c20-462d-b71f-99170b5fba62 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:13 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d93a9236-6c20-462d-b71f-99170b5fba62 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:41:13 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d93a9236-6c20-462d-b71f-99170b5fba62 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:41:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d93a9236-6c20-462d-b71f-99170b5fba62 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d93a9236-6c20-462d-b71f-99170b5fba62 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:13 devstack sudo[104701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:41:13 devstack sudo[104701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:13 devstack sudo[104692]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-accd0ce2-8994-45ca-ad56-c9f7859754f5 tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_4ceb308d-0303-4f0e-9d05-c124719f1648_ob7t21o3devstack@QuobyteHD /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fb466273-09cb-4d22-9212-41a12aeee8ef" returned: 0 in 0.442s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:13 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-accd0ce2-8994-45ca-ad56-c9f7859754f5 tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4ceb308d-0303-4f0e-9d05-c124719f1648_ob7t21o3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fb466273-09cb-4d22-9212-41a12aeee8ef {{(pid=87166) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 14 16:41:13 devstack cinder-volume[87166]: INFO cinder.image.image_utils [None req-accd0ce2-8994-45ca-ad56-c9f7859754f5 tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] Converted 0.00 MB image at 0.00 MB/s
Jul 14 16:41:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-accd0ce2-8994-45ca-ad56-c9f7859754f5 tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fb466273-09cb-4d22-9212-41a12aeee8ef 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:13 devstack sudo[104703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fb466273-09cb-4d22-9212-41a12aeee8ef 1G
Jul 14 16:41:13 devstack sudo[104703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:14 devstack sudo[104701]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d93a9236-6c20-462d-b71f-99170b5fba62 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.345s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:14 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-d93a9236-6c20-462d-b71f-99170b5fba62 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:41:14 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-d93a9236-6c20-462d-b71f-99170b5fba62 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Deleted volume successfully.
Jul 14 16:41:14 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d93a9236-6c20-462d-b71f-99170b5fba62 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Lock "cinder-06e45220-7003-4249-9506-9fe46b9c8f55-delete_volume" released by "delete_volume" :: held 1.734s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:41:14 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9ade89b-89a5-49be-8522-989f3d9ff5cc tempest-ProjectReaderTests-1127203843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:41:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d9ade89b-89a5-49be-8522-989f3d9ff5cc tempest-ProjectReaderTests-1127203843 None] Flow 'volume_create_manager' (9589ee03-8ad0-440a-8794-9b81bc00b7ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:41:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d9ade89b-89a5-49be-8522-989f3d9ff5cc tempest-ProjectReaderTests-1127203843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ed3b74a-e5c7-4b16-ac43-3fd7401ea584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:14 devstack sudo[104696]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-121485d4-0616-4cfb-9f3c-c9507d7f2499 tempest-CreateVolumesFromSnapshotTest-860857562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-22f06f16-f4a0-4cb6-a1fd-d1751846e892 1073741824" returned: 0 in 0.657s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d9ade89b-89a5-49be-8522-989f3d9ff5cc tempest-ProjectReaderTests-1127203843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ed3b74a-e5c7-4b16-ac43-3fd7401ea584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:41:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1216320301',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=208de139-203a-4d05-af90-540ed141b5f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='883944e7bf4f4b4dbc774e64e3e27858',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:41:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:41:14Z,use_quota=True,user_id='edcf2b7f48504051a3973d82e7b0fa86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d9ade89b-89a5-49be-8522-989f3d9ff5cc tempest-ProjectReaderTests-1127203843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8aa1b62c-1bb3-4355-8181-4616203ae66b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d9ade89b-89a5-49be-8522-989f3d9ff5cc tempest-ProjectReaderTests-1127203843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8aa1b62c-1bb3-4355-8181-4616203ae66b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d9ade89b-89a5-49be-8522-989f3d9ff5cc tempest-ProjectReaderTests-1127203843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee12c884-9ca1-40f6-b8c8-e0054dcd19f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d9ade89b-89a5-49be-8522-989f3d9ff5cc tempest-ProjectReaderTests-1127203843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee12c884-9ca1-40f6-b8c8-e0054dcd19f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '208de139-203a-4d05-af90-540ed141b5f6', 'volume_name': 'volume-208de139-203a-4d05-af90-540ed141b5f6', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:14 devstack sudo[104703]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d9ade89b-89a5-49be-8522-989f3d9ff5cc tempest-ProjectReaderTests-1127203843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4118bad9-5a48-4d35-84ba-5d85e40cbeb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d9ade89b-89a5-49be-8522-989f3d9ff5cc tempest-ProjectReaderTests-1127203843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4118bad9-5a48-4d35-84ba-5d85e40cbeb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d9ade89b-89a5-49be-8522-989f3d9ff5cc tempest-ProjectReaderTests-1127203843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ca6c689-7a25-4376-bc9f-9b0001fea54d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:14 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-d9ade89b-89a5-49be-8522-989f3d9ff5cc tempest-ProjectReaderTests-1127203843 None] Volume 208de139-203a-4d05-af90-540ed141b5f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-208de139-203a-4d05-af90-540ed141b5f6', 'volume_size': 1}
Jul 14 16:41:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d9ade89b-89a5-49be-8522-989f3d9ff5cc tempest-ProjectReaderTests-1127203843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-accd0ce2-8994-45ca-ad56-c9f7859754f5 tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fb466273-09cb-4d22-9212-41a12aeee8ef 1G" returned: 0 in 0.447s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-121485d4-0616-4cfb-9f3c-c9507d7f2499 tempest-CreateVolumesFromSnapshotTest-860857562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-22f06f16-f4a0-4cb6-a1fd-d1751846e892 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:14 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c74cc0a-d704-4a23-b56a-dfbee2c89a4c]: (4, 'raw') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:41:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-accd0ce2-8994-45ca-ad56-c9f7859754f5 tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fb466273-09cb-4d22-9212-41a12aeee8ef {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:14 devstack sudo[104713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-22f06f16-f4a0-4cb6-a1fd-d1751846e892
Jul 14 16:41:14 devstack sudo[104713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:14 devstack sudo[104714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fb466273-09cb-4d22-9212-41a12aeee8ef
Jul 14 16:41:14 devstack sudo[104714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:14 devstack sudo[104713]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-121485d4-0616-4cfb-9f3c-c9507d7f2499 tempest-CreateVolumesFromSnapshotTest-860857562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-22f06f16-f4a0-4cb6-a1fd-d1751846e892" returned: 0 in 0.281s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:14 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-121485d4-0616-4cfb-9f3c-c9507d7f2499 tempest-CreateVolumesFromSnapshotTest-860857562 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:41:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-121485d4-0616-4cfb-9f3c-c9507d7f2499 tempest-CreateVolumesFromSnapshotTest-860857562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-af937450-3199-4ba7-be4a-8b39d4f96f1f tempest-CreateVolumesFromSnapshotTest-860857562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.065s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:14 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-af937450-3199-4ba7-be4a-8b39d4f96f1f tempest-CreateVolumesFromSnapshotTest-860857562 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:41:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1398894365',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18475d06-503e-471b-a2a1-eeecfb93b990,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e08a088459f34bb891367dfbb94a6f83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:41:06Z,use_quota=True,user_id='1e6fa70abe9c48e2a52755e148363909',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:41:14 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-af937450-3199-4ba7-be4a-8b39d4f96f1f tempest-CreateVolumesFromSnapshotTest-860857562 None] Creating volume 18475d06-503e-471b-a2a1-eeecfb93b990 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:41:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-af937450-3199-4ba7-be4a-8b39d4f96f1f tempest-CreateVolumesFromSnapshotTest-860857562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-af937450-3199-4ba7-be4a-8b39d4f96f1f tempest-CreateVolumesFromSnapshotTest-860857562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:14 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-af937450-3199-4ba7-be4a-8b39d4f96f1f tempest-CreateVolumesFromSnapshotTest-860857562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:41:14 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-af937450-3199-4ba7-be4a-8b39d4f96f1f tempest-CreateVolumesFromSnapshotTest-860857562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:41:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-af937450-3199-4ba7-be4a-8b39d4f96f1f tempest-CreateVolumesFromSnapshotTest-860857562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:14 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-af937450-3199-4ba7-be4a-8b39d4f96f1f tempest-CreateVolumesFromSnapshotTest-860857562 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:41:14 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-af937450-3199-4ba7-be4a-8b39d4f96f1f tempest-CreateVolumesFromSnapshotTest-860857562 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:41:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-af937450-3199-4ba7-be4a-8b39d4f96f1f tempest-CreateVolumesFromSnapshotTest-860857562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-18475d06-503e-471b-a2a1-eeecfb93b990 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:14 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-32f6f181-1327-4f0d-a49d-de7c07422bbb tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Acquiring lock "cinder-05e8d4bf-bdf0-4bc4-aee0-0d95d9b37b6f-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:41:14 devstack sudo[104718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-18475d06-503e-471b-a2a1-eeecfb93b990 1073741824
Jul 14 16:41:14 devstack sudo[104718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-121485d4-0616-4cfb-9f3c-c9507d7f2499 tempest-CreateVolumesFromSnapshotTest-860857562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (364c1cc0-f3c5-4daa-84f9-3447662ed92c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22f06f16-f4a0-4cb6-a1fd-d1751846e892', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-121485d4-0616-4cfb-9f3c-c9507d7f2499 tempest-CreateVolumesFromSnapshotTest-860857562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99c3e34e-1da5-4abd-9bf4-f5066b79e4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:14 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-32f6f181-1327-4f0d-a49d-de7c07422bbb tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Lock "cinder-05e8d4bf-bdf0-4bc4-aee0-0d95d9b37b6f-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:41:14 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-121485d4-0616-4cfb-9f3c-c9507d7f2499 tempest-CreateVolumesFromSnapshotTest-860857562 None] Volume volume-22f06f16-f4a0-4cb6-a1fd-d1751846e892 (22f06f16-f4a0-4cb6-a1fd-d1751846e892): created successfully
Jul 14 16:41:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-121485d4-0616-4cfb-9f3c-c9507d7f2499 tempest-CreateVolumesFromSnapshotTest-860857562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99c3e34e-1da5-4abd-9bf4-f5066b79e4b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-121485d4-0616-4cfb-9f3c-c9507d7f2499 tempest-CreateVolumesFromSnapshotTest-860857562 None] Flow 'volume_create_manager' (7c970b25-094d-48d8-8b37-da5d81d4eb1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:41:14 devstack sudo[104714]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-accd0ce2-8994-45ca-ad56-c9f7859754f5 tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fb466273-09cb-4d22-9212-41a12aeee8ef" returned: 0 in 0.388s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-accd0ce2-8994-45ca-ad56-c9f7859754f5 tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fb466273-09cb-4d22-9212-41a12aeee8ef {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:14 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-121485d4-0616-4cfb-9f3c-c9507d7f2499 tempest-CreateVolumesFromSnapshotTest-860857562 None] Created volume successfully.
Jul 14 16:41:14 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-32f6f181-1327-4f0d-a49d-de7c07422bbb tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Acquiring lock "cinder-quobyte-05e8d4bf-bdf0-4bc4-aee0-0d95d9b37b6f" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:41:14 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-32f6f181-1327-4f0d-a49d-de7c07422bbb tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Lock "cinder-quobyte-05e8d4bf-bdf0-4bc4-aee0-0d95d9b37b6f" acquired by "delete_volume" :: waited 0.019s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:41:14 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[22037226-0709-4dc9-84ff-5cba767be85d]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:41:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-32f6f181-1327-4f0d-a49d-de7c07422bbb tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-05e8d4bf-bdf0-4bc4-aee0-0d95d9b37b6f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:14 devstack sudo[104722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fb466273-09cb-4d22-9212-41a12aeee8ef
Jul 14 16:41:14 devstack sudo[104722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:14 devstack sudo[104723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-05e8d4bf-bdf0-4bc4-aee0-0d95d9b37b6f
Jul 14 16:41:14 devstack sudo[104723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:15 devstack sudo[104718]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-af937450-3199-4ba7-be4a-8b39d4f96f1f tempest-CreateVolumesFromSnapshotTest-860857562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-18475d06-503e-471b-a2a1-eeecfb93b990 1073741824" returned: 0 in 0.479s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-af937450-3199-4ba7-be4a-8b39d4f96f1f tempest-CreateVolumesFromSnapshotTest-860857562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-18475d06-503e-471b-a2a1-eeecfb93b990 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:15 devstack sudo[104722]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-accd0ce2-8994-45ca-ad56-c9f7859754f5 tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fb466273-09cb-4d22-9212-41a12aeee8ef" returned: 1 in 0.425s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-accd0ce2-8994-45ca-ad56-c9f7859754f5 tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fb466273-09cb-4d22-9212-41a12aeee8ef' failed. Not Retrying. {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 16:41:15 devstack cinder-volume[87166]: DEBUG cinder.volume.volume_utils [None req-accd0ce2-8994-45ca-ad56-c9f7859754f5 tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] Downloaded image 4ceb308d-0303-4f0e-9d05-c124719f1648 ((None, [{'url': 'file:///opt/stack/data/glance/images/4ceb308d-0303-4f0e-9d05-c124719f1648', 'metadata': {}}])) to volume fb466273-09cb-4d22-9212-41a12aeee8ef successfully. {{(pid=87166) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 14 16:41:15 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-accd0ce2-8994-45ca-ad56-c9f7859754f5 tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] Temporary image 4ceb308d-0303-4f0e-9d05-c124719f1648 for user ec853d25fe774258a3d056c74a7aa5af is deleted. {{(pid=87166) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 14 16:41:15 devstack cinder-volume[87166]: DEBUG cinder.volume.volume_utils [None req-accd0ce2-8994-45ca-ad56-c9f7859754f5 tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] Marking volume fb466273-09cb-4d22-9212-41a12aeee8ef as bootable. {{(pid=87166) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 14 16:41:15 devstack sudo[104733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-18475d06-503e-471b-a2a1-eeecfb93b990
Jul 14 16:41:15 devstack sudo[104733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:15 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-accd0ce2-8994-45ca-ad56-c9f7859754f5 tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] Copying metadata from image 4ceb308d-0303-4f0e-9d05-c124719f1648 to fb466273-09cb-4d22-9212-41a12aeee8ef. {{(pid=87166) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 14 16:41:15 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-accd0ce2-8994-45ca-ad56-c9f7859754f5 tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] Creating volume glance metadata for volume fb466273-09cb-4d22-9212-41a12aeee8ef backed by image 4ceb308d-0303-4f0e-9d05-c124719f1648 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '4ceb308d-0303-4f0e-9d05-c124719f1648', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'dab4a1a49ce90d2eff5eadc9cf499d3f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87166) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 14 16:41:15 devstack sudo[104723]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-32f6f181-1327-4f0d-a49d-de7c07422bbb tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-05e8d4bf-bdf0-4bc4-aee0-0d95d9b37b6f" returned: 0 in 0.443s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-32f6f181-1327-4f0d-a49d-de7c07422bbb tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-05e8d4bf-bdf0-4bc4-aee0-0d95d9b37b6f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-accd0ce2-8994-45ca-ad56-c9f7859754f5 tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3370778a-99d5-4042-9aa6-95763c4203a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb466273-09cb-4d22-9212-41a12aeee8ef', 'volume_size': 1, 'image_id': '4ceb308d-0303-4f0e-9d05-c124719f1648', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4ceb308d-0303-4f0e-9d05-c124719f1648', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'dab4a1a49ce90d2eff5eadc9cf499d3f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cff9f674ec1740b49e3dad4660349444', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2645874b616e879618a05487c90c03beafed015132d18319de4d1eeeb0a300353dfdaee327aefc4bbf6e5f928c5d532e11e9ee025bf4ac126232d6d55bc7f128', 'id': '4ceb308d-0303-4f0e-9d05-c124719f1648', 'created_at': datetime.datetime(2026, 7, 14, 14, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 14, 41, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4ceb308d-0303-4f0e-9d05-c124719f1648/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74f78100e390>}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-accd0ce2-8994-45ca-ad56-c9f7859754f5 tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cc7fbe9-4e15-4211-aaf7-dbf0a87b5267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:15 devstack sudo[104738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-05e8d4bf-bdf0-4bc4-aee0-0d95d9b37b6f
Jul 14 16:41:15 devstack sudo[104738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:15 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-accd0ce2-8994-45ca-ad56-c9f7859754f5 tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] Volume volume-fb466273-09cb-4d22-9212-41a12aeee8ef (fb466273-09cb-4d22-9212-41a12aeee8ef): created successfully
Jul 14 16:41:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-accd0ce2-8994-45ca-ad56-c9f7859754f5 tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cc7fbe9-4e15-4211-aaf7-dbf0a87b5267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-accd0ce2-8994-45ca-ad56-c9f7859754f5 tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] Flow 'volume_create_manager' (39595c28-50ef-402e-820c-a50cabb7ebfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:41:15 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-accd0ce2-8994-45ca-ad56-c9f7859754f5 tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] Created volume successfully.
Jul 14 16:41:15 devstack sudo[104733]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-af937450-3199-4ba7-be4a-8b39d4f96f1f tempest-CreateVolumesFromSnapshotTest-860857562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-18475d06-503e-471b-a2a1-eeecfb93b990" returned: 0 in 0.290s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:15 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-af937450-3199-4ba7-be4a-8b39d4f96f1f tempest-CreateVolumesFromSnapshotTest-860857562 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:41:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-af937450-3199-4ba7-be4a-8b39d4f96f1f tempest-CreateVolumesFromSnapshotTest-860857562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d9ade89b-89a5-49be-8522-989f3d9ff5cc tempest-ProjectReaderTests-1127203843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.148s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:15 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d9ade89b-89a5-49be-8522-989f3d9ff5cc tempest-ProjectReaderTests-1127203843 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:41:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1216320301',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=208de139-203a-4d05-af90-540ed141b5f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='883944e7bf4f4b4dbc774e64e3e27858',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:41:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:41:14Z,use_quota=True,user_id='edcf2b7f48504051a3973d82e7b0fa86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:41:15 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-d9ade89b-89a5-49be-8522-989f3d9ff5cc tempest-ProjectReaderTests-1127203843 None] Creating volume 208de139-203a-4d05-af90-540ed141b5f6 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:41:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d9ade89b-89a5-49be-8522-989f3d9ff5cc tempest-ProjectReaderTests-1127203843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d9ade89b-89a5-49be-8522-989f3d9ff5cc tempest-ProjectReaderTests-1127203843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:15 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d9ade89b-89a5-49be-8522-989f3d9ff5cc tempest-ProjectReaderTests-1127203843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:41:15 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d9ade89b-89a5-49be-8522-989f3d9ff5cc tempest-ProjectReaderTests-1127203843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:41:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d9ade89b-89a5-49be-8522-989f3d9ff5cc tempest-ProjectReaderTests-1127203843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:15 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d9ade89b-89a5-49be-8522-989f3d9ff5cc tempest-ProjectReaderTests-1127203843 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:41:15 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-d9ade89b-89a5-49be-8522-989f3d9ff5cc tempest-ProjectReaderTests-1127203843 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:41:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d9ade89b-89a5-49be-8522-989f3d9ff5cc tempest-ProjectReaderTests-1127203843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-208de139-203a-4d05-af90-540ed141b5f6 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-af937450-3199-4ba7-be4a-8b39d4f96f1f tempest-CreateVolumesFromSnapshotTest-860857562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad08c561-5f87-4a8d-891d-2941597cc6a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18475d06-503e-471b-a2a1-eeecfb93b990', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-af937450-3199-4ba7-be4a-8b39d4f96f1f tempest-CreateVolumesFromSnapshotTest-860857562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a16f6a48-22fe-46c6-a331-e871ee3c4adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:15 devstack sudo[104741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-208de139-203a-4d05-af90-540ed141b5f6 1073741824
Jul 14 16:41:15 devstack sudo[104741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:15 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b365d7ed-2b38-4603-84f8-b7c624e00bdc tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] Acquiring lock "cinder-fb466273-09cb-4d22-9212-41a12aeee8ef-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:41:15 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-af937450-3199-4ba7-be4a-8b39d4f96f1f tempest-CreateVolumesFromSnapshotTest-860857562 None] Volume volume-18475d06-503e-471b-a2a1-eeecfb93b990 (18475d06-503e-471b-a2a1-eeecfb93b990): created successfully
Jul 14 16:41:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-af937450-3199-4ba7-be4a-8b39d4f96f1f tempest-CreateVolumesFromSnapshotTest-860857562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a16f6a48-22fe-46c6-a331-e871ee3c4adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-af937450-3199-4ba7-be4a-8b39d4f96f1f tempest-CreateVolumesFromSnapshotTest-860857562 None] Flow 'volume_create_manager' (193c706d-ee1d-4326-8c1d-02f864765762) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:41:15 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b365d7ed-2b38-4603-84f8-b7c624e00bdc tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] Lock "cinder-fb466273-09cb-4d22-9212-41a12aeee8ef-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:41:15 devstack sudo[104738]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:15 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-af937450-3199-4ba7-be4a-8b39d4f96f1f tempest-CreateVolumesFromSnapshotTest-860857562 None] Created volume successfully.
Jul 14 16:41:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-32f6f181-1327-4f0d-a49d-de7c07422bbb tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-05e8d4bf-bdf0-4bc4-aee0-0d95d9b37b6f" returned: 0 in 0.290s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:15 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-32f6f181-1327-4f0d-a49d-de7c07422bbb tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Lock "cinder-quobyte-05e8d4bf-bdf0-4bc4-aee0-0d95d9b37b6f" released by "delete_volume" :: held 0.787s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:41:15 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b365d7ed-2b38-4603-84f8-b7c624e00bdc tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] Acquiring lock "cinder-quobyte-fb466273-09cb-4d22-9212-41a12aeee8ef" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:41:15 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b365d7ed-2b38-4603-84f8-b7c624e00bdc tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] Lock "cinder-quobyte-fb466273-09cb-4d22-9212-41a12aeee8ef" acquired by "delete_volume" :: waited 0.018s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:41:15 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-32f6f181-1327-4f0d-a49d-de7c07422bbb tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Created reservations ['f3416b3b-ac33-4717-aaad-0c674e0cdae4', '4973dc26-9ba5-473a-a517-2f178130cb12', '4ffda64a-bf47-45c9-9686-91c0c4de8595', 'd856e8d8-6bb3-40e1-8ae4-0d56db5c94d6'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:41:15 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00c9adb-9b0e-4f4e-8d09-e8e037d300fd]: (4, 'raw') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:41:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b365d7ed-2b38-4603-84f8-b7c624e00bdc tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fb466273-09cb-4d22-9212-41a12aeee8ef {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-32f6f181-1327-4f0d-a49d-de7c07422bbb tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-32f6f181-1327-4f0d-a49d-de7c07422bbb tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:15 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-32f6f181-1327-4f0d-a49d-de7c07422bbb tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:41:15 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-32f6f181-1327-4f0d-a49d-de7c07422bbb tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:41:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-32f6f181-1327-4f0d-a49d-de7c07422bbb tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-32f6f181-1327-4f0d-a49d-de7c07422bbb tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:15 devstack sudo[104748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:41:15 devstack sudo[104748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:15 devstack sudo[104744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fb466273-09cb-4d22-9212-41a12aeee8ef
Jul 14 16:41:15 devstack sudo[104744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:15 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7eeff285-84fd-434c-9e29-bc739a63a965 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Acquiring lock "cinder-244d8be4-3958-4799-9edd-552e124eef76-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:41:15 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7eeff285-84fd-434c-9e29-bc739a63a965 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Lock "cinder-244d8be4-3958-4799-9edd-552e124eef76-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:41:15 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7eeff285-84fd-434c-9e29-bc739a63a965 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Acquiring lock "cinder-quobyte-244d8be4-3958-4799-9edd-552e124eef76" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:41:15 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7eeff285-84fd-434c-9e29-bc739a63a965 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Lock "cinder-quobyte-244d8be4-3958-4799-9edd-552e124eef76" acquired by "delete_volume" :: waited 0.021s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:41:15 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[823da0ae-2536-412e-8bec-3a6656e1b46d]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:41:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7eeff285-84fd-434c-9e29-bc739a63a965 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-244d8be4-3958-4799-9edd-552e124eef76 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:15 devstack sudo[104741]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d9ade89b-89a5-49be-8522-989f3d9ff5cc tempest-ProjectReaderTests-1127203843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-208de139-203a-4d05-af90-540ed141b5f6 1073741824" returned: 0 in 0.555s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d9ade89b-89a5-49be-8522-989f3d9ff5cc tempest-ProjectReaderTests-1127203843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-208de139-203a-4d05-af90-540ed141b5f6 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:16 devstack sudo[104756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-208de139-203a-4d05-af90-540ed141b5f6
Jul 14 16:41:16 devstack sudo[104756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:16 devstack sudo[104748]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-32f6f181-1327-4f0d-a49d-de7c07422bbb tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.355s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:16 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-32f6f181-1327-4f0d-a49d-de7c07422bbb tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:41:16 devstack sudo[104744]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:16 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-32f6f181-1327-4f0d-a49d-de7c07422bbb tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Deleted volume successfully.
Jul 14 16:41:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b365d7ed-2b38-4603-84f8-b7c624e00bdc tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fb466273-09cb-4d22-9212-41a12aeee8ef" returned: 0 in 0.461s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b365d7ed-2b38-4603-84f8-b7c624e00bdc tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fb466273-09cb-4d22-9212-41a12aeee8ef {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:16 devstack sudo[104752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-244d8be4-3958-4799-9edd-552e124eef76
Jul 14 16:41:16 devstack sudo[104752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:16 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-32f6f181-1327-4f0d-a49d-de7c07422bbb tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Lock "cinder-05e8d4bf-bdf0-4bc4-aee0-0d95d9b37b6f-delete_volume" released by "delete_volume" :: held 1.452s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:41:16 devstack sudo[104758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fb466273-09cb-4d22-9212-41a12aeee8ef
Jul 14 16:41:16 devstack sudo[104758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:16 devstack sudo[104756]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d9ade89b-89a5-49be-8522-989f3d9ff5cc tempest-ProjectReaderTests-1127203843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-208de139-203a-4d05-af90-540ed141b5f6" returned: 0 in 0.303s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:16 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d9ade89b-89a5-49be-8522-989f3d9ff5cc tempest-ProjectReaderTests-1127203843 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:41:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d9ade89b-89a5-49be-8522-989f3d9ff5cc tempest-ProjectReaderTests-1127203843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d9ade89b-89a5-49be-8522-989f3d9ff5cc tempest-ProjectReaderTests-1127203843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ca6c689-7a25-4376-bc9f-9b0001fea54d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-208de139-203a-4d05-af90-540ed141b5f6', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d9ade89b-89a5-49be-8522-989f3d9ff5cc tempest-ProjectReaderTests-1127203843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20eab282-48f4-44d7-94bc-dbbd98b3ee11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:16 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-d9ade89b-89a5-49be-8522-989f3d9ff5cc tempest-ProjectReaderTests-1127203843 None] Volume volume-208de139-203a-4d05-af90-540ed141b5f6 (208de139-203a-4d05-af90-540ed141b5f6): created successfully
Jul 14 16:41:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d9ade89b-89a5-49be-8522-989f3d9ff5cc tempest-ProjectReaderTests-1127203843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20eab282-48f4-44d7-94bc-dbbd98b3ee11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d9ade89b-89a5-49be-8522-989f3d9ff5cc tempest-ProjectReaderTests-1127203843 None] Flow 'volume_create_manager' (9589ee03-8ad0-440a-8794-9b81bc00b7ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:41:16 devstack sudo[104752]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7eeff285-84fd-434c-9e29-bc739a63a965 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-244d8be4-3958-4799-9edd-552e124eef76" returned: 0 in 0.433s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7eeff285-84fd-434c-9e29-bc739a63a965 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-244d8be4-3958-4799-9edd-552e124eef76 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:16 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-d9ade89b-89a5-49be-8522-989f3d9ff5cc tempest-ProjectReaderTests-1127203843 None] Created volume successfully.
Jul 14 16:41:16 devstack sudo[104766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-244d8be4-3958-4799-9edd-552e124eef76
Jul 14 16:41:16 devstack sudo[104766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:16 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-cc1bc17c-d823-46f1-aee3-c329bf6628aa tempest-CreateVolumesFromSnapshotTest-860857562 None] Acquiring lock "cinder-18475d06-503e-471b-a2a1-eeecfb93b990-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:41:16 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-cc1bc17c-d823-46f1-aee3-c329bf6628aa tempest-CreateVolumesFromSnapshotTest-860857562 None] Lock "cinder-18475d06-503e-471b-a2a1-eeecfb93b990-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:41:16 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-cc1bc17c-d823-46f1-aee3-c329bf6628aa tempest-CreateVolumesFromSnapshotTest-860857562 None] Acquiring lock "cinder-quobyte-18475d06-503e-471b-a2a1-eeecfb93b990" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:41:16 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-cc1bc17c-d823-46f1-aee3-c329bf6628aa tempest-CreateVolumesFromSnapshotTest-860857562 None] Lock "cinder-quobyte-18475d06-503e-471b-a2a1-eeecfb93b990" acquired by "delete_volume" :: waited 0.027s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:41:16 devstack sudo[104758]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b365d7ed-2b38-4603-84f8-b7c624e00bdc tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fb466273-09cb-4d22-9212-41a12aeee8ef" returned: 1 in 0.443s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b365d7ed-2b38-4603-84f8-b7c624e00bdc tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fb466273-09cb-4d22-9212-41a12aeee8ef' failed. Not Retrying. {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 16:41:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b365d7ed-2b38-4603-84f8-b7c624e00bdc tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fb466273-09cb-4d22-9212-41a12aeee8ef {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:16 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a34dd9-3035-4a79-8205-74ba03254e3a]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:41:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cc1bc17c-d823-46f1-aee3-c329bf6628aa tempest-CreateVolumesFromSnapshotTest-860857562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-18475d06-503e-471b-a2a1-eeecfb93b990 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:16 devstack sudo[104771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fb466273-09cb-4d22-9212-41a12aeee8ef
Jul 14 16:41:16 devstack sudo[104771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:16 devstack sudo[104772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-18475d06-503e-471b-a2a1-eeecfb93b990
Jul 14 16:41:16 devstack sudo[104772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:16 devstack sudo[104766]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7eeff285-84fd-434c-9e29-bc739a63a965 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-244d8be4-3958-4799-9edd-552e124eef76" returned: 0 in 0.317s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:16 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7eeff285-84fd-434c-9e29-bc739a63a965 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Lock "cinder-quobyte-244d8be4-3958-4799-9edd-552e124eef76" released by "delete_volume" :: held 0.795s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:41:16 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-7eeff285-84fd-434c-9e29-bc739a63a965 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Created reservations ['c977103c-a53a-4203-a339-57c8f25362b1', '9863d488-e9f3-412b-8b56-ef98ec44286c', 'f0019c47-d5a0-417c-abb8-8dce2ef1f115', '4a7ff224-8e72-4b4a-a47b-e0425575f54a'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:41:16 devstack sudo[104771]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b365d7ed-2b38-4603-84f8-b7c624e00bdc tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fb466273-09cb-4d22-9212-41a12aeee8ef" returned: 0 in 0.277s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:16 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b365d7ed-2b38-4603-84f8-b7c624e00bdc tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] Lock "cinder-quobyte-fb466273-09cb-4d22-9212-41a12aeee8ef" released by "delete_volume" :: held 1.260s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:41:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-7eeff285-84fd-434c-9e29-bc739a63a965 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-7eeff285-84fd-434c-9e29-bc739a63a965 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:16 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-7eeff285-84fd-434c-9e29-bc739a63a965 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:41:16 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-7eeff285-84fd-434c-9e29-bc739a63a965 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:41:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-7eeff285-84fd-434c-9e29-bc739a63a965 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7eeff285-84fd-434c-9e29-bc739a63a965 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:16 devstack sudo[104779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:41:16 devstack sudo[104779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:16 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-b365d7ed-2b38-4603-84f8-b7c624e00bdc tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] Created reservations ['17942fd3-ca55-4c34-b3a3-d3f717395b63', '00ce283a-b568-42d6-b22e-225c731ed889', '2ac51405-5fcd-4ad8-9047-75b6d7c7cc76', '8f2aa174-2d5a-4b18-8547-5fddb753b9e1'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:41:16 devstack sudo[104772]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cc1bc17c-d823-46f1-aee3-c329bf6628aa tempest-CreateVolumesFromSnapshotTest-860857562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-18475d06-503e-471b-a2a1-eeecfb93b990" returned: 0 in 0.410s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cc1bc17c-d823-46f1-aee3-c329bf6628aa tempest-CreateVolumesFromSnapshotTest-860857562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-18475d06-503e-471b-a2a1-eeecfb93b990 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:16 devstack sudo[104782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-18475d06-503e-471b-a2a1-eeecfb93b990
Jul 14 16:41:16 devstack sudo[104782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:16 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e50c955e-e099-4bd6-bfd6-4e0200589811 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Acquiring lock "cinder-11917a9a-2508-49ad-81b9-5bb8f4038b74-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:41:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b365d7ed-2b38-4603-84f8-b7c624e00bdc tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b365d7ed-2b38-4603-84f8-b7c624e00bdc tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:16 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-b365d7ed-2b38-4603-84f8-b7c624e00bdc tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:41:16 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-b365d7ed-2b38-4603-84f8-b7c624e00bdc tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:41:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b365d7ed-2b38-4603-84f8-b7c624e00bdc tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b365d7ed-2b38-4603-84f8-b7c624e00bdc tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:17 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e50c955e-e099-4bd6-bfd6-4e0200589811 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Lock "cinder-11917a9a-2508-49ad-81b9-5bb8f4038b74-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:41:17 devstack sudo[104784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:41:17 devstack sudo[104784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:17 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e50c955e-e099-4bd6-bfd6-4e0200589811 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Acquiring lock "cinder-quobyte-11917a9a-2508-49ad-81b9-5bb8f4038b74" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:41:17 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e50c955e-e099-4bd6-bfd6-4e0200589811 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Lock "cinder-quobyte-11917a9a-2508-49ad-81b9-5bb8f4038b74" acquired by "delete_volume" :: waited 0.016s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:41:17 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f59198b-166e-41e0-b433-95b7cfb8ff68]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:41:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e50c955e-e099-4bd6-bfd6-4e0200589811 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-11917a9a-2508-49ad-81b9-5bb8f4038b74 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:17 devstack sudo[104779]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7eeff285-84fd-434c-9e29-bc739a63a965 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.382s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:17 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-7eeff285-84fd-434c-9e29-bc739a63a965 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:41:17 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-7eeff285-84fd-434c-9e29-bc739a63a965 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Deleted volume successfully.
Jul 14 16:41:17 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7eeff285-84fd-434c-9e29-bc739a63a965 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Lock "cinder-244d8be4-3958-4799-9edd-552e124eef76-delete_volume" released by "delete_volume" :: held 1.422s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:41:17 devstack sudo[104782]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:17 devstack sudo[104787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-11917a9a-2508-49ad-81b9-5bb8f4038b74
Jul 14 16:41:17 devstack sudo[104787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cc1bc17c-d823-46f1-aee3-c329bf6628aa tempest-CreateVolumesFromSnapshotTest-860857562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-18475d06-503e-471b-a2a1-eeecfb93b990" returned: 0 in 0.364s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:17 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-cc1bc17c-d823-46f1-aee3-c329bf6628aa tempest-CreateVolumesFromSnapshotTest-860857562 None] Lock "cinder-quobyte-18475d06-503e-471b-a2a1-eeecfb93b990" released by "delete_volume" :: held 0.831s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:41:17 devstack sudo[104784]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b365d7ed-2b38-4603-84f8-b7c624e00bdc tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.344s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:17 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-b365d7ed-2b38-4603-84f8-b7c624e00bdc tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:41:17 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-b365d7ed-2b38-4603-84f8-b7c624e00bdc tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] Deleted volume successfully.
Jul 14 16:41:17 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-cc1bc17c-d823-46f1-aee3-c329bf6628aa tempest-CreateVolumesFromSnapshotTest-860857562 None] Created reservations ['a1a192f3-ce84-493e-bfd0-bd9eddf1bc90', '30726982-6b9c-4284-b001-3f0ba8bc0c5b', 'db4e2367-1330-450c-be1f-902132154892', '500fa352-b035-41ad-b938-2f6bd52c0310'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:41:17 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b365d7ed-2b38-4603-84f8-b7c624e00bdc tempest-VolumeAndVolumeTypeFromImageTest-2100977789 None] Lock "cinder-fb466273-09cb-4d22-9212-41a12aeee8ef-delete_volume" released by "delete_volume" :: held 1.937s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:41:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cc1bc17c-d823-46f1-aee3-c329bf6628aa tempest-CreateVolumesFromSnapshotTest-860857562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cc1bc17c-d823-46f1-aee3-c329bf6628aa tempest-CreateVolumesFromSnapshotTest-860857562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:17 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-cc1bc17c-d823-46f1-aee3-c329bf6628aa tempest-CreateVolumesFromSnapshotTest-860857562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:41:17 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-cc1bc17c-d823-46f1-aee3-c329bf6628aa tempest-CreateVolumesFromSnapshotTest-860857562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:41:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cc1bc17c-d823-46f1-aee3-c329bf6628aa tempest-CreateVolumesFromSnapshotTest-860857562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cc1bc17c-d823-46f1-aee3-c329bf6628aa tempest-CreateVolumesFromSnapshotTest-860857562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:17 devstack sudo[104791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:41:17 devstack sudo[104791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-fb9df3f8-ecc9-40e0-a8c3-8766446f9f4a tempest-ProjectReaderTests-1127203843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-fb9df3f8-ecc9-40e0-a8c3-8766446f9f4a tempest-ProjectReaderTests-1127203843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:17 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-fb9df3f8-ecc9-40e0-a8c3-8766446f9f4a tempest-ProjectReaderTests-1127203843 None] Creating offline snapshot a7d58704-a0b4-4c0d-974d-9ab088cfc88d of volume 208de139-203a-4d05-af90-540ed141b5f6 {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 16:41:17 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d661cc-cd2f-4bf2-89fe-7f79320ea833]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:41:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fb9df3f8-ecc9-40e0-a8c3-8766446f9f4a tempest-ProjectReaderTests-1127203843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-208de139-203a-4d05-af90-540ed141b5f6 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:17 devstack sudo[104787]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:17 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-77fb166b-f0f3-446c-a8a2-b85241c16715 tempest-CreateVolumesFromSnapshotTest-860857562 None] Acquiring lock "cinder-22f06f16-f4a0-4cb6-a1fd-d1751846e892-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:41:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e50c955e-e099-4bd6-bfd6-4e0200589811 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-11917a9a-2508-49ad-81b9-5bb8f4038b74" returned: 0 in 0.482s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e50c955e-e099-4bd6-bfd6-4e0200589811 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-11917a9a-2508-49ad-81b9-5bb8f4038b74 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:17 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-77fb166b-f0f3-446c-a8a2-b85241c16715 tempest-CreateVolumesFromSnapshotTest-860857562 None] Lock "cinder-22f06f16-f4a0-4cb6-a1fd-d1751846e892-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:41:17 devstack sudo[104797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-11917a9a-2508-49ad-81b9-5bb8f4038b74
Jul 14 16:41:17 devstack sudo[104797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:17 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-77fb166b-f0f3-446c-a8a2-b85241c16715 tempest-CreateVolumesFromSnapshotTest-860857562 None] Acquiring lock "cinder-quobyte-22f06f16-f4a0-4cb6-a1fd-d1751846e892" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:41:17 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-77fb166b-f0f3-446c-a8a2-b85241c16715 tempest-CreateVolumesFromSnapshotTest-860857562 None] Lock "cinder-quobyte-22f06f16-f4a0-4cb6-a1fd-d1751846e892" acquired by "delete_volume" :: waited 0.031s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:41:17 devstack sudo[104796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-208de139-203a-4d05-af90-540ed141b5f6
Jul 14 16:41:17 devstack sudo[104796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cc1bc17c-d823-46f1-aee3-c329bf6628aa tempest-CreateVolumesFromSnapshotTest-860857562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.307s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:17 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-cc1bc17c-d823-46f1-aee3-c329bf6628aa tempest-CreateVolumesFromSnapshotTest-860857562 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:41:17 devstack sudo[104791]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:17 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[755df2d4-6633-44d8-89bd-f484dcbd0730]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:41:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-77fb166b-f0f3-446c-a8a2-b85241c16715 tempest-CreateVolumesFromSnapshotTest-860857562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-22f06f16-f4a0-4cb6-a1fd-d1751846e892 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:17 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-cc1bc17c-d823-46f1-aee3-c329bf6628aa tempest-CreateVolumesFromSnapshotTest-860857562 None] Deleted volume successfully.
Jul 14 16:41:17 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-cc1bc17c-d823-46f1-aee3-c329bf6628aa tempest-CreateVolumesFromSnapshotTest-860857562 None] Lock "cinder-18475d06-503e-471b-a2a1-eeecfb93b990-delete_volume" released by "delete_volume" :: held 1.446s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:41:17 devstack sudo[104801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-22f06f16-f4a0-4cb6-a1fd-d1751846e892
Jul 14 16:41:17 devstack sudo[104801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:17 devstack sudo[104797]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e50c955e-e099-4bd6-bfd6-4e0200589811 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-11917a9a-2508-49ad-81b9-5bb8f4038b74" returned: 0 in 0.376s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:17 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e50c955e-e099-4bd6-bfd6-4e0200589811 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Lock "cinder-quobyte-11917a9a-2508-49ad-81b9-5bb8f4038b74" released by "delete_volume" :: held 0.920s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:41:18 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-e50c955e-e099-4bd6-bfd6-4e0200589811 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Created reservations ['68152fc4-10eb-4cbf-bcf8-a03a6123af22', '62a92f35-58ae-4658-9237-0bdf3a4240a1', '53b0198c-27f8-404e-923e-80f84fa8f105', '511f12d6-f790-4ebe-9d2e-623474e19bca'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:41:18 devstack sudo[104796]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fb9df3f8-ecc9-40e0-a8c3-8766446f9f4a tempest-ProjectReaderTests-1127203843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-208de139-203a-4d05-af90-540ed141b5f6" returned: 0 in 0.616s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fb9df3f8-ecc9-40e0-a8c3-8766446f9f4a tempest-ProjectReaderTests-1127203843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-208de139-203a-4d05-af90-540ed141b5f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-208de139-203a-4d05-af90-540ed141b5f6.a7d58704-a0b4-4c0d-974d-9ab088cfc88d 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:18 devstack sudo[104810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-208de139-203a-4d05-af90-540ed141b5f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-208de139-203a-4d05-af90-540ed141b5f6.a7d58704-a0b4-4c0d-974d-9ab088cfc88d 1G
Jul 14 16:41:18 devstack sudo[104810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:18 devstack sudo[104801]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-77fb166b-f0f3-446c-a8a2-b85241c16715 tempest-CreateVolumesFromSnapshotTest-860857562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-22f06f16-f4a0-4cb6-a1fd-d1751846e892" returned: 0 in 0.465s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-77fb166b-f0f3-446c-a8a2-b85241c16715 tempest-CreateVolumesFromSnapshotTest-860857562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-22f06f16-f4a0-4cb6-a1fd-d1751846e892 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e50c955e-e099-4bd6-bfd6-4e0200589811 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e50c955e-e099-4bd6-bfd6-4e0200589811 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:18 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-e50c955e-e099-4bd6-bfd6-4e0200589811 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:41:18 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-e50c955e-e099-4bd6-bfd6-4e0200589811 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:41:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e50c955e-e099-4bd6-bfd6-4e0200589811 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e50c955e-e099-4bd6-bfd6-4e0200589811 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:18 devstack sudo[104812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-22f06f16-f4a0-4cb6-a1fd-d1751846e892
Jul 14 16:41:18 devstack sudo[104812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:18 devstack sudo[104813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:41:18 devstack sudo[104813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:18 devstack sudo[104812]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-77fb166b-f0f3-446c-a8a2-b85241c16715 tempest-CreateVolumesFromSnapshotTest-860857562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-22f06f16-f4a0-4cb6-a1fd-d1751846e892" returned: 0 in 0.326s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:18 devstack sudo[104813]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e50c955e-e099-4bd6-bfd6-4e0200589811 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.315s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:18 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-e50c955e-e099-4bd6-bfd6-4e0200589811 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:41:18 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-77fb166b-f0f3-446c-a8a2-b85241c16715 tempest-CreateVolumesFromSnapshotTest-860857562 None] Lock "cinder-quobyte-22f06f16-f4a0-4cb6-a1fd-d1751846e892" released by "delete_volume" :: held 0.849s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:41:18 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-e50c955e-e099-4bd6-bfd6-4e0200589811 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Deleted volume successfully.
Jul 14 16:41:18 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e50c955e-e099-4bd6-bfd6-4e0200589811 tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Lock "cinder-11917a9a-2508-49ad-81b9-5bb8f4038b74-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:41:18 devstack sudo[104810]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fb9df3f8-ecc9-40e0-a8c3-8766446f9f4a tempest-ProjectReaderTests-1127203843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-208de139-203a-4d05-af90-540ed141b5f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-208de139-203a-4d05-af90-540ed141b5f6.a7d58704-a0b4-4c0d-974d-9ab088cfc88d 1G" returned: 0 in 0.479s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fb9df3f8-ecc9-40e0-a8c3-8766446f9f4a tempest-ProjectReaderTests-1127203843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-208de139-203a-4d05-af90-540ed141b5f6 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-208de139-203a-4d05-af90-540ed141b5f6.a7d58704-a0b4-4c0d-974d-9ab088cfc88d {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:18 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-77fb166b-f0f3-446c-a8a2-b85241c16715 tempest-CreateVolumesFromSnapshotTest-860857562 None] Created reservations ['f758e990-2726-4c76-86f1-8648b402b14c', '307ce7ad-d126-4c3e-a052-0eb0972332d8', '387df906-800a-42c5-bc04-a69afd060ce6', '7d937371-ebe4-479f-94d3-f12f94fc4100'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:41:18 devstack sudo[104822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-208de139-203a-4d05-af90-540ed141b5f6 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-208de139-203a-4d05-af90-540ed141b5f6.a7d58704-a0b4-4c0d-974d-9ab088cfc88d
Jul 14 16:41:18 devstack sudo[104822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-77fb166b-f0f3-446c-a8a2-b85241c16715 tempest-CreateVolumesFromSnapshotTest-860857562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-77fb166b-f0f3-446c-a8a2-b85241c16715 tempest-CreateVolumesFromSnapshotTest-860857562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:18 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-77fb166b-f0f3-446c-a8a2-b85241c16715 tempest-CreateVolumesFromSnapshotTest-860857562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:41:18 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-77fb166b-f0f3-446c-a8a2-b85241c16715 tempest-CreateVolumesFromSnapshotTest-860857562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:41:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-77fb166b-f0f3-446c-a8a2-b85241c16715 tempest-CreateVolumesFromSnapshotTest-860857562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-77fb166b-f0f3-446c-a8a2-b85241c16715 tempest-CreateVolumesFromSnapshotTest-860857562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:18 devstack sudo[104824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:41:18 devstack sudo[104824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:18 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-168cec73-c290-4a71-9c0a-eb4f9dcf026a tempest-CreateVolumesFromSnapshotTest-860857562 None] Acquiring lock "cinder-04d45231-9072-49b3-b2ce-ef3920fd8177-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:41:18 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-168cec73-c290-4a71-9c0a-eb4f9dcf026a tempest-CreateVolumesFromSnapshotTest-860857562 None] Lock "cinder-04d45231-9072-49b3-b2ce-ef3920fd8177-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:41:18 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-168cec73-c290-4a71-9c0a-eb4f9dcf026a tempest-CreateVolumesFromSnapshotTest-860857562 None] Acquiring lock "cinder-quobyte-04d45231-9072-49b3-b2ce-ef3920fd8177" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:41:18 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-168cec73-c290-4a71-9c0a-eb4f9dcf026a tempest-CreateVolumesFromSnapshotTest-860857562 None] Lock "cinder-quobyte-04d45231-9072-49b3-b2ce-ef3920fd8177" acquired by "delete_volume" :: waited 0.024s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:41:18 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[120f0810-722c-489e-b986-f667df30e5d7]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:41:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-168cec73-c290-4a71-9c0a-eb4f9dcf026a tempest-CreateVolumesFromSnapshotTest-860857562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-04d45231-9072-49b3-b2ce-ef3920fd8177 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:19 devstack sudo[104822]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fb9df3f8-ecc9-40e0-a8c3-8766446f9f4a tempest-ProjectReaderTests-1127203843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-208de139-203a-4d05-af90-540ed141b5f6 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-208de139-203a-4d05-af90-540ed141b5f6.a7d58704-a0b4-4c0d-974d-9ab088cfc88d" returned: 0 in 0.379s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:19 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-fb9df3f8-ecc9-40e0-a8c3-8766446f9f4a tempest-ProjectReaderTests-1127203843 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-208de139-203a-4d05-af90-540ed141b5f6.a7d58704-a0b4-4c0d-974d-9ab088cfc88d is being set with open permissions: ugo+rw
Jul 14 16:41:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fb9df3f8-ecc9-40e0-a8c3-8766446f9f4a tempest-ProjectReaderTests-1127203843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-208de139-203a-4d05-af90-540ed141b5f6.a7d58704-a0b4-4c0d-974d-9ab088cfc88d {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:19 devstack sudo[104831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-208de139-203a-4d05-af90-540ed141b5f6.a7d58704-a0b4-4c0d-974d-9ab088cfc88d
Jul 14 16:41:19 devstack sudo[104831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:19 devstack sudo[104824]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-77fb166b-f0f3-446c-a8a2-b85241c16715 tempest-CreateVolumesFromSnapshotTest-860857562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.308s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:19 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-77fb166b-f0f3-446c-a8a2-b85241c16715 tempest-CreateVolumesFromSnapshotTest-860857562 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:41:19 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-77fb166b-f0f3-446c-a8a2-b85241c16715 tempest-CreateVolumesFromSnapshotTest-860857562 None] Deleted volume successfully.
Jul 14 16:41:19 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-77fb166b-f0f3-446c-a8a2-b85241c16715 tempest-CreateVolumesFromSnapshotTest-860857562 None] Lock "cinder-22f06f16-f4a0-4cb6-a1fd-d1751846e892-delete_volume" released by "delete_volume" :: held 1.471s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:41:19 devstack sudo[104829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-04d45231-9072-49b3-b2ce-ef3920fd8177
Jul 14 16:41:19 devstack sudo[104829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:19 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-9f13d6f9-8273-4a63-a00b-523acac3332c tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Acquiring lock "cinder-164dd959-4416-4a66-84da-9aa1af14623c-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:41:19 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-9f13d6f9-8273-4a63-a00b-523acac3332c tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Lock "cinder-164dd959-4416-4a66-84da-9aa1af14623c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:41:19 devstack sudo[104831]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fb9df3f8-ecc9-40e0-a8c3-8766446f9f4a tempest-ProjectReaderTests-1127203843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-208de139-203a-4d05-af90-540ed141b5f6.a7d58704-a0b4-4c0d-974d-9ab088cfc88d" returned: 0 in 0.344s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fb9df3f8-ecc9-40e0-a8c3-8766446f9f4a tempest-ProjectReaderTests-1127203843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-208de139-203a-4d05-af90-540ed141b5f6.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:19 devstack sudo[104838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-208de139-203a-4d05-af90-540ed141b5f6.info
Jul 14 16:41:19 devstack sudo[104838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:19 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-9f13d6f9-8273-4a63-a00b-523acac3332c tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Acquiring lock "cinder-quobyte-164dd959-4416-4a66-84da-9aa1af14623c" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:41:19 devstack sudo[104829]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:19 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-9f13d6f9-8273-4a63-a00b-523acac3332c tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Lock "cinder-quobyte-164dd959-4416-4a66-84da-9aa1af14623c" acquired by "delete_volume" :: waited 0.023s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:41:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-168cec73-c290-4a71-9c0a-eb4f9dcf026a tempest-CreateVolumesFromSnapshotTest-860857562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-04d45231-9072-49b3-b2ce-ef3920fd8177" returned: 0 in 0.522s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-168cec73-c290-4a71-9c0a-eb4f9dcf026a tempest-CreateVolumesFromSnapshotTest-860857562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-04d45231-9072-49b3-b2ce-ef3920fd8177 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:19 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96b2cad-810f-42eb-affa-89544a516433]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:41:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9f13d6f9-8273-4a63-a00b-523acac3332c tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-164dd959-4416-4a66-84da-9aa1af14623c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:19 devstack sudo[104840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-04d45231-9072-49b3-b2ce-ef3920fd8177
Jul 14 16:41:19 devstack sudo[104840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:19 devstack sudo[104842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-164dd959-4416-4a66-84da-9aa1af14623c
Jul 14 16:41:19 devstack sudo[104842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:19 devstack sudo[104838]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fb9df3f8-ecc9-40e0-a8c3-8766446f9f4a tempest-ProjectReaderTests-1127203843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-208de139-203a-4d05-af90-540ed141b5f6.info" returned: 0 in 0.317s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:19 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-fb9df3f8-ecc9-40e0-a8c3-8766446f9f4a tempest-ProjectReaderTests-1127203843 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-208de139-203a-4d05-af90-540ed141b5f6.info is being set with open permissions: ugo+rw
Jul 14 16:41:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fb9df3f8-ecc9-40e0-a8c3-8766446f9f4a tempest-ProjectReaderTests-1127203843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-208de139-203a-4d05-af90-540ed141b5f6.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:19 devstack sudo[104846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-208de139-203a-4d05-af90-540ed141b5f6.info
Jul 14 16:41:19 devstack sudo[104846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:19 devstack sudo[104840]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-168cec73-c290-4a71-9c0a-eb4f9dcf026a tempest-CreateVolumesFromSnapshotTest-860857562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-04d45231-9072-49b3-b2ce-ef3920fd8177" returned: 0 in 0.308s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:19 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-168cec73-c290-4a71-9c0a-eb4f9dcf026a tempest-CreateVolumesFromSnapshotTest-860857562 None] Lock "cinder-quobyte-04d45231-9072-49b3-b2ce-ef3920fd8177" released by "delete_volume" :: held 0.885s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:41:19 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-168cec73-c290-4a71-9c0a-eb4f9dcf026a tempest-CreateVolumesFromSnapshotTest-860857562 None] Created reservations ['34074162-73ce-4acf-a216-7ab68334e9ec', '207b0e29-1993-47cc-bd11-e697bfa3103d', '0fcb6458-a846-4626-b38c-91647981e46c', 'a0bddf69-04c4-412f-89b2-96f85c23b9b7'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:41:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-168cec73-c290-4a71-9c0a-eb4f9dcf026a tempest-CreateVolumesFromSnapshotTest-860857562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-168cec73-c290-4a71-9c0a-eb4f9dcf026a tempest-CreateVolumesFromSnapshotTest-860857562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:19 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-168cec73-c290-4a71-9c0a-eb4f9dcf026a tempest-CreateVolumesFromSnapshotTest-860857562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:41:19 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-168cec73-c290-4a71-9c0a-eb4f9dcf026a tempest-CreateVolumesFromSnapshotTest-860857562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:41:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-168cec73-c290-4a71-9c0a-eb4f9dcf026a tempest-CreateVolumesFromSnapshotTest-860857562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-168cec73-c290-4a71-9c0a-eb4f9dcf026a tempest-CreateVolumesFromSnapshotTest-860857562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:20 devstack sudo[104842]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:20 devstack sudo[104853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:41:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9f13d6f9-8273-4a63-a00b-523acac3332c tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-164dd959-4416-4a66-84da-9aa1af14623c" returned: 0 in 0.505s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:20 devstack sudo[104853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9f13d6f9-8273-4a63-a00b-523acac3332c tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-164dd959-4416-4a66-84da-9aa1af14623c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:20 devstack sudo[104846]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fb9df3f8-ecc9-40e0-a8c3-8766446f9f4a tempest-ProjectReaderTests-1127203843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-208de139-203a-4d05-af90-540ed141b5f6.info" returned: 0 in 0.339s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:20 devstack sudo[104855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-164dd959-4416-4a66-84da-9aa1af14623c
Jul 14 16:41:20 devstack sudo[104855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-fb9df3f8-ecc9-40e0-a8c3-8766446f9f4a tempest-ProjectReaderTests-1127203843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.581s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:20 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3fb2f50c-876c-4a13-978b-6dd6fc5ad90b tempest-CreateVolumesFromSnapshotTest-860857562 None] Acquiring lock "cinder-aae6fc0b-4a87-4c3e-bbe6-828a5344bbbb-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:41:20 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3fb2f50c-876c-4a13-978b-6dd6fc5ad90b tempest-CreateVolumesFromSnapshotTest-860857562 None] Lock "cinder-aae6fc0b-4a87-4c3e-bbe6-828a5344bbbb-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:41:20 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-fb9df3f8-ecc9-40e0-a8c3-8766446f9f4a tempest-ProjectReaderTests-1127203843 None] Create snapshot completed successfully
Jul 14 16:41:20 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3fb2f50c-876c-4a13-978b-6dd6fc5ad90b tempest-CreateVolumesFromSnapshotTest-860857562 None] Acquiring lock "cinder-quobyte-aae6fc0b-4a87-4c3e-bbe6-828a5344bbbb" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:41:20 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3fb2f50c-876c-4a13-978b-6dd6fc5ad90b tempest-CreateVolumesFromSnapshotTest-860857562 None] Lock "cinder-quobyte-aae6fc0b-4a87-4c3e-bbe6-828a5344bbbb" acquired by "delete_volume" :: waited 0.018s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:41:20 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cbdb719-f202-43e8-b150-d725f1a7de6f]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:41:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3fb2f50c-876c-4a13-978b-6dd6fc5ad90b tempest-CreateVolumesFromSnapshotTest-860857562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-aae6fc0b-4a87-4c3e-bbe6-828a5344bbbb {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:20 devstack sudo[104853]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-168cec73-c290-4a71-9c0a-eb4f9dcf026a tempest-CreateVolumesFromSnapshotTest-860857562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.333s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:20 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-168cec73-c290-4a71-9c0a-eb4f9dcf026a tempest-CreateVolumesFromSnapshotTest-860857562 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:41:20 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-168cec73-c290-4a71-9c0a-eb4f9dcf026a tempest-CreateVolumesFromSnapshotTest-860857562 None] Deleted volume successfully.
Jul 14 16:41:20 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-168cec73-c290-4a71-9c0a-eb4f9dcf026a tempest-CreateVolumesFromSnapshotTest-860857562 None] Lock "cinder-04d45231-9072-49b3-b2ce-ef3920fd8177-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:41:20 devstack sudo[104855]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9f13d6f9-8273-4a63-a00b-523acac3332c tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-164dd959-4416-4a66-84da-9aa1af14623c" returned: 0 in 0.352s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:20 devstack sudo[104858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-aae6fc0b-4a87-4c3e-bbe6-828a5344bbbb
Jul 14 16:41:20 devstack sudo[104858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:20 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-9f13d6f9-8273-4a63-a00b-523acac3332c tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Lock "cinder-quobyte-164dd959-4416-4a66-84da-9aa1af14623c" released by "delete_volume" :: held 0.926s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:41:20 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-9f13d6f9-8273-4a63-a00b-523acac3332c tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Created reservations ['64e4f651-8dd3-4596-bf6d-bcb5404c8f9f', 'd57a41a0-362d-4137-a582-d3def56d8468', '189be713-26db-4113-9369-0534a0e903ad', '15258db1-1aab-4a78-9434-459b251d6f5d'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:41:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9f13d6f9-8273-4a63-a00b-523acac3332c tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9f13d6f9-8273-4a63-a00b-523acac3332c tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:20 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-9f13d6f9-8273-4a63-a00b-523acac3332c tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:41:20 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-9f13d6f9-8273-4a63-a00b-523acac3332c tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:41:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9f13d6f9-8273-4a63-a00b-523acac3332c tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9f13d6f9-8273-4a63-a00b-523acac3332c tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:20 devstack sudo[104861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:41:20 devstack sudo[104861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:20 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3a6f460d-d48d-47cf-af73-e4fe36fd45d7 tempest-ProjectReaderTests-1127203843 None] Acquiring lock "cinder-a7d58704-a0b4-4c0d-974d-9ab088cfc88d-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:41:20 devstack sudo[104858]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3fb2f50c-876c-4a13-978b-6dd6fc5ad90b tempest-CreateVolumesFromSnapshotTest-860857562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-aae6fc0b-4a87-4c3e-bbe6-828a5344bbbb" returned: 0 in 0.487s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3fb2f50c-876c-4a13-978b-6dd6fc5ad90b tempest-CreateVolumesFromSnapshotTest-860857562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-aae6fc0b-4a87-4c3e-bbe6-828a5344bbbb {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:20 devstack sudo[104866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-aae6fc0b-4a87-4c3e-bbe6-828a5344bbbb
Jul 14 16:41:20 devstack sudo[104866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:20 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3a6f460d-d48d-47cf-af73-e4fe36fd45d7 tempest-ProjectReaderTests-1127203843 None] Lock "cinder-a7d58704-a0b4-4c0d-974d-9ab088cfc88d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.059s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:41:20 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3a6f460d-d48d-47cf-af73-e4fe36fd45d7 tempest-ProjectReaderTests-1127203843 None] Acquiring lock "cinder-quobyte-208de139-203a-4d05-af90-540ed141b5f6" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:41:20 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3a6f460d-d48d-47cf-af73-e4fe36fd45d7 tempest-ProjectReaderTests-1127203843 None] Lock "cinder-quobyte-208de139-203a-4d05-af90-540ed141b5f6" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:41:20 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3a6f460d-d48d-47cf-af73-e4fe36fd45d7 tempest-ProjectReaderTests-1127203843 None] Acquiring lock "cinder-quobyte-a7d58704-a0b4-4c0d-974d-9ab088cfc88d" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:41:20 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3a6f460d-d48d-47cf-af73-e4fe36fd45d7 tempest-ProjectReaderTests-1127203843 None] Lock "cinder-quobyte-a7d58704-a0b4-4c0d-974d-9ab088cfc88d" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:41:20 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-3a6f460d-d48d-47cf-af73-e4fe36fd45d7 tempest-ProjectReaderTests-1127203843 None] Deleting offline snapshot a7d58704-a0b4-4c0d-974d-9ab088cfc88d of volume 208de139-203a-4d05-af90-540ed141b5f6 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 16:41:20 devstack sudo[104861]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:20 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-3a6f460d-d48d-47cf-af73-e4fe36fd45d7 tempest-ProjectReaderTests-1127203843 None] snapshot_file for this snap is: volume-208de139-203a-4d05-af90-540ed141b5f6.a7d58704-a0b4-4c0d-974d-9ab088cfc88d {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 16:41:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9f13d6f9-8273-4a63-a00b-523acac3332c tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.277s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:20 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-9f13d6f9-8273-4a63-a00b-523acac3332c tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:41:20 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-9f13d6f9-8273-4a63-a00b-523acac3332c tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Deleted volume successfully.
Jul 14 16:41:20 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[951d1db3-0c0d-4f14-bf73-4bdd0bcaba92]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:41:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3a6f460d-d48d-47cf-af73-e4fe36fd45d7 tempest-ProjectReaderTests-1127203843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-208de139-203a-4d05-af90-540ed141b5f6.a7d58704-a0b4-4c0d-974d-9ab088cfc88d {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:20 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-9f13d6f9-8273-4a63-a00b-523acac3332c tempest-CreateVolumesFromSourceVolumeTest-1549361698 None] Lock "cinder-164dd959-4416-4a66-84da-9aa1af14623c-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:41:20 devstack sudo[104869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-208de139-203a-4d05-af90-540ed141b5f6.a7d58704-a0b4-4c0d-974d-9ab088cfc88d
Jul 14 16:41:20 devstack sudo[104869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:21 devstack sudo[104866]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3fb2f50c-876c-4a13-978b-6dd6fc5ad90b tempest-CreateVolumesFromSnapshotTest-860857562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-aae6fc0b-4a87-4c3e-bbe6-828a5344bbbb" returned: 0 in 0.311s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:21 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3fb2f50c-876c-4a13-978b-6dd6fc5ad90b tempest-CreateVolumesFromSnapshotTest-860857562 None] Lock "cinder-quobyte-aae6fc0b-4a87-4c3e-bbe6-828a5344bbbb" released by "delete_volume" :: held 0.859s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:41:21 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-3fb2f50c-876c-4a13-978b-6dd6fc5ad90b tempest-CreateVolumesFromSnapshotTest-860857562 None] Created reservations ['c2c0e070-f511-4c09-ac88-4be9575c0d19', 'aa6c4c04-0f2a-49a1-9667-e0976808faeb', '90e52e9f-02f1-464f-a810-50ca859e30ab', '06b406d0-a54e-40b2-923f-674f594ce59c'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:41:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3fb2f50c-876c-4a13-978b-6dd6fc5ad90b tempest-CreateVolumesFromSnapshotTest-860857562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3fb2f50c-876c-4a13-978b-6dd6fc5ad90b tempest-CreateVolumesFromSnapshotTest-860857562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:21 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-3fb2f50c-876c-4a13-978b-6dd6fc5ad90b tempest-CreateVolumesFromSnapshotTest-860857562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:41:21 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-3fb2f50c-876c-4a13-978b-6dd6fc5ad90b tempest-CreateVolumesFromSnapshotTest-860857562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:41:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3fb2f50c-876c-4a13-978b-6dd6fc5ad90b tempest-CreateVolumesFromSnapshotTest-860857562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3fb2f50c-876c-4a13-978b-6dd6fc5ad90b tempest-CreateVolumesFromSnapshotTest-860857562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:21 devstack sudo[104873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:41:21 devstack sudo[104873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:21 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-fe773762-8708-4a42-8f95-2c4d8dcaac92 tempest-CreateVolumesFromSnapshotTest-860857562 None] Acquiring lock "cinder-cd2a3da3-1370-48f3-beed-8d04840a309f-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:41:21 devstack sudo[104869]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3a6f460d-d48d-47cf-af73-e4fe36fd45d7 tempest-ProjectReaderTests-1127203843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-208de139-203a-4d05-af90-540ed141b5f6.a7d58704-a0b4-4c0d-974d-9ab088cfc88d" returned: 0 in 0.462s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:21 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-3a6f460d-d48d-47cf-af73-e4fe36fd45d7 tempest-ProjectReaderTests-1127203843 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-208de139-203a-4d05-af90-540ed141b5f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 16:41:21 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-fe773762-8708-4a42-8f95-2c4d8dcaac92 tempest-CreateVolumesFromSnapshotTest-860857562 None] Lock "cinder-cd2a3da3-1370-48f3-beed-8d04840a309f-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:41:21 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ad2ecc-10b3-4fe3-a6cd-a8eba4b7c29a]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:41:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3a6f460d-d48d-47cf-af73-e4fe36fd45d7 tempest-ProjectReaderTests-1127203843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-208de139-203a-4d05-af90-540ed141b5f6 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:21 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-fe773762-8708-4a42-8f95-2c4d8dcaac92 tempest-CreateVolumesFromSnapshotTest-860857562 None] Acquiring lock "cinder-quobyte-cd2a3da3-1370-48f3-beed-8d04840a309f" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:41:21 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-fe773762-8708-4a42-8f95-2c4d8dcaac92 tempest-CreateVolumesFromSnapshotTest-860857562 None] Lock "cinder-quobyte-cd2a3da3-1370-48f3-beed-8d04840a309f" acquired by "delete_volume" :: waited 0.019s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:41:21 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c643942-9431-435d-94a6-49645aeb053c]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:41:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fe773762-8708-4a42-8f95-2c4d8dcaac92 tempest-CreateVolumesFromSnapshotTest-860857562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cd2a3da3-1370-48f3-beed-8d04840a309f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:21 devstack sudo[104877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-208de139-203a-4d05-af90-540ed141b5f6
Jul 14 16:41:21 devstack sudo[104877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:21 devstack sudo[104873]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3fb2f50c-876c-4a13-978b-6dd6fc5ad90b tempest-CreateVolumesFromSnapshotTest-860857562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.357s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:21 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-3fb2f50c-876c-4a13-978b-6dd6fc5ad90b tempest-CreateVolumesFromSnapshotTest-860857562 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:41:21 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-3fb2f50c-876c-4a13-978b-6dd6fc5ad90b tempest-CreateVolumesFromSnapshotTest-860857562 None] Deleted volume successfully.
Jul 14 16:41:21 devstack sudo[104878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cd2a3da3-1370-48f3-beed-8d04840a309f
Jul 14 16:41:21 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3fb2f50c-876c-4a13-978b-6dd6fc5ad90b tempest-CreateVolumesFromSnapshotTest-860857562 None] Lock "cinder-aae6fc0b-4a87-4c3e-bbe6-828a5344bbbb-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:41:21 devstack sudo[104878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:21 devstack sudo[104877]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3a6f460d-d48d-47cf-af73-e4fe36fd45d7 tempest-ProjectReaderTests-1127203843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-208de139-203a-4d05-af90-540ed141b5f6" returned: 0 in 0.438s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3a6f460d-d48d-47cf-af73-e4fe36fd45d7 tempest-ProjectReaderTests-1127203843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-208de139-203a-4d05-af90-540ed141b5f6.a7d58704-a0b4-4c0d-974d-9ab088cfc88d {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:21 devstack sudo[104885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-208de139-203a-4d05-af90-540ed141b5f6.a7d58704-a0b4-4c0d-974d-9ab088cfc88d
Jul 14 16:41:21 devstack sudo[104885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:21 devstack sudo[104878]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fe773762-8708-4a42-8f95-2c4d8dcaac92 tempest-CreateVolumesFromSnapshotTest-860857562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cd2a3da3-1370-48f3-beed-8d04840a309f" returned: 0 in 0.484s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fe773762-8708-4a42-8f95-2c4d8dcaac92 tempest-CreateVolumesFromSnapshotTest-860857562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cd2a3da3-1370-48f3-beed-8d04840a309f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:22 devstack sudo[104891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cd2a3da3-1370-48f3-beed-8d04840a309f
Jul 14 16:41:22 devstack sudo[104891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:22 devstack sudo[104885]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3a6f460d-d48d-47cf-af73-e4fe36fd45d7 tempest-ProjectReaderTests-1127203843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-208de139-203a-4d05-af90-540ed141b5f6.a7d58704-a0b4-4c0d-974d-9ab088cfc88d" returned: 0 in 0.435s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3a6f460d-d48d-47cf-af73-e4fe36fd45d7 tempest-ProjectReaderTests-1127203843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-208de139-203a-4d05-af90-540ed141b5f6.a7d58704-a0b4-4c0d-974d-9ab088cfc88d {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:22 devstack sudo[104898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-208de139-203a-4d05-af90-540ed141b5f6.a7d58704-a0b4-4c0d-974d-9ab088cfc88d
Jul 14 16:41:22 devstack sudo[104898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:22 devstack sudo[104891]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fe773762-8708-4a42-8f95-2c4d8dcaac92 tempest-CreateVolumesFromSnapshotTest-860857562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cd2a3da3-1370-48f3-beed-8d04840a309f" returned: 0 in 0.322s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-fe773762-8708-4a42-8f95-2c4d8dcaac92 tempest-CreateVolumesFromSnapshotTest-860857562 None] Lock "cinder-quobyte-cd2a3da3-1370-48f3-beed-8d04840a309f" released by "delete_volume" :: held 0.860s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:41:22 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-fe773762-8708-4a42-8f95-2c4d8dcaac92 tempest-CreateVolumesFromSnapshotTest-860857562 None] Created reservations ['47a571e4-c5d4-466d-b9fb-36ce537407b6', '5d2489b5-fd61-419e-9872-9782c547ab33', '8ca0ebb3-4a4d-47cb-998d-d68e3c6495fb', '27c42cae-6cf6-41b4-9c04-93d6aa399343'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:41:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-fe773762-8708-4a42-8f95-2c4d8dcaac92 tempest-CreateVolumesFromSnapshotTest-860857562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-fe773762-8708-4a42-8f95-2c4d8dcaac92 tempest-CreateVolumesFromSnapshotTest-860857562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:22 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-fe773762-8708-4a42-8f95-2c4d8dcaac92 tempest-CreateVolumesFromSnapshotTest-860857562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:41:22 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-fe773762-8708-4a42-8f95-2c4d8dcaac92 tempest-CreateVolumesFromSnapshotTest-860857562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:41:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-fe773762-8708-4a42-8f95-2c4d8dcaac92 tempest-CreateVolumesFromSnapshotTest-860857562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fe773762-8708-4a42-8f95-2c4d8dcaac92 tempest-CreateVolumesFromSnapshotTest-860857562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:22 devstack sudo[104900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:41:22 devstack sudo[104900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-305f02ee-a4a5-404d-ae12-47cf5a9b79e2 tempest-CreateVolumesFromSnapshotTest-860857562 None] Acquiring lock "cinder-16cbd470-bbab-499c-9ebe-fb383bb3f133-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:41:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-305f02ee-a4a5-404d-ae12-47cf5a9b79e2 tempest-CreateVolumesFromSnapshotTest-860857562 None] Lock "cinder-16cbd470-bbab-499c-9ebe-fb383bb3f133-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:41:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-305f02ee-a4a5-404d-ae12-47cf5a9b79e2 tempest-CreateVolumesFromSnapshotTest-860857562 None] Acquiring lock "cinder-quobyte-cb2d2eb6-1175-495b-80e4-a0057f4d0dbe" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:41:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-305f02ee-a4a5-404d-ae12-47cf5a9b79e2 tempest-CreateVolumesFromSnapshotTest-860857562 None] Lock "cinder-quobyte-cb2d2eb6-1175-495b-80e4-a0057f4d0dbe" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:41:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-305f02ee-a4a5-404d-ae12-47cf5a9b79e2 tempest-CreateVolumesFromSnapshotTest-860857562 None] Acquiring lock "cinder-quobyte-16cbd470-bbab-499c-9ebe-fb383bb3f133" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:41:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-305f02ee-a4a5-404d-ae12-47cf5a9b79e2 tempest-CreateVolumesFromSnapshotTest-860857562 None] Lock "cinder-quobyte-16cbd470-bbab-499c-9ebe-fb383bb3f133" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:41:22 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-305f02ee-a4a5-404d-ae12-47cf5a9b79e2 tempest-CreateVolumesFromSnapshotTest-860857562 None] Deleting offline snapshot 16cbd470-bbab-499c-9ebe-fb383bb3f133 of volume cb2d2eb6-1175-495b-80e4-a0057f4d0dbe {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 16:41:22 devstack sudo[104898]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:22 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-305f02ee-a4a5-404d-ae12-47cf5a9b79e2 tempest-CreateVolumesFromSnapshotTest-860857562 None] snapshot_file for this snap is: volume-cb2d2eb6-1175-495b-80e4-a0057f4d0dbe.16cbd470-bbab-499c-9ebe-fb383bb3f133 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 16:41:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3a6f460d-d48d-47cf-af73-e4fe36fd45d7 tempest-ProjectReaderTests-1127203843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-208de139-203a-4d05-af90-540ed141b5f6.a7d58704-a0b4-4c0d-974d-9ab088cfc88d" returned: 0 in 0.470s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:22 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca1f194-b15e-4ff1-89df-1493acf2c372]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:41:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-305f02ee-a4a5-404d-ae12-47cf5a9b79e2 tempest-CreateVolumesFromSnapshotTest-860857562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cb2d2eb6-1175-495b-80e4-a0057f4d0dbe.16cbd470-bbab-499c-9ebe-fb383bb3f133 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3a6f460d-d48d-47cf-af73-e4fe36fd45d7 tempest-ProjectReaderTests-1127203843 None] Lock "cinder-quobyte-a7d58704-a0b4-4c0d-974d-9ab088cfc88d" released by "_delete_snapshot" :: held 1.957s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:41:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3a6f460d-d48d-47cf-af73-e4fe36fd45d7 tempest-ProjectReaderTests-1127203843 None] Lock "cinder-quobyte-208de139-203a-4d05-af90-540ed141b5f6" released by "delete_snapshot" :: held 1.997s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:41:22 devstack sudo[104900]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fe773762-8708-4a42-8f95-2c4d8dcaac92 tempest-CreateVolumesFromSnapshotTest-860857562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.355s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:22 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-fe773762-8708-4a42-8f95-2c4d8dcaac92 tempest-CreateVolumesFromSnapshotTest-860857562 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:41:22 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-fe773762-8708-4a42-8f95-2c4d8dcaac92 tempest-CreateVolumesFromSnapshotTest-860857562 None] Deleted volume successfully.
Jul 14 16:41:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-fe773762-8708-4a42-8f95-2c4d8dcaac92 tempest-CreateVolumesFromSnapshotTest-860857562 None] Lock "cinder-cd2a3da3-1370-48f3-beed-8d04840a309f-delete_volume" released by "delete_volume" :: held 1.544s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:41:22 devstack sudo[104903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cb2d2eb6-1175-495b-80e4-a0057f4d0dbe.16cbd470-bbab-499c-9ebe-fb383bb3f133
Jul 14 16:41:22 devstack sudo[104903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:22 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-3a6f460d-d48d-47cf-af73-e4fe36fd45d7 tempest-ProjectReaderTests-1127203843 None] Created reservations ['f64d8903-bbde-4399-bf0f-df8be2687f5f', '6ce0f0fd-4f88-4cdd-ac85-eefc0c0f2528', 'f6a243d9-2f87-47c7-965d-60a0fd3649e8', '091cb125-9bf0-4f5a-9952-35bd73944744'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:41:22 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-3a6f460d-d48d-47cf-af73-e4fe36fd45d7 tempest-ProjectReaderTests-1127203843 None] Delete snapshot completed successfully.
Jul 14 16:41:23 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3a6f460d-d48d-47cf-af73-e4fe36fd45d7 tempest-ProjectReaderTests-1127203843 None] Lock "cinder-a7d58704-a0b4-4c0d-974d-9ab088cfc88d-delete_snapshot" released by "delete_snapshot" :: held 2.236s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:41:23 devstack sudo[104903]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-305f02ee-a4a5-404d-ae12-47cf5a9b79e2 tempest-CreateVolumesFromSnapshotTest-860857562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cb2d2eb6-1175-495b-80e4-a0057f4d0dbe.16cbd470-bbab-499c-9ebe-fb383bb3f133" returned: 0 in 0.448s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:23 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-305f02ee-a4a5-404d-ae12-47cf5a9b79e2 tempest-CreateVolumesFromSnapshotTest-860857562 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb2d2eb6-1175-495b-80e4-a0057f4d0dbe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 16:41:23 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[87376b4a-f441-44a9-adab-3514f7383432]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:41:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-305f02ee-a4a5-404d-ae12-47cf5a9b79e2 tempest-CreateVolumesFromSnapshotTest-860857562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cb2d2eb6-1175-495b-80e4-a0057f4d0dbe {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:23 devstack sudo[104910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cb2d2eb6-1175-495b-80e4-a0057f4d0dbe
Jul 14 16:41:23 devstack sudo[104910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:23 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-30c2f9a4-f603-4e83-ad37-42353034cd0b tempest-CreateVolumesFromImageTest-272599248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:41:23 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-30c2f9a4-f603-4e83-ad37-42353034cd0b tempest-CreateVolumesFromImageTest-272599248 None] Flow 'volume_create_manager' (44423bb2-526a-41ce-b1b0-d101f6cc405c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:41:23 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-30c2f9a4-f603-4e83-ad37-42353034cd0b tempest-CreateVolumesFromImageTest-272599248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96a3e7a4-6ce7-4b94-8e64-ebacafeeac04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:23 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-30c2f9a4-f603-4e83-ad37-42353034cd0b tempest-CreateVolumesFromImageTest-272599248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96a3e7a4-6ce7-4b94-8e64-ebacafeeac04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:41:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-712952904',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53c36f02-0f36-42f7-a0e5-9383bc778540,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4b3ad8730dd4f73a3709b2e7317fcda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:41:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:41:24Z,use_quota=True,user_id='126298d1db6841619643104ed41ed819',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:23 devstack sudo[104910]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:23 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-30c2f9a4-f603-4e83-ad37-42353034cd0b tempest-CreateVolumesFromImageTest-272599248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2c04ac2-d7d1-461e-97fe-be4c83084ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:23 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-30c2f9a4-f603-4e83-ad37-42353034cd0b tempest-CreateVolumesFromImageTest-272599248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2c04ac2-d7d1-461e-97fe-be4c83084ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:23 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-30c2f9a4-f603-4e83-ad37-42353034cd0b tempest-CreateVolumesFromImageTest-272599248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7211632b-ed23-403e-9c72-7c7693d010f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:23 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-30c2f9a4-f603-4e83-ad37-42353034cd0b tempest-CreateVolumesFromImageTest-272599248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7211632b-ed23-403e-9c72-7c7693d010f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53c36f02-0f36-42f7-a0e5-9383bc778540', 'volume_name': 'volume-53c36f02-0f36-42f7-a0e5-9383bc778540', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:23 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-30c2f9a4-f603-4e83-ad37-42353034cd0b tempest-CreateVolumesFromImageTest-272599248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ada489a-d9f8-43f3-afdb-11e810505f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:23 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-30c2f9a4-f603-4e83-ad37-42353034cd0b tempest-CreateVolumesFromImageTest-272599248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ada489a-d9f8-43f3-afdb-11e810505f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:23 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-30c2f9a4-f603-4e83-ad37-42353034cd0b tempest-CreateVolumesFromImageTest-272599248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13bf3f1e-a58e-493b-8b92-ccef56d9abfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:23 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-30c2f9a4-f603-4e83-ad37-42353034cd0b tempest-CreateVolumesFromImageTest-272599248 None] Volume 53c36f02-0f36-42f7-a0e5-9383bc778540: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53c36f02-0f36-42f7-a0e5-9383bc778540', 'volume_size': 1}
Jul 14 16:41:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-30c2f9a4-f603-4e83-ad37-42353034cd0b tempest-CreateVolumesFromImageTest-272599248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-30c2f9a4-f603-4e83-ad37-42353034cd0b tempest-CreateVolumesFromImageTest-272599248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:23 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-30c2f9a4-f603-4e83-ad37-42353034cd0b tempest-CreateVolumesFromImageTest-272599248 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:41:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-712952904',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53c36f02-0f36-42f7-a0e5-9383bc778540,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4b3ad8730dd4f73a3709b2e7317fcda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:41:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:41:24Z,use_quota=True,user_id='126298d1db6841619643104ed41ed819',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:41:23 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-30c2f9a4-f603-4e83-ad37-42353034cd0b tempest-CreateVolumesFromImageTest-272599248 None] Creating volume 53c36f02-0f36-42f7-a0e5-9383bc778540 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:41:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-30c2f9a4-f603-4e83-ad37-42353034cd0b tempest-CreateVolumesFromImageTest-272599248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-30c2f9a4-f603-4e83-ad37-42353034cd0b tempest-CreateVolumesFromImageTest-272599248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:23 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-30c2f9a4-f603-4e83-ad37-42353034cd0b tempest-CreateVolumesFromImageTest-272599248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:41:23 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-30c2f9a4-f603-4e83-ad37-42353034cd0b tempest-CreateVolumesFromImageTest-272599248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:41:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-30c2f9a4-f603-4e83-ad37-42353034cd0b tempest-CreateVolumesFromImageTest-272599248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:23 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-30c2f9a4-f603-4e83-ad37-42353034cd0b tempest-CreateVolumesFromImageTest-272599248 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:41:23 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-30c2f9a4-f603-4e83-ad37-42353034cd0b tempest-CreateVolumesFromImageTest-272599248 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:41:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-30c2f9a4-f603-4e83-ad37-42353034cd0b tempest-CreateVolumesFromImageTest-272599248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-53c36f02-0f36-42f7-a0e5-9383bc778540 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-305f02ee-a4a5-404d-ae12-47cf5a9b79e2 tempest-CreateVolumesFromSnapshotTest-860857562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cb2d2eb6-1175-495b-80e4-a0057f4d0dbe" returned: 0 in 0.517s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-305f02ee-a4a5-404d-ae12-47cf5a9b79e2 tempest-CreateVolumesFromSnapshotTest-860857562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cb2d2eb6-1175-495b-80e4-a0057f4d0dbe.16cbd470-bbab-499c-9ebe-fb383bb3f133 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:23 devstack sudo[104915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-53c36f02-0f36-42f7-a0e5-9383bc778540 1073741824
Jul 14 16:41:23 devstack sudo[104915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:23 devstack sudo[104916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cb2d2eb6-1175-495b-80e4-a0057f4d0dbe.16cbd470-bbab-499c-9ebe-fb383bb3f133
Jul 14 16:41:23 devstack sudo[104916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:24 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-a42376ca-c9b1-4dea-9805-da33a8a6ef21 tempest-CreateVolumesFromImageTest-272599248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:41:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a42376ca-c9b1-4dea-9805-da33a8a6ef21 tempest-CreateVolumesFromImageTest-272599248 None] Flow 'volume_create_manager' (570912bd-d9ab-41b1-96c6-6085f40e1029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:41:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a42376ca-c9b1-4dea-9805-da33a8a6ef21 tempest-CreateVolumesFromImageTest-272599248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23297eae-8182-4141-a012-463a7aa2f8c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:24 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b7334339-7cfe-4242-af57-cd673469517e tempest-ProjectReaderTests-1127203843 None] Acquiring lock "cinder-208de139-203a-4d05-af90-540ed141b5f6-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:41:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a42376ca-c9b1-4dea-9805-da33a8a6ef21 tempest-CreateVolumesFromImageTest-272599248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23297eae-8182-4141-a012-463a7aa2f8c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:41:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1030829424',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2079d13-2a96-471d-98a9-44bcf44e5b73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4b3ad8730dd4f73a3709b2e7317fcda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:41:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:41:24Z,use_quota=True,user_id='126298d1db6841619643104ed41ed819',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a42376ca-c9b1-4dea-9805-da33a8a6ef21 tempest-CreateVolumesFromImageTest-272599248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e662461-68e8-44bc-beb0-159a41281784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a42376ca-c9b1-4dea-9805-da33a8a6ef21 tempest-CreateVolumesFromImageTest-272599248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e662461-68e8-44bc-beb0-159a41281784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a42376ca-c9b1-4dea-9805-da33a8a6ef21 tempest-CreateVolumesFromImageTest-272599248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fc23f92-5310-4583-be27-d2a61182d316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a42376ca-c9b1-4dea-9805-da33a8a6ef21 tempest-CreateVolumesFromImageTest-272599248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fc23f92-5310-4583-be27-d2a61182d316) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2079d13-2a96-471d-98a9-44bcf44e5b73', 'volume_name': 'volume-b2079d13-2a96-471d-98a9-44bcf44e5b73', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a42376ca-c9b1-4dea-9805-da33a8a6ef21 tempest-CreateVolumesFromImageTest-272599248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0caac1f7-6476-469c-9cf5-ed946deaf044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a42376ca-c9b1-4dea-9805-da33a8a6ef21 tempest-CreateVolumesFromImageTest-272599248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0caac1f7-6476-469c-9cf5-ed946deaf044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a42376ca-c9b1-4dea-9805-da33a8a6ef21 tempest-CreateVolumesFromImageTest-272599248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c15777ff-cf95-40e9-8c33-6da3676bad15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:24 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-a42376ca-c9b1-4dea-9805-da33a8a6ef21 tempest-CreateVolumesFromImageTest-272599248 None] Volume b2079d13-2a96-471d-98a9-44bcf44e5b73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2079d13-2a96-471d-98a9-44bcf44e5b73', 'volume_size': 1}
Jul 14 16:41:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a42376ca-c9b1-4dea-9805-da33a8a6ef21 tempest-CreateVolumesFromImageTest-272599248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:24 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b7334339-7cfe-4242-af57-cd673469517e tempest-ProjectReaderTests-1127203843 None] Lock "cinder-208de139-203a-4d05-af90-540ed141b5f6-delete_volume" acquired by "delete_volume" :: waited 0.098s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:41:24 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b7334339-7cfe-4242-af57-cd673469517e tempest-ProjectReaderTests-1127203843 None] Acquiring lock "cinder-quobyte-208de139-203a-4d05-af90-540ed141b5f6" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:41:24 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b7334339-7cfe-4242-af57-cd673469517e tempest-ProjectReaderTests-1127203843 None] Lock "cinder-quobyte-208de139-203a-4d05-af90-540ed141b5f6" acquired by "delete_volume" :: waited 0.017s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:41:24 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[97547831-3edd-40c7-a500-332760ea0c22]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:41:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b7334339-7cfe-4242-af57-cd673469517e tempest-ProjectReaderTests-1127203843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-208de139-203a-4d05-af90-540ed141b5f6 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:24 devstack sudo[104916]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-305f02ee-a4a5-404d-ae12-47cf5a9b79e2 tempest-CreateVolumesFromSnapshotTest-860857562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cb2d2eb6-1175-495b-80e4-a0057f4d0dbe.16cbd470-bbab-499c-9ebe-fb383bb3f133" returned: 0 in 0.629s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-305f02ee-a4a5-404d-ae12-47cf5a9b79e2 tempest-CreateVolumesFromSnapshotTest-860857562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cb2d2eb6-1175-495b-80e4-a0057f4d0dbe.16cbd470-bbab-499c-9ebe-fb383bb3f133 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:24 devstack sudo[104915]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-30c2f9a4-f603-4e83-ad37-42353034cd0b tempest-CreateVolumesFromImageTest-272599248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-53c36f02-0f36-42f7-a0e5-9383bc778540 1073741824" returned: 0 in 0.703s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:24 devstack sudo[104926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cb2d2eb6-1175-495b-80e4-a0057f4d0dbe.16cbd470-bbab-499c-9ebe-fb383bb3f133
Jul 14 16:41:24 devstack sudo[104926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-30c2f9a4-f603-4e83-ad37-42353034cd0b tempest-CreateVolumesFromImageTest-272599248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-53c36f02-0f36-42f7-a0e5-9383bc778540 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:24 devstack sudo[104928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-53c36f02-0f36-42f7-a0e5-9383bc778540
Jul 14 16:41:24 devstack sudo[104928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:24 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d53ae1b-c2d1-462b-9442-d63dffa0edbc tempest-CreateVolumesFromImageTest-272599248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:41:24 devstack sudo[104925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-208de139-203a-4d05-af90-540ed141b5f6
Jul 14 16:41:24 devstack sudo[104925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5d53ae1b-c2d1-462b-9442-d63dffa0edbc tempest-CreateVolumesFromImageTest-272599248 None] Flow 'volume_create_manager' (8d2762de-e752-46f8-803f-423b18f51b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:41:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5d53ae1b-c2d1-462b-9442-d63dffa0edbc tempest-CreateVolumesFromImageTest-272599248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9146f0b-92bb-4be3-84c1-28c344b59a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5d53ae1b-c2d1-462b-9442-d63dffa0edbc tempest-CreateVolumesFromImageTest-272599248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9146f0b-92bb-4be3-84c1-28c344b59a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:41:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1644698088',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc4cecee-834b-4b4e-adef-09fe4d6ae9e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4b3ad8730dd4f73a3709b2e7317fcda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:41:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:41:25Z,use_quota=True,user_id='126298d1db6841619643104ed41ed819',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5d53ae1b-c2d1-462b-9442-d63dffa0edbc tempest-CreateVolumesFromImageTest-272599248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be6cb0b9-a645-49db-8b2b-4332616bc59b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5d53ae1b-c2d1-462b-9442-d63dffa0edbc tempest-CreateVolumesFromImageTest-272599248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be6cb0b9-a645-49db-8b2b-4332616bc59b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5d53ae1b-c2d1-462b-9442-d63dffa0edbc tempest-CreateVolumesFromImageTest-272599248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (541a04ad-e46a-468d-a267-dcfe3888cdd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5d53ae1b-c2d1-462b-9442-d63dffa0edbc tempest-CreateVolumesFromImageTest-272599248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (541a04ad-e46a-468d-a267-dcfe3888cdd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc4cecee-834b-4b4e-adef-09fe4d6ae9e9', 'volume_name': 'volume-cc4cecee-834b-4b4e-adef-09fe4d6ae9e9', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5d53ae1b-c2d1-462b-9442-d63dffa0edbc tempest-CreateVolumesFromImageTest-272599248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f96720e9-5610-4e13-89eb-88291e9f79ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5d53ae1b-c2d1-462b-9442-d63dffa0edbc tempest-CreateVolumesFromImageTest-272599248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f96720e9-5610-4e13-89eb-88291e9f79ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5d53ae1b-c2d1-462b-9442-d63dffa0edbc tempest-CreateVolumesFromImageTest-272599248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df66c5b9-ea94-48d4-9199-584ecd9e0d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:24 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-5d53ae1b-c2d1-462b-9442-d63dffa0edbc tempest-CreateVolumesFromImageTest-272599248 None] Volume cc4cecee-834b-4b4e-adef-09fe4d6ae9e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc4cecee-834b-4b4e-adef-09fe4d6ae9e9', 'volume_size': 1}
Jul 14 16:41:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5d53ae1b-c2d1-462b-9442-d63dffa0edbc tempest-CreateVolumesFromImageTest-272599248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:24 devstack sudo[104926]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-305f02ee-a4a5-404d-ae12-47cf5a9b79e2 tempest-CreateVolumesFromSnapshotTest-860857562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cb2d2eb6-1175-495b-80e4-a0057f4d0dbe.16cbd470-bbab-499c-9ebe-fb383bb3f133" returned: 0 in 0.419s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:24 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-305f02ee-a4a5-404d-ae12-47cf5a9b79e2 tempest-CreateVolumesFromSnapshotTest-860857562 None] Lock "cinder-quobyte-16cbd470-bbab-499c-9ebe-fb383bb3f133" released by "_delete_snapshot" :: held 2.223s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:41:24 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-305f02ee-a4a5-404d-ae12-47cf5a9b79e2 tempest-CreateVolumesFromSnapshotTest-860857562 None] Lock "cinder-quobyte-cb2d2eb6-1175-495b-80e4-a0057f4d0dbe" released by "delete_snapshot" :: held 2.277s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:41:25 devstack sudo[104928]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:25 devstack sudo[104925]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-30c2f9a4-f603-4e83-ad37-42353034cd0b tempest-CreateVolumesFromImageTest-272599248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-53c36f02-0f36-42f7-a0e5-9383bc778540" returned: 0 in 0.550s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:25 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-30c2f9a4-f603-4e83-ad37-42353034cd0b tempest-CreateVolumesFromImageTest-272599248 None] <== create_volume: return (1327ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:41:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-30c2f9a4-f603-4e83-ad37-42353034cd0b tempest-CreateVolumesFromImageTest-272599248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.329s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b7334339-7cfe-4242-af57-cd673469517e tempest-ProjectReaderTests-1127203843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-208de139-203a-4d05-af90-540ed141b5f6" returned: 0 in 0.692s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a42376ca-c9b1-4dea-9805-da33a8a6ef21 tempest-CreateVolumesFromImageTest-272599248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.849s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:25 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a42376ca-c9b1-4dea-9805-da33a8a6ef21 tempest-CreateVolumesFromImageTest-272599248 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:41:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1030829424',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2079d13-2a96-471d-98a9-44bcf44e5b73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4b3ad8730dd4f73a3709b2e7317fcda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:41:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:41:24Z,use_quota=True,user_id='126298d1db6841619643104ed41ed819',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:41:25 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-a42376ca-c9b1-4dea-9805-da33a8a6ef21 tempest-CreateVolumesFromImageTest-272599248 None] Creating volume b2079d13-2a96-471d-98a9-44bcf44e5b73 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:41:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a42376ca-c9b1-4dea-9805-da33a8a6ef21 tempest-CreateVolumesFromImageTest-272599248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a42376ca-c9b1-4dea-9805-da33a8a6ef21 tempest-CreateVolumesFromImageTest-272599248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:25 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a42376ca-c9b1-4dea-9805-da33a8a6ef21 tempest-CreateVolumesFromImageTest-272599248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:41:25 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a42376ca-c9b1-4dea-9805-da33a8a6ef21 tempest-CreateVolumesFromImageTest-272599248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:41:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a42376ca-c9b1-4dea-9805-da33a8a6ef21 tempest-CreateVolumesFromImageTest-272599248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:25 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a42376ca-c9b1-4dea-9805-da33a8a6ef21 tempest-CreateVolumesFromImageTest-272599248 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:41:25 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-a42376ca-c9b1-4dea-9805-da33a8a6ef21 tempest-CreateVolumesFromImageTest-272599248 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:41:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a42376ca-c9b1-4dea-9805-da33a8a6ef21 tempest-CreateVolumesFromImageTest-272599248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b2079d13-2a96-471d-98a9-44bcf44e5b73 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b7334339-7cfe-4242-af57-cd673469517e tempest-ProjectReaderTests-1127203843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-208de139-203a-4d05-af90-540ed141b5f6 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:25 devstack sudo[104937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b2079d13-2a96-471d-98a9-44bcf44e5b73 1073741824
Jul 14 16:41:25 devstack sudo[104938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-208de139-203a-4d05-af90-540ed141b5f6
Jul 14 16:41:25 devstack sudo[104937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:25 devstack sudo[104938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:25 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-30c2f9a4-f603-4e83-ad37-42353034cd0b tempest-CreateVolumesFromImageTest-272599248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13bf3f1e-a58e-493b-8b92-ccef56d9abfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53c36f02-0f36-42f7-a0e5-9383bc778540', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:25 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-30c2f9a4-f603-4e83-ad37-42353034cd0b tempest-CreateVolumesFromImageTest-272599248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cede0fbe-946f-4ff5-8b9c-66c81645fd3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:25 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-305f02ee-a4a5-404d-ae12-47cf5a9b79e2 tempest-CreateVolumesFromSnapshotTest-860857562 None] Created reservations ['b4cec103-a9a3-4289-8354-2aada1cf23db', '427db8e0-1f3d-45c9-a955-0322d49934ac', 'dd8eeee7-b109-4a13-8c10-f0c4e25979ce', 'abc1269b-c5bf-4947-bb1b-fc224dad834a'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:41:25 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-30c2f9a4-f603-4e83-ad37-42353034cd0b tempest-CreateVolumesFromImageTest-272599248 None] Volume volume-53c36f02-0f36-42f7-a0e5-9383bc778540 (53c36f02-0f36-42f7-a0e5-9383bc778540): created successfully
Jul 14 16:41:25 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-30c2f9a4-f603-4e83-ad37-42353034cd0b tempest-CreateVolumesFromImageTest-272599248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cede0fbe-946f-4ff5-8b9c-66c81645fd3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:25 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-30c2f9a4-f603-4e83-ad37-42353034cd0b tempest-CreateVolumesFromImageTest-272599248 None] Flow 'volume_create_manager' (44423bb2-526a-41ce-b1b0-d101f6cc405c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:41:25 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-30c2f9a4-f603-4e83-ad37-42353034cd0b tempest-CreateVolumesFromImageTest-272599248 None] Created volume successfully.
Jul 14 16:41:25 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f087881-6c08-4460-b909-4565aeb6d4f4 tempest-CreateVolumesFromImageTest-272599248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:41:25 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0f087881-6c08-4460-b909-4565aeb6d4f4 tempest-CreateVolumesFromImageTest-272599248 None] Flow 'volume_create_manager' (397401c1-b9e7-470e-8681-de42ee924375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:41:25 devstack sudo[104938]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:25 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0f087881-6c08-4460-b909-4565aeb6d4f4 tempest-CreateVolumesFromImageTest-272599248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (877f4ba6-09ce-4fb7-966d-3710253e988b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b7334339-7cfe-4242-af57-cd673469517e tempest-ProjectReaderTests-1127203843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-208de139-203a-4d05-af90-540ed141b5f6" returned: 0 in 0.407s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:25 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-305f02ee-a4a5-404d-ae12-47cf5a9b79e2 tempest-CreateVolumesFromSnapshotTest-860857562 None] Delete snapshot completed successfully.
Jul 14 16:41:25 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b7334339-7cfe-4242-af57-cd673469517e tempest-ProjectReaderTests-1127203843 None] Lock "cinder-quobyte-208de139-203a-4d05-af90-540ed141b5f6" released by "delete_volume" :: held 1.242s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:41:25 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0f087881-6c08-4460-b909-4565aeb6d4f4 tempest-CreateVolumesFromImageTest-272599248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (877f4ba6-09ce-4fb7-966d-3710253e988b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:41:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-852555672',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9887f49-d253-4498-9ebf-3b6d77a2de1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4b3ad8730dd4f73a3709b2e7317fcda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:41:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:41:25Z,use_quota=True,user_id='126298d1db6841619643104ed41ed819',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:25 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0f087881-6c08-4460-b909-4565aeb6d4f4 tempest-CreateVolumesFromImageTest-272599248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25c34cdf-9730-42d3-abf2-ac3132530dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:25 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0f087881-6c08-4460-b909-4565aeb6d4f4 tempest-CreateVolumesFromImageTest-272599248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25c34cdf-9730-42d3-abf2-ac3132530dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:25 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0f087881-6c08-4460-b909-4565aeb6d4f4 tempest-CreateVolumesFromImageTest-272599248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b78f6ec-2c22-4872-a43c-a0a998430e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:25 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0f087881-6c08-4460-b909-4565aeb6d4f4 tempest-CreateVolumesFromImageTest-272599248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b78f6ec-2c22-4872-a43c-a0a998430e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9887f49-d253-4498-9ebf-3b6d77a2de1e', 'volume_name': 'volume-f9887f49-d253-4498-9ebf-3b6d77a2de1e', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:25 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0f087881-6c08-4460-b909-4565aeb6d4f4 tempest-CreateVolumesFromImageTest-272599248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a84e496-7814-44a1-9a45-586240c7fa06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:25 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0f087881-6c08-4460-b909-4565aeb6d4f4 tempest-CreateVolumesFromImageTest-272599248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a84e496-7814-44a1-9a45-586240c7fa06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:25 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0f087881-6c08-4460-b909-4565aeb6d4f4 tempest-CreateVolumesFromImageTest-272599248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9633d4cb-ac03-4e47-a3e7-457375f7e1f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:25 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-0f087881-6c08-4460-b909-4565aeb6d4f4 tempest-CreateVolumesFromImageTest-272599248 None] Volume f9887f49-d253-4498-9ebf-3b6d77a2de1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9887f49-d253-4498-9ebf-3b6d77a2de1e', 'volume_size': 1}
Jul 14 16:41:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0f087881-6c08-4460-b909-4565aeb6d4f4 tempest-CreateVolumesFromImageTest-272599248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:25 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-305f02ee-a4a5-404d-ae12-47cf5a9b79e2 tempest-CreateVolumesFromSnapshotTest-860857562 None] Lock "cinder-16cbd470-bbab-499c-9ebe-fb383bb3f133-delete_snapshot" released by "delete_snapshot" :: held 3.050s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:41:25 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5313922-4995-43c3-b8cb-66f4da87160b tempest-CreateVolumesFromImageTest-272599248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:41:25 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c5313922-4995-43c3-b8cb-66f4da87160b tempest-CreateVolumesFromImageTest-272599248 None] Flow 'volume_create_manager' (860277cb-c47b-445a-9a96-8a2498f537ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:41:25 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c5313922-4995-43c3-b8cb-66f4da87160b tempest-CreateVolumesFromImageTest-272599248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fc9b79c-14a2-4ffa-8114-5c8605234f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:25 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c5313922-4995-43c3-b8cb-66f4da87160b tempest-CreateVolumesFromImageTest-272599248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fc9b79c-14a2-4ffa-8114-5c8605234f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:41:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1837340105',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1bef319-f99f-4785-a70c-6ece0fd772c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4b3ad8730dd4f73a3709b2e7317fcda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:41:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:41:26Z,use_quota=True,user_id='126298d1db6841619643104ed41ed819',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:25 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c5313922-4995-43c3-b8cb-66f4da87160b tempest-CreateVolumesFromImageTest-272599248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97432a10-110d-4d0c-87d5-b8d02e7daa53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:25 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c5313922-4995-43c3-b8cb-66f4da87160b tempest-CreateVolumesFromImageTest-272599248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97432a10-110d-4d0c-87d5-b8d02e7daa53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:25 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c5313922-4995-43c3-b8cb-66f4da87160b tempest-CreateVolumesFromImageTest-272599248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (274bee90-ac94-49ca-ba5f-b2d1980c5526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:25 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c5313922-4995-43c3-b8cb-66f4da87160b tempest-CreateVolumesFromImageTest-272599248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (274bee90-ac94-49ca-ba5f-b2d1980c5526) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1bef319-f99f-4785-a70c-6ece0fd772c7', 'volume_name': 'volume-e1bef319-f99f-4785-a70c-6ece0fd772c7', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:25 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c5313922-4995-43c3-b8cb-66f4da87160b tempest-CreateVolumesFromImageTest-272599248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (832275f6-8b09-4354-8c2d-9b39a98e4e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:25 devstack sudo[104937]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:25 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c5313922-4995-43c3-b8cb-66f4da87160b tempest-CreateVolumesFromImageTest-272599248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (832275f6-8b09-4354-8c2d-9b39a98e4e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:25 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c5313922-4995-43c3-b8cb-66f4da87160b tempest-CreateVolumesFromImageTest-272599248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c6d6613-7265-4258-96b8-a908e8b8d1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:25 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-c5313922-4995-43c3-b8cb-66f4da87160b tempest-CreateVolumesFromImageTest-272599248 None] Volume e1bef319-f99f-4785-a70c-6ece0fd772c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1bef319-f99f-4785-a70c-6ece0fd772c7', 'volume_size': 1}
Jul 14 16:41:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c5313922-4995-43c3-b8cb-66f4da87160b tempest-CreateVolumesFromImageTest-272599248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a42376ca-c9b1-4dea-9805-da33a8a6ef21 tempest-CreateVolumesFromImageTest-272599248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b2079d13-2a96-471d-98a9-44bcf44e5b73 1073741824" returned: 0 in 0.677s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:25 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-b7334339-7cfe-4242-af57-cd673469517e tempest-ProjectReaderTests-1127203843 None] Created reservations ['676ffec2-dfab-4ae0-8520-5f0f66c2ab23', 'f667a676-90f7-40eb-9c16-7a3a90dab32a', '142f99d0-0b5e-4c76-aad1-4b064ac0a9e5', 'bf65029d-489a-40e8-bdd0-23303b63ba23'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:41:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a42376ca-c9b1-4dea-9805-da33a8a6ef21 tempest-CreateVolumesFromImageTest-272599248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b2079d13-2a96-471d-98a9-44bcf44e5b73 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:25 devstack sudo[104946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b2079d13-2a96-471d-98a9-44bcf44e5b73
Jul 14 16:41:25 devstack sudo[104946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b7334339-7cfe-4242-af57-cd673469517e tempest-ProjectReaderTests-1127203843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b7334339-7cfe-4242-af57-cd673469517e tempest-ProjectReaderTests-1127203843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:25 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-b7334339-7cfe-4242-af57-cd673469517e tempest-ProjectReaderTests-1127203843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:41:25 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-b7334339-7cfe-4242-af57-cd673469517e tempest-ProjectReaderTests-1127203843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:41:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b7334339-7cfe-4242-af57-cd673469517e tempest-ProjectReaderTests-1127203843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b7334339-7cfe-4242-af57-cd673469517e tempest-ProjectReaderTests-1127203843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:25 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f2c38791-ef36-43b3-ada4-55087ac73487 tempest-CreateVolumesFromSnapshotTest-860857562 None] Acquiring lock "cinder-cb2d2eb6-1175-495b-80e4-a0057f4d0dbe-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:41:25 devstack sudo[104948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:41:25 devstack sudo[104948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:25 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f2c38791-ef36-43b3-ada4-55087ac73487 tempest-CreateVolumesFromSnapshotTest-860857562 None] Lock "cinder-cb2d2eb6-1175-495b-80e4-a0057f4d0dbe-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:41:26 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f2c38791-ef36-43b3-ada4-55087ac73487 tempest-CreateVolumesFromSnapshotTest-860857562 None] Acquiring lock "cinder-quobyte-cb2d2eb6-1175-495b-80e4-a0057f4d0dbe" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:41:26 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f2c38791-ef36-43b3-ada4-55087ac73487 tempest-CreateVolumesFromSnapshotTest-860857562 None] Lock "cinder-quobyte-cb2d2eb6-1175-495b-80e4-a0057f4d0dbe" acquired by "delete_volume" :: waited 0.024s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:41:26 devstack sudo[104946]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:26 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b6c7d09-8e06-41a0-9699-b0d7195a7348]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:41:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f2c38791-ef36-43b3-ada4-55087ac73487 tempest-CreateVolumesFromSnapshotTest-860857562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cb2d2eb6-1175-495b-80e4-a0057f4d0dbe {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a42376ca-c9b1-4dea-9805-da33a8a6ef21 tempest-CreateVolumesFromImageTest-272599248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b2079d13-2a96-471d-98a9-44bcf44e5b73" returned: 0 in 0.310s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:26 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a42376ca-c9b1-4dea-9805-da33a8a6ef21 tempest-CreateVolumesFromImageTest-272599248 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:41:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a42376ca-c9b1-4dea-9805-da33a8a6ef21 tempest-CreateVolumesFromImageTest-272599248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5d53ae1b-c2d1-462b-9442-d63dffa0edbc tempest-CreateVolumesFromImageTest-272599248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.372s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:26 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5d53ae1b-c2d1-462b-9442-d63dffa0edbc tempest-CreateVolumesFromImageTest-272599248 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:41:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1644698088',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc4cecee-834b-4b4e-adef-09fe4d6ae9e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4b3ad8730dd4f73a3709b2e7317fcda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:41:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:41:25Z,use_quota=True,user_id='126298d1db6841619643104ed41ed819',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:41:26 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-5d53ae1b-c2d1-462b-9442-d63dffa0edbc tempest-CreateVolumesFromImageTest-272599248 None] Creating volume cc4cecee-834b-4b4e-adef-09fe4d6ae9e9 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:41:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5d53ae1b-c2d1-462b-9442-d63dffa0edbc tempest-CreateVolumesFromImageTest-272599248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5d53ae1b-c2d1-462b-9442-d63dffa0edbc tempest-CreateVolumesFromImageTest-272599248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:26 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5d53ae1b-c2d1-462b-9442-d63dffa0edbc tempest-CreateVolumesFromImageTest-272599248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:41:26 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5d53ae1b-c2d1-462b-9442-d63dffa0edbc tempest-CreateVolumesFromImageTest-272599248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:41:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5d53ae1b-c2d1-462b-9442-d63dffa0edbc tempest-CreateVolumesFromImageTest-272599248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:26 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5d53ae1b-c2d1-462b-9442-d63dffa0edbc tempest-CreateVolumesFromImageTest-272599248 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:41:26 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-5d53ae1b-c2d1-462b-9442-d63dffa0edbc tempest-CreateVolumesFromImageTest-272599248 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:41:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5d53ae1b-c2d1-462b-9442-d63dffa0edbc tempest-CreateVolumesFromImageTest-272599248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cc4cecee-834b-4b4e-adef-09fe4d6ae9e9 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:26 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a42376ca-c9b1-4dea-9805-da33a8a6ef21 tempest-CreateVolumesFromImageTest-272599248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c15777ff-cf95-40e9-8c33-6da3676bad15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2079d13-2a96-471d-98a9-44bcf44e5b73', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:26 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a42376ca-c9b1-4dea-9805-da33a8a6ef21 tempest-CreateVolumesFromImageTest-272599248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7eba262-0816-4da5-a240-207db0e14d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:26 devstack sudo[104952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cc4cecee-834b-4b4e-adef-09fe4d6ae9e9 1073741824
Jul 14 16:41:26 devstack sudo[104952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:26 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-a42376ca-c9b1-4dea-9805-da33a8a6ef21 tempest-CreateVolumesFromImageTest-272599248 None] Volume volume-b2079d13-2a96-471d-98a9-44bcf44e5b73 (b2079d13-2a96-471d-98a9-44bcf44e5b73): created successfully
Jul 14 16:41:26 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a42376ca-c9b1-4dea-9805-da33a8a6ef21 tempest-CreateVolumesFromImageTest-272599248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7eba262-0816-4da5-a240-207db0e14d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:26 devstack sudo[104948]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:26 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a42376ca-c9b1-4dea-9805-da33a8a6ef21 tempest-CreateVolumesFromImageTest-272599248 None] Flow 'volume_create_manager' (570912bd-d9ab-41b1-96c6-6085f40e1029) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:41:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b7334339-7cfe-4242-af57-cd673469517e tempest-ProjectReaderTests-1127203843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.362s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:26 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-b7334339-7cfe-4242-af57-cd673469517e tempest-ProjectReaderTests-1127203843 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:41:26 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-b7334339-7cfe-4242-af57-cd673469517e tempest-ProjectReaderTests-1127203843 None] Deleted volume successfully.
Jul 14 16:41:26 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-a42376ca-c9b1-4dea-9805-da33a8a6ef21 tempest-CreateVolumesFromImageTest-272599248 None] Created volume successfully.
Jul 14 16:41:26 devstack sudo[104951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cb2d2eb6-1175-495b-80e4-a0057f4d0dbe
Jul 14 16:41:26 devstack sudo[104951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:26 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b7334339-7cfe-4242-af57-cd673469517e tempest-ProjectReaderTests-1127203843 None] Lock "cinder-208de139-203a-4d05-af90-540ed141b5f6-delete_volume" released by "delete_volume" :: held 2.037s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:41:26 devstack sudo[104951]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f2c38791-ef36-43b3-ada4-55087ac73487 tempest-CreateVolumesFromSnapshotTest-860857562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cb2d2eb6-1175-495b-80e4-a0057f4d0dbe" returned: 0 in 0.461s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f2c38791-ef36-43b3-ada4-55087ac73487 tempest-CreateVolumesFromSnapshotTest-860857562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cb2d2eb6-1175-495b-80e4-a0057f4d0dbe {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:26 devstack sudo[104962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cb2d2eb6-1175-495b-80e4-a0057f4d0dbe
Jul 14 16:41:26 devstack sudo[104962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:26 devstack sudo[104952]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5d53ae1b-c2d1-462b-9442-d63dffa0edbc tempest-CreateVolumesFromImageTest-272599248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cc4cecee-834b-4b4e-adef-09fe4d6ae9e9 1073741824" returned: 0 in 0.583s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5d53ae1b-c2d1-462b-9442-d63dffa0edbc tempest-CreateVolumesFromImageTest-272599248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cc4cecee-834b-4b4e-adef-09fe4d6ae9e9 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:26 devstack sudo[104964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cc4cecee-834b-4b4e-adef-09fe4d6ae9e9
Jul 14 16:41:26 devstack sudo[104964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:26 devstack sudo[104962]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f2c38791-ef36-43b3-ada4-55087ac73487 tempest-CreateVolumesFromSnapshotTest-860857562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cb2d2eb6-1175-495b-80e4-a0057f4d0dbe" returned: 0 in 0.329s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:26 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f2c38791-ef36-43b3-ada4-55087ac73487 tempest-CreateVolumesFromSnapshotTest-860857562 None] Lock "cinder-quobyte-cb2d2eb6-1175-495b-80e4-a0057f4d0dbe" released by "delete_volume" :: held 0.889s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:41:27 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-f2c38791-ef36-43b3-ada4-55087ac73487 tempest-CreateVolumesFromSnapshotTest-860857562 None] Created reservations ['5926e08b-cfbb-44a0-a205-8f4f93941f85', 'e6f3b734-6bba-46bf-bfc4-06ae097ead5b', '6d1357a7-e6c1-4a2a-841f-647bce5f317c', '8ac9e078-74a1-4684-ae16-05944e653b09'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:41:27 devstack sudo[104964]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5d53ae1b-c2d1-462b-9442-d63dffa0edbc tempest-CreateVolumesFromImageTest-272599248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cc4cecee-834b-4b4e-adef-09fe4d6ae9e9" returned: 0 in 0.343s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:27 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5d53ae1b-c2d1-462b-9442-d63dffa0edbc tempest-CreateVolumesFromImageTest-272599248 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:41:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5d53ae1b-c2d1-462b-9442-d63dffa0edbc tempest-CreateVolumesFromImageTest-272599248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0f087881-6c08-4460-b909-4565aeb6d4f4 tempest-CreateVolumesFromImageTest-272599248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.505s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:27 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0f087881-6c08-4460-b909-4565aeb6d4f4 tempest-CreateVolumesFromImageTest-272599248 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:41:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-852555672',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9887f49-d253-4498-9ebf-3b6d77a2de1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4b3ad8730dd4f73a3709b2e7317fcda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:41:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:41:25Z,use_quota=True,user_id='126298d1db6841619643104ed41ed819',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:41:27 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-0f087881-6c08-4460-b909-4565aeb6d4f4 tempest-CreateVolumesFromImageTest-272599248 None] Creating volume f9887f49-d253-4498-9ebf-3b6d77a2de1e {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:41:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0f087881-6c08-4460-b909-4565aeb6d4f4 tempest-CreateVolumesFromImageTest-272599248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0f087881-6c08-4460-b909-4565aeb6d4f4 tempest-CreateVolumesFromImageTest-272599248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:27 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0f087881-6c08-4460-b909-4565aeb6d4f4 tempest-CreateVolumesFromImageTest-272599248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:41:27 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0f087881-6c08-4460-b909-4565aeb6d4f4 tempest-CreateVolumesFromImageTest-272599248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:41:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0f087881-6c08-4460-b909-4565aeb6d4f4 tempest-CreateVolumesFromImageTest-272599248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:27 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0f087881-6c08-4460-b909-4565aeb6d4f4 tempest-CreateVolumesFromImageTest-272599248 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:41:27 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-0f087881-6c08-4460-b909-4565aeb6d4f4 tempest-CreateVolumesFromImageTest-272599248 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:41:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0f087881-6c08-4460-b909-4565aeb6d4f4 tempest-CreateVolumesFromImageTest-272599248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f9887f49-d253-4498-9ebf-3b6d77a2de1e 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:27 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-af56bef5-2708-4457-b9e3-127edf526692 tempest-ProjectReaderTests-1127203843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:41:27 devstack sudo[104968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f9887f49-d253-4498-9ebf-3b6d77a2de1e 1073741824
Jul 14 16:41:27 devstack sudo[104968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-af56bef5-2708-4457-b9e3-127edf526692 tempest-ProjectReaderTests-1127203843 None] Flow 'volume_create_manager' (a347005b-49fb-4296-a39c-1a74ff361b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:41:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-af56bef5-2708-4457-b9e3-127edf526692 tempest-ProjectReaderTests-1127203843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0ce3661-2f5e-46e9-8f5a-0116f0cd0210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5d53ae1b-c2d1-462b-9442-d63dffa0edbc tempest-CreateVolumesFromImageTest-272599248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df66c5b9-ea94-48d4-9199-584ecd9e0d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc4cecee-834b-4b4e-adef-09fe4d6ae9e9', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5d53ae1b-c2d1-462b-9442-d63dffa0edbc tempest-CreateVolumesFromImageTest-272599248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9160424c-acb6-4392-bb6f-a25f5643e035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-af56bef5-2708-4457-b9e3-127edf526692 tempest-ProjectReaderTests-1127203843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0ce3661-2f5e-46e9-8f5a-0116f0cd0210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1429472720',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dda47ebd-bee2-4bd8-b811-4b02521d5cc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='883944e7bf4f4b4dbc774e64e3e27858',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:41:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:41:27Z,use_quota=True,user_id='edcf2b7f48504051a3973d82e7b0fa86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-af56bef5-2708-4457-b9e3-127edf526692 tempest-ProjectReaderTests-1127203843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c26100f5-2f9a-4867-a200-558c0a0509a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-af56bef5-2708-4457-b9e3-127edf526692 tempest-ProjectReaderTests-1127203843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c26100f5-2f9a-4867-a200-558c0a0509a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-af56bef5-2708-4457-b9e3-127edf526692 tempest-ProjectReaderTests-1127203843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5545d5cf-61e8-414a-aab5-c512e32ceeb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-af56bef5-2708-4457-b9e3-127edf526692 tempest-ProjectReaderTests-1127203843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5545d5cf-61e8-414a-aab5-c512e32ceeb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dda47ebd-bee2-4bd8-b811-4b02521d5cc5', 'volume_name': 'volume-dda47ebd-bee2-4bd8-b811-4b02521d5cc5', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-af56bef5-2708-4457-b9e3-127edf526692 tempest-ProjectReaderTests-1127203843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4efa027-b490-4cb1-8622-af474ce8e7ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-af56bef5-2708-4457-b9e3-127edf526692 tempest-ProjectReaderTests-1127203843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4efa027-b490-4cb1-8622-af474ce8e7ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-af56bef5-2708-4457-b9e3-127edf526692 tempest-ProjectReaderTests-1127203843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59e917c0-06ed-453d-8374-c359ace422c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:27 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-af56bef5-2708-4457-b9e3-127edf526692 tempest-ProjectReaderTests-1127203843 None] Volume dda47ebd-bee2-4bd8-b811-4b02521d5cc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dda47ebd-bee2-4bd8-b811-4b02521d5cc5', 'volume_size': 1}
Jul 14 16:41:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-af56bef5-2708-4457-b9e3-127edf526692 tempest-ProjectReaderTests-1127203843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:27 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-5d53ae1b-c2d1-462b-9442-d63dffa0edbc tempest-CreateVolumesFromImageTest-272599248 None] Volume volume-cc4cecee-834b-4b4e-adef-09fe4d6ae9e9 (cc4cecee-834b-4b4e-adef-09fe4d6ae9e9): created successfully
Jul 14 16:41:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5d53ae1b-c2d1-462b-9442-d63dffa0edbc tempest-CreateVolumesFromImageTest-272599248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9160424c-acb6-4392-bb6f-a25f5643e035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5d53ae1b-c2d1-462b-9442-d63dffa0edbc tempest-CreateVolumesFromImageTest-272599248 None] Flow 'volume_create_manager' (8d2762de-e752-46f8-803f-423b18f51b16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:41:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f2c38791-ef36-43b3-ada4-55087ac73487 tempest-CreateVolumesFromSnapshotTest-860857562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f2c38791-ef36-43b3-ada4-55087ac73487 tempest-CreateVolumesFromSnapshotTest-860857562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:27 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f2c38791-ef36-43b3-ada4-55087ac73487 tempest-CreateVolumesFromSnapshotTest-860857562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:41:27 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f2c38791-ef36-43b3-ada4-55087ac73487 tempest-CreateVolumesFromSnapshotTest-860857562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:41:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f2c38791-ef36-43b3-ada4-55087ac73487 tempest-CreateVolumesFromSnapshotTest-860857562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f2c38791-ef36-43b3-ada4-55087ac73487 tempest-CreateVolumesFromSnapshotTest-860857562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:27 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-5d53ae1b-c2d1-462b-9442-d63dffa0edbc tempest-CreateVolumesFromImageTest-272599248 None] Created volume successfully.
Jul 14 16:41:27 devstack sudo[104970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:41:27 devstack sudo[104970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:27 devstack sudo[104970]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f2c38791-ef36-43b3-ada4-55087ac73487 tempest-CreateVolumesFromSnapshotTest-860857562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.281s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:27 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-f2c38791-ef36-43b3-ada4-55087ac73487 tempest-CreateVolumesFromSnapshotTest-860857562 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:41:27 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-f2c38791-ef36-43b3-ada4-55087ac73487 tempest-CreateVolumesFromSnapshotTest-860857562 None] Deleted volume successfully.
Jul 14 16:41:27 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f2c38791-ef36-43b3-ada4-55087ac73487 tempest-CreateVolumesFromSnapshotTest-860857562 None] Lock "cinder-cb2d2eb6-1175-495b-80e4-a0057f4d0dbe-delete_volume" released by "delete_volume" :: held 1.679s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:41:27 devstack sudo[104968]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0f087881-6c08-4460-b909-4565aeb6d4f4 tempest-CreateVolumesFromImageTest-272599248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f9887f49-d253-4498-9ebf-3b6d77a2de1e 1073741824" returned: 0 in 0.499s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0f087881-6c08-4460-b909-4565aeb6d4f4 tempest-CreateVolumesFromImageTest-272599248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f9887f49-d253-4498-9ebf-3b6d77a2de1e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:27 devstack sudo[104977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f9887f49-d253-4498-9ebf-3b6d77a2de1e
Jul 14 16:41:27 devstack sudo[104977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:27 devstack sudo[104977]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0f087881-6c08-4460-b909-4565aeb6d4f4 tempest-CreateVolumesFromImageTest-272599248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f9887f49-d253-4498-9ebf-3b6d77a2de1e" returned: 0 in 0.279s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:27 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0f087881-6c08-4460-b909-4565aeb6d4f4 tempest-CreateVolumesFromImageTest-272599248 None] <== create_volume: return (820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:41:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0f087881-6c08-4460-b909-4565aeb6d4f4 tempest-CreateVolumesFromImageTest-272599248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c5313922-4995-43c3-b8cb-66f4da87160b tempest-CreateVolumesFromImageTest-272599248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.184s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:27 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-c5313922-4995-43c3-b8cb-66f4da87160b tempest-CreateVolumesFromImageTest-272599248 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:41:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1837340105',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1bef319-f99f-4785-a70c-6ece0fd772c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4b3ad8730dd4f73a3709b2e7317fcda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:41:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:41:26Z,use_quota=True,user_id='126298d1db6841619643104ed41ed819',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:41:27 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-c5313922-4995-43c3-b8cb-66f4da87160b tempest-CreateVolumesFromImageTest-272599248 None] Creating volume e1bef319-f99f-4785-a70c-6ece0fd772c7 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:41:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c5313922-4995-43c3-b8cb-66f4da87160b tempest-CreateVolumesFromImageTest-272599248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c5313922-4995-43c3-b8cb-66f4da87160b tempest-CreateVolumesFromImageTest-272599248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:27 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-c5313922-4995-43c3-b8cb-66f4da87160b tempest-CreateVolumesFromImageTest-272599248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:41:27 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-c5313922-4995-43c3-b8cb-66f4da87160b tempest-CreateVolumesFromImageTest-272599248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:41:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c5313922-4995-43c3-b8cb-66f4da87160b tempest-CreateVolumesFromImageTest-272599248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:27 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-c5313922-4995-43c3-b8cb-66f4da87160b tempest-CreateVolumesFromImageTest-272599248 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:41:27 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-c5313922-4995-43c3-b8cb-66f4da87160b tempest-CreateVolumesFromImageTest-272599248 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:41:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c5313922-4995-43c3-b8cb-66f4da87160b tempest-CreateVolumesFromImageTest-272599248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e1bef319-f99f-4785-a70c-6ece0fd772c7 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0f087881-6c08-4460-b909-4565aeb6d4f4 tempest-CreateVolumesFromImageTest-272599248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9633d4cb-ac03-4e47-a3e7-457375f7e1f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9887f49-d253-4498-9ebf-3b6d77a2de1e', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0f087881-6c08-4460-b909-4565aeb6d4f4 tempest-CreateVolumesFromImageTest-272599248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82f6c687-06b4-4a81-aee1-f05f35ed4376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:27 devstack sudo[104980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e1bef319-f99f-4785-a70c-6ece0fd772c7 1073741824
Jul 14 16:41:28 devstack sudo[104980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:28 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-0f087881-6c08-4460-b909-4565aeb6d4f4 tempest-CreateVolumesFromImageTest-272599248 None] Volume volume-f9887f49-d253-4498-9ebf-3b6d77a2de1e (f9887f49-d253-4498-9ebf-3b6d77a2de1e): created successfully
Jul 14 16:41:28 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0f087881-6c08-4460-b909-4565aeb6d4f4 tempest-CreateVolumesFromImageTest-272599248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82f6c687-06b4-4a81-aee1-f05f35ed4376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:28 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0f087881-6c08-4460-b909-4565aeb6d4f4 tempest-CreateVolumesFromImageTest-272599248 None] Flow 'volume_create_manager' (397401c1-b9e7-470e-8681-de42ee924375) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:41:28 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-0f087881-6c08-4460-b909-4565aeb6d4f4 tempest-CreateVolumesFromImageTest-272599248 None] Created volume successfully.
Jul 14 16:41:28 devstack sudo[104980]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c5313922-4995-43c3-b8cb-66f4da87160b tempest-CreateVolumesFromImageTest-272599248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e1bef319-f99f-4785-a70c-6ece0fd772c7 1073741824" returned: 0 in 0.482s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c5313922-4995-43c3-b8cb-66f4da87160b tempest-CreateVolumesFromImageTest-272599248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e1bef319-f99f-4785-a70c-6ece0fd772c7 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:28 devstack sudo[104986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e1bef319-f99f-4785-a70c-6ece0fd772c7
Jul 14 16:41:28 devstack sudo[104986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:28 devstack sudo[104986]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c5313922-4995-43c3-b8cb-66f4da87160b tempest-CreateVolumesFromImageTest-272599248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e1bef319-f99f-4785-a70c-6ece0fd772c7" returned: 0 in 0.273s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:28 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-c5313922-4995-43c3-b8cb-66f4da87160b tempest-CreateVolumesFromImageTest-272599248 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:41:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c5313922-4995-43c3-b8cb-66f4da87160b tempest-CreateVolumesFromImageTest-272599248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-af56bef5-2708-4457-b9e3-127edf526692 tempest-ProjectReaderTests-1127203843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.502s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:28 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-af56bef5-2708-4457-b9e3-127edf526692 tempest-ProjectReaderTests-1127203843 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1429472720',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dda47ebd-bee2-4bd8-b811-4b02521d5cc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='883944e7bf4f4b4dbc774e64e3e27858',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:41:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:41:27Z,use_quota=True,user_id='edcf2b7f48504051a3973d82e7b0fa86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:41:28 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-af56bef5-2708-4457-b9e3-127edf526692 tempest-ProjectReaderTests-1127203843 None] Creating volume dda47ebd-bee2-4bd8-b811-4b02521d5cc5 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:41:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-af56bef5-2708-4457-b9e3-127edf526692 tempest-ProjectReaderTests-1127203843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-af56bef5-2708-4457-b9e3-127edf526692 tempest-ProjectReaderTests-1127203843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:28 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-af56bef5-2708-4457-b9e3-127edf526692 tempest-ProjectReaderTests-1127203843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:41:28 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-af56bef5-2708-4457-b9e3-127edf526692 tempest-ProjectReaderTests-1127203843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:41:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-af56bef5-2708-4457-b9e3-127edf526692 tempest-ProjectReaderTests-1127203843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:28 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-af56bef5-2708-4457-b9e3-127edf526692 tempest-ProjectReaderTests-1127203843 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:41:28 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-af56bef5-2708-4457-b9e3-127edf526692 tempest-ProjectReaderTests-1127203843 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:41:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-af56bef5-2708-4457-b9e3-127edf526692 tempest-ProjectReaderTests-1127203843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-dda47ebd-bee2-4bd8-b811-4b02521d5cc5 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:28 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c5313922-4995-43c3-b8cb-66f4da87160b tempest-CreateVolumesFromImageTest-272599248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c6d6613-7265-4258-96b8-a908e8b8d1d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1bef319-f99f-4785-a70c-6ece0fd772c7', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:28 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c5313922-4995-43c3-b8cb-66f4da87160b tempest-CreateVolumesFromImageTest-272599248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a85ef310-2cf8-43a9-9838-820ed10b3fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:28 devstack sudo[104989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-dda47ebd-bee2-4bd8-b811-4b02521d5cc5 1073741824
Jul 14 16:41:28 devstack sudo[104989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:28 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-c5313922-4995-43c3-b8cb-66f4da87160b tempest-CreateVolumesFromImageTest-272599248 None] Volume volume-e1bef319-f99f-4785-a70c-6ece0fd772c7 (e1bef319-f99f-4785-a70c-6ece0fd772c7): created successfully
Jul 14 16:41:28 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c5313922-4995-43c3-b8cb-66f4da87160b tempest-CreateVolumesFromImageTest-272599248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a85ef310-2cf8-43a9-9838-820ed10b3fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:28 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c5313922-4995-43c3-b8cb-66f4da87160b tempest-CreateVolumesFromImageTest-272599248 None] Flow 'volume_create_manager' (860277cb-c47b-445a-9a96-8a2498f537ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:41:28 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-c5313922-4995-43c3-b8cb-66f4da87160b tempest-CreateVolumesFromImageTest-272599248 None] Created volume successfully.
Jul 14 16:41:28 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfb9a179-e4b3-4a1b-9a99-75809453f36c tempest-VolumeImageDependencyTests-1226837158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:41:28 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cfb9a179-e4b3-4a1b-9a99-75809453f36c tempest-VolumeImageDependencyTests-1226837158 None] Flow 'volume_create_manager' (6ed522e5-8f3e-4616-af5c-51f7bdbc845b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:41:28 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cfb9a179-e4b3-4a1b-9a99-75809453f36c tempest-VolumeImageDependencyTests-1226837158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abbe6388-ecf0-4db7-9560-4af1c7a60b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cfb9a179-e4b3-4a1b-9a99-75809453f36c tempest-VolumeImageDependencyTests-1226837158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abbe6388-ecf0-4db7-9560-4af1c7a60b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:41:29Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46db7e4d-7cb6-441e-8e93-13d804a99975,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='286d05196c9145c78e310b19929cadbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:41:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:41:29Z,use_quota=True,user_id='c0d9e01082b840e0b1a18552e901326a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cfb9a179-e4b3-4a1b-9a99-75809453f36c tempest-VolumeImageDependencyTests-1226837158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13dfd17a-68cd-4af0-9def-1bf9fe84907d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cfb9a179-e4b3-4a1b-9a99-75809453f36c tempest-VolumeImageDependencyTests-1226837158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13dfd17a-68cd-4af0-9def-1bf9fe84907d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cfb9a179-e4b3-4a1b-9a99-75809453f36c tempest-VolumeImageDependencyTests-1226837158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67cb3c70-5226-4af8-8d37-396771e026a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:29 devstack cinder-volume[87166]: DEBUG cinder.image.glance [None req-cfb9a179-e4b3-4a1b-9a99-75809453f36c tempest-VolumeImageDependencyTests-1226837158 None] Creating Keystone auth plugin from conf {{(pid=87166) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 14 16:41:29 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-db4f8114-b0b6-4d6d-8557-61b6dc978a53 tempest-CreateVolumesFromImageTest-272599248 None] Acquiring lock "cinder-e1bef319-f99f-4785-a70c-6ece0fd772c7-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:41:29 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-db4f8114-b0b6-4d6d-8557-61b6dc978a53 tempest-CreateVolumesFromImageTest-272599248 None] Lock "cinder-e1bef319-f99f-4785-a70c-6ece0fd772c7-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:41:29 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-db4f8114-b0b6-4d6d-8557-61b6dc978a53 tempest-CreateVolumesFromImageTest-272599248 None] Acquiring lock "cinder-quobyte-e1bef319-f99f-4785-a70c-6ece0fd772c7" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:41:29 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-db4f8114-b0b6-4d6d-8557-61b6dc978a53 tempest-CreateVolumesFromImageTest-272599248 None] Lock "cinder-quobyte-e1bef319-f99f-4785-a70c-6ece0fd772c7" acquired by "delete_volume" :: waited 0.019s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:41:29 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc972e4-87f1-4e4b-a446-7f0faf96efd4]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:41:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-db4f8114-b0b6-4d6d-8557-61b6dc978a53 tempest-CreateVolumesFromImageTest-272599248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e1bef319-f99f-4785-a70c-6ece0fd772c7 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:29 devstack sudo[104989]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-af56bef5-2708-4457-b9e3-127edf526692 tempest-ProjectReaderTests-1127203843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-dda47ebd-bee2-4bd8-b811-4b02521d5cc5 1073741824" returned: 0 in 0.660s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-af56bef5-2708-4457-b9e3-127edf526692 tempest-ProjectReaderTests-1127203843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-dda47ebd-bee2-4bd8-b811-4b02521d5cc5 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:29 devstack sudo[104995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e1bef319-f99f-4785-a70c-6ece0fd772c7
Jul 14 16:41:29 devstack sudo[104995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:29 devstack sudo[104997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-dda47ebd-bee2-4bd8-b811-4b02521d5cc5
Jul 14 16:41:29 devstack sudo[104997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cfb9a179-e4b3-4a1b-9a99-75809453f36c tempest-VolumeImageDependencyTests-1226837158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67cb3c70-5226-4af8-8d37-396771e026a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '46db7e4d-7cb6-441e-8e93-13d804a99975', 'volume_name': 'volume-46db7e4d-7cb6-441e-8e93-13d804a99975', 'volume_size': 1, 'image_id': 'c3d674eb-ab89-4e7a-aac7-ef9e6ef74756', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c3d674eb-ab89-4e7a-aac7-ef9e6ef74756', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9333cd536bc8e93b7c95ca1d635c62c9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '286d05196c9145c78e310b19929cadbe', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '31a32528c8bd2e92b9eebc9d08f86e13f2096fa76540f81bf0705c9d35f725b65e001aab8fc27e7b53ec6088f5d92736b27283a49fdf86b69a59eb75495e46c8', 'id': 'c3d674eb-ab89-4e7a-aac7-ef9e6ef74756', 'created_at': datetime.datetime(2026, 7, 14, 14, 41, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 14, 41, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c3d674eb-ab89-4e7a-aac7-ef9e6ef74756/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74f7769a6a50>}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cfb9a179-e4b3-4a1b-9a99-75809453f36c tempest-VolumeImageDependencyTests-1226837158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9875cb9d-89d4-44b2-82e3-0eb36683e87b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cfb9a179-e4b3-4a1b-9a99-75809453f36c tempest-VolumeImageDependencyTests-1226837158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9875cb9d-89d4-44b2-82e3-0eb36683e87b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cfb9a179-e4b3-4a1b-9a99-75809453f36c tempest-VolumeImageDependencyTests-1226837158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c60be4d-54d6-49f3-926f-d4b0921a1e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:29 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-cfb9a179-e4b3-4a1b-9a99-75809453f36c tempest-VolumeImageDependencyTests-1226837158 None] Volume 46db7e4d-7cb6-441e-8e93-13d804a99975: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-46db7e4d-7cb6-441e-8e93-13d804a99975', 'volume_size': 1, 'image_id': 'c3d674eb-ab89-4e7a-aac7-ef9e6ef74756', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c3d674eb-ab89-4e7a-aac7-ef9e6ef74756', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9333cd536bc8e93b7c95ca1d635c62c9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '286d05196c9145c78e310b19929cadbe', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '31a32528c8bd2e92b9eebc9d08f86e13f2096fa76540f81bf0705c9d35f725b65e001aab8fc27e7b53ec6088f5d92736b27283a49fdf86b69a59eb75495e46c8', 'id': 'c3d674eb-ab89-4e7a-aac7-ef9e6ef74756', 'created_at': datetime.datetime(2026, 7, 14, 14, 41, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 14, 41, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c3d674eb-ab89-4e7a-aac7-ef9e6ef74756/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74f7769a6a50>}
Jul 14 16:41:29 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfb9a179-e4b3-4a1b-9a99-75809453f36c tempest-VolumeImageDependencyTests-1226837158 None] Trying to clone 46db7e4d-7cb6-441e-8e93-13d804a99975 from image c3d674eb-ab89-4e7a-aac7-ef9e6ef74756 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c3d674eb-ab89-4e7a-aac7-ef9e6ef74756', 'metadata': {}}]). {{(pid=87166) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 14 16:41:29 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-cfb9a179-e4b3-4a1b-9a99-75809453f36c tempest-VolumeImageDependencyTests-1226837158 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c3d674eb-ab89-4e7a-aac7-ef9e6ef74756_9a33swuadevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87166) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 14 16:41:29 devstack cinder-volume[87166]: INFO cinder.image.image_utils [None req-cfb9a179-e4b3-4a1b-9a99-75809453f36c tempest-VolumeImageDependencyTests-1226837158 None] Image download 0.00 MB at 0.00 MB/s
Jul 14 16:41:29 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b790119-919f-4776-872c-387c5fa56570]: (4, 'raw') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:41:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cfb9a179-e4b3-4a1b-9a99-75809453f36c tempest-VolumeImageDependencyTests-1226837158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c3d674eb-ab89-4e7a-aac7-ef9e6ef74756_9a33swuadevstack@QuobyteHD {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:29 devstack sudo[104997]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-af56bef5-2708-4457-b9e3-127edf526692 tempest-ProjectReaderTests-1127203843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-dda47ebd-bee2-4bd8-b811-4b02521d5cc5" returned: 0 in 0.333s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-af56bef5-2708-4457-b9e3-127edf526692 tempest-ProjectReaderTests-1127203843 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:41:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-af56bef5-2708-4457-b9e3-127edf526692 tempest-ProjectReaderTests-1127203843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:29 devstack sudo[104995]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-db4f8114-b0b6-4d6d-8557-61b6dc978a53 tempest-CreateVolumesFromImageTest-272599248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e1bef319-f99f-4785-a70c-6ece0fd772c7" returned: 0 in 0.516s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-db4f8114-b0b6-4d6d-8557-61b6dc978a53 tempest-CreateVolumesFromImageTest-272599248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e1bef319-f99f-4785-a70c-6ece0fd772c7 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-af56bef5-2708-4457-b9e3-127edf526692 tempest-ProjectReaderTests-1127203843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59e917c0-06ed-453d-8374-c359ace422c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dda47ebd-bee2-4bd8-b811-4b02521d5cc5', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-af56bef5-2708-4457-b9e3-127edf526692 tempest-ProjectReaderTests-1127203843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (711a5276-404d-4f01-a22d-9c56733be156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:29 devstack sudo[105006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e1bef319-f99f-4785-a70c-6ece0fd772c7
Jul 14 16:41:29 devstack sudo[105006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:29 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-af56bef5-2708-4457-b9e3-127edf526692 tempest-ProjectReaderTests-1127203843 None] Volume volume-dda47ebd-bee2-4bd8-b811-4b02521d5cc5 (dda47ebd-bee2-4bd8-b811-4b02521d5cc5): created successfully
Jul 14 16:41:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-af56bef5-2708-4457-b9e3-127edf526692 tempest-ProjectReaderTests-1127203843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (711a5276-404d-4f01-a22d-9c56733be156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-af56bef5-2708-4457-b9e3-127edf526692 tempest-ProjectReaderTests-1127203843 None] Flow 'volume_create_manager' (a347005b-49fb-4296-a39c-1a74ff361b9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:41:29 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-af56bef5-2708-4457-b9e3-127edf526692 tempest-ProjectReaderTests-1127203843 None] Created volume successfully.
Jul 14 16:41:29 devstack sudo[105005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c3d674eb-ab89-4e7a-aac7-ef9e6ef74756_9a33swuadevstack@QuobyteHD
Jul 14 16:41:29 devstack sudo[105005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:30 devstack sudo[105006]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-db4f8114-b0b6-4d6d-8557-61b6dc978a53 tempest-CreateVolumesFromImageTest-272599248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e1bef319-f99f-4785-a70c-6ece0fd772c7" returned: 0 in 0.305s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:30 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-db4f8114-b0b6-4d6d-8557-61b6dc978a53 tempest-CreateVolumesFromImageTest-272599248 None] Lock "cinder-quobyte-e1bef319-f99f-4785-a70c-6ece0fd772c7" released by "delete_volume" :: held 0.877s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:41:30 devstack sudo[105005]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cfb9a179-e4b3-4a1b-9a99-75809453f36c tempest-VolumeImageDependencyTests-1226837158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c3d674eb-ab89-4e7a-aac7-ef9e6ef74756_9a33swuadevstack@QuobyteHD" returned: 0 in 0.396s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cfb9a179-e4b3-4a1b-9a99-75809453f36c tempest-VolumeImageDependencyTests-1226837158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c3d674eb-ab89-4e7a-aac7-ef9e6ef74756_9a33swuadevstack@QuobyteHD {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:30 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-db4f8114-b0b6-4d6d-8557-61b6dc978a53 tempest-CreateVolumesFromImageTest-272599248 None] Created reservations ['4342ab5c-e255-4b88-a054-f753e2004a06', '0d20433d-99df-4132-8a82-7d9765640065', '1c322546-5fe8-4982-98a2-1c58b56adbd7', '69dcd170-2b7b-4d1e-95fa-4e838782ace7'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:41:30 devstack sudo[105012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c3d674eb-ab89-4e7a-aac7-ef9e6ef74756_9a33swuadevstack@QuobyteHD
Jul 14 16:41:30 devstack sudo[105012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-db4f8114-b0b6-4d6d-8557-61b6dc978a53 tempest-CreateVolumesFromImageTest-272599248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-db4f8114-b0b6-4d6d-8557-61b6dc978a53 tempest-CreateVolumesFromImageTest-272599248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:30 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-db4f8114-b0b6-4d6d-8557-61b6dc978a53 tempest-CreateVolumesFromImageTest-272599248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:41:30 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-db4f8114-b0b6-4d6d-8557-61b6dc978a53 tempest-CreateVolumesFromImageTest-272599248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:41:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-db4f8114-b0b6-4d6d-8557-61b6dc978a53 tempest-CreateVolumesFromImageTest-272599248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-db4f8114-b0b6-4d6d-8557-61b6dc978a53 tempest-CreateVolumesFromImageTest-272599248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:30 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-1564faed-5e3f-4a8b-bb45-85aaff6b4cbb tempest-CreateVolumesFromImageTest-272599248 None] Acquiring lock "cinder-f9887f49-d253-4498-9ebf-3b6d77a2de1e-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:41:30 devstack sudo[105014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:41:30 devstack sudo[105014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:30 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-1564faed-5e3f-4a8b-bb45-85aaff6b4cbb tempest-CreateVolumesFromImageTest-272599248 None] Lock "cinder-f9887f49-d253-4498-9ebf-3b6d77a2de1e-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:41:30 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-1564faed-5e3f-4a8b-bb45-85aaff6b4cbb tempest-CreateVolumesFromImageTest-272599248 None] Acquiring lock "cinder-quobyte-f9887f49-d253-4498-9ebf-3b6d77a2de1e" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:41:30 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-1564faed-5e3f-4a8b-bb45-85aaff6b4cbb tempest-CreateVolumesFromImageTest-272599248 None] Lock "cinder-quobyte-f9887f49-d253-4498-9ebf-3b6d77a2de1e" acquired by "delete_volume" :: waited 0.023s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:41:30 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ebe6209-8aef-4359-92d0-2c499cd18f75]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:41:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1564faed-5e3f-4a8b-bb45-85aaff6b4cbb tempest-CreateVolumesFromImageTest-272599248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f9887f49-d253-4498-9ebf-3b6d77a2de1e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:30 devstack sudo[105012]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cfb9a179-e4b3-4a1b-9a99-75809453f36c tempest-VolumeImageDependencyTests-1226837158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c3d674eb-ab89-4e7a-aac7-ef9e6ef74756_9a33swuadevstack@QuobyteHD" returned: 1 in 0.462s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cfb9a179-e4b3-4a1b-9a99-75809453f36c tempest-VolumeImageDependencyTests-1226837158 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c3d674eb-ab89-4e7a-aac7-ef9e6ef74756_9a33swuadevstack@QuobyteHD' failed. Not Retrying. {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 16:41:30 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-cfb9a179-e4b3-4a1b-9a99-75809453f36c tempest-VolumeImageDependencyTests-1226837158 None] Temporary image c3d674eb-ab89-4e7a-aac7-ef9e6ef74756 is fetched for user c0d9e01082b840e0b1a18552e901326a. {{(pid=87166) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 14 16:41:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f2f44037-bd16-44db-a732-b5270e2ae257 tempest-ProjectReaderTests-1127203843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f2f44037-bd16-44db-a732-b5270e2ae257 tempest-ProjectReaderTests-1127203843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:30 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-f2f44037-bd16-44db-a732-b5270e2ae257 tempest-ProjectReaderTests-1127203843 None] Creating offline snapshot ead19762-ce50-42b4-a653-1cb7274676d3 of volume dda47ebd-bee2-4bd8-b811-4b02521d5cc5 {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 16:41:30 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb9f3ac-0df2-44e7-be68-5da9ded88ec1]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:41:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f2f44037-bd16-44db-a732-b5270e2ae257 tempest-ProjectReaderTests-1127203843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-dda47ebd-bee2-4bd8-b811-4b02521d5cc5 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:30 devstack sudo[105014]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-db4f8114-b0b6-4d6d-8557-61b6dc978a53 tempest-CreateVolumesFromImageTest-272599248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.399s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:30 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-db4f8114-b0b6-4d6d-8557-61b6dc978a53 tempest-CreateVolumesFromImageTest-272599248 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:41:30 devstack sudo[105019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f9887f49-d253-4498-9ebf-3b6d77a2de1e
Jul 14 16:41:30 devstack sudo[105019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:30 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-db4f8114-b0b6-4d6d-8557-61b6dc978a53 tempest-CreateVolumesFromImageTest-272599248 None] Deleted volume successfully.
Jul 14 16:41:30 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac43673-0e83-4df1-afd4-0ccb8a3ac0d9]: (4, 'raw') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:41:30 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-db4f8114-b0b6-4d6d-8557-61b6dc978a53 tempest-CreateVolumesFromImageTest-272599248 None] Lock "cinder-e1bef319-f99f-4785-a70c-6ece0fd772c7-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:41:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cfb9a179-e4b3-4a1b-9a99-75809453f36c tempest-VolumeImageDependencyTests-1226837158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c3d674eb-ab89-4e7a-aac7-ef9e6ef74756_9a33swuadevstack@QuobyteHD {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:30 devstack sudo[105021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-dda47ebd-bee2-4bd8-b811-4b02521d5cc5
Jul 14 16:41:30 devstack sudo[105021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:30 devstack sudo[105023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c3d674eb-ab89-4e7a-aac7-ef9e6ef74756_9a33swuadevstack@QuobyteHD
Jul 14 16:41:30 devstack sudo[105023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:31 devstack sudo[105019]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1564faed-5e3f-4a8b-bb45-85aaff6b4cbb tempest-CreateVolumesFromImageTest-272599248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f9887f49-d253-4498-9ebf-3b6d77a2de1e" returned: 0 in 0.462s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1564faed-5e3f-4a8b-bb45-85aaff6b4cbb tempest-CreateVolumesFromImageTest-272599248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f9887f49-d253-4498-9ebf-3b6d77a2de1e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:31 devstack sudo[105029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f9887f49-d253-4498-9ebf-3b6d77a2de1e
Jul 14 16:41:31 devstack sudo[105029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:31 devstack sudo[105023]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cfb9a179-e4b3-4a1b-9a99-75809453f36c tempest-VolumeImageDependencyTests-1226837158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c3d674eb-ab89-4e7a-aac7-ef9e6ef74756_9a33swuadevstack@QuobyteHD" returned: 0 in 0.393s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cfb9a179-e4b3-4a1b-9a99-75809453f36c tempest-VolumeImageDependencyTests-1226837158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c3d674eb-ab89-4e7a-aac7-ef9e6ef74756_9a33swuadevstack@QuobyteHD {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:31 devstack sudo[105021]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f2f44037-bd16-44db-a732-b5270e2ae257 tempest-ProjectReaderTests-1127203843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-dda47ebd-bee2-4bd8-b811-4b02521d5cc5" returned: 0 in 0.489s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f2f44037-bd16-44db-a732-b5270e2ae257 tempest-ProjectReaderTests-1127203843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-dda47ebd-bee2-4bd8-b811-4b02521d5cc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-dda47ebd-bee2-4bd8-b811-4b02521d5cc5.ead19762-ce50-42b4-a653-1cb7274676d3 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:31 devstack sudo[105037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-dda47ebd-bee2-4bd8-b811-4b02521d5cc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-dda47ebd-bee2-4bd8-b811-4b02521d5cc5.ead19762-ce50-42b4-a653-1cb7274676d3 1G
Jul 14 16:41:31 devstack sudo[105037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:31 devstack sudo[105036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c3d674eb-ab89-4e7a-aac7-ef9e6ef74756_9a33swuadevstack@QuobyteHD
Jul 14 16:41:31 devstack sudo[105036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:31 devstack sudo[105029]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1564faed-5e3f-4a8b-bb45-85aaff6b4cbb tempest-CreateVolumesFromImageTest-272599248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-f9887f49-d253-4498-9ebf-3b6d77a2de1e" returned: 0 in 0.326s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:31 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-1564faed-5e3f-4a8b-bb45-85aaff6b4cbb tempest-CreateVolumesFromImageTest-272599248 None] Lock "cinder-quobyte-f9887f49-d253-4498-9ebf-3b6d77a2de1e" released by "delete_volume" :: held 0.847s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:41:31 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-1564faed-5e3f-4a8b-bb45-85aaff6b4cbb tempest-CreateVolumesFromImageTest-272599248 None] Created reservations ['622303d5-7643-4d6b-835b-e0617ef6ed56', '16d44055-bc92-4540-bce5-641d71dd54c7', 'ffb09d96-c7fd-4e26-840b-d4e4a475e836', '01f2c3ef-9fc2-49cd-8508-726d531591b9'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:41:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1564faed-5e3f-4a8b-bb45-85aaff6b4cbb tempest-CreateVolumesFromImageTest-272599248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1564faed-5e3f-4a8b-bb45-85aaff6b4cbb tempest-CreateVolumesFromImageTest-272599248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:31 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-1564faed-5e3f-4a8b-bb45-85aaff6b4cbb tempest-CreateVolumesFromImageTest-272599248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:41:31 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-1564faed-5e3f-4a8b-bb45-85aaff6b4cbb tempest-CreateVolumesFromImageTest-272599248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:41:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1564faed-5e3f-4a8b-bb45-85aaff6b4cbb tempest-CreateVolumesFromImageTest-272599248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1564faed-5e3f-4a8b-bb45-85aaff6b4cbb tempest-CreateVolumesFromImageTest-272599248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:31 devstack sudo[105036]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cfb9a179-e4b3-4a1b-9a99-75809453f36c tempest-VolumeImageDependencyTests-1226837158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c3d674eb-ab89-4e7a-aac7-ef9e6ef74756_9a33swuadevstack@QuobyteHD" returned: 1 in 0.408s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cfb9a179-e4b3-4a1b-9a99-75809453f36c tempest-VolumeImageDependencyTests-1226837158 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c3d674eb-ab89-4e7a-aac7-ef9e6ef74756_9a33swuadevstack@QuobyteHD' failed. Not Retrying. {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 16:41:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cfb9a179-e4b3-4a1b-9a99-75809453f36c tempest-VolumeImageDependencyTests-1226837158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:31 devstack sudo[105047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:41:31 devstack sudo[105047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:31 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3ee5e883-992e-48d4-a65a-91195783fbd9 tempest-CreateVolumesFromImageTest-272599248 None] Acquiring lock "cinder-cc4cecee-834b-4b4e-adef-09fe4d6ae9e9-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:41:31 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3ee5e883-992e-48d4-a65a-91195783fbd9 tempest-CreateVolumesFromImageTest-272599248 None] Lock "cinder-cc4cecee-834b-4b4e-adef-09fe4d6ae9e9-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:41:31 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3ee5e883-992e-48d4-a65a-91195783fbd9 tempest-CreateVolumesFromImageTest-272599248 None] Acquiring lock "cinder-quobyte-cc4cecee-834b-4b4e-adef-09fe4d6ae9e9" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:41:31 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3ee5e883-992e-48d4-a65a-91195783fbd9 tempest-CreateVolumesFromImageTest-272599248 None] Lock "cinder-quobyte-cc4cecee-834b-4b4e-adef-09fe4d6ae9e9" acquired by "delete_volume" :: waited 0.024s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:41:31 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0ca958-a198-466c-8f5f-dbdec1578db6]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:41:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3ee5e883-992e-48d4-a65a-91195783fbd9 tempest-CreateVolumesFromImageTest-272599248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cc4cecee-834b-4b4e-adef-09fe4d6ae9e9 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:31 devstack sudo[105037]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f2f44037-bd16-44db-a732-b5270e2ae257 tempest-ProjectReaderTests-1127203843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-dda47ebd-bee2-4bd8-b811-4b02521d5cc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-dda47ebd-bee2-4bd8-b811-4b02521d5cc5.ead19762-ce50-42b4-a653-1cb7274676d3 1G" returned: 0 in 0.624s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f2f44037-bd16-44db-a732-b5270e2ae257 tempest-ProjectReaderTests-1127203843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dda47ebd-bee2-4bd8-b811-4b02521d5cc5 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-dda47ebd-bee2-4bd8-b811-4b02521d5cc5.ead19762-ce50-42b4-a653-1cb7274676d3 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:31 devstack sudo[105051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dda47ebd-bee2-4bd8-b811-4b02521d5cc5 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-dda47ebd-bee2-4bd8-b811-4b02521d5cc5.ead19762-ce50-42b4-a653-1cb7274676d3
Jul 14 16:41:31 devstack sudo[105051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:31 devstack sudo[105047]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1564faed-5e3f-4a8b-bb45-85aaff6b4cbb tempest-CreateVolumesFromImageTest-272599248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.332s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:31 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-1564faed-5e3f-4a8b-bb45-85aaff6b4cbb tempest-CreateVolumesFromImageTest-272599248 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:41:31 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-1564faed-5e3f-4a8b-bb45-85aaff6b4cbb tempest-CreateVolumesFromImageTest-272599248 None] Deleted volume successfully.
Jul 14 16:41:32 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-1564faed-5e3f-4a8b-bb45-85aaff6b4cbb tempest-CreateVolumesFromImageTest-272599248 None] Lock "cinder-f9887f49-d253-4498-9ebf-3b6d77a2de1e-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:41:32 devstack sudo[105050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cc4cecee-834b-4b4e-adef-09fe4d6ae9e9
Jul 14 16:41:32 devstack sudo[105050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:32 devstack sudo[105051]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f2f44037-bd16-44db-a732-b5270e2ae257 tempest-ProjectReaderTests-1127203843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dda47ebd-bee2-4bd8-b811-4b02521d5cc5 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-dda47ebd-bee2-4bd8-b811-4b02521d5cc5.ead19762-ce50-42b4-a653-1cb7274676d3" returned: 0 in 0.355s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:32 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-f2f44037-bd16-44db-a732-b5270e2ae257 tempest-ProjectReaderTests-1127203843 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-dda47ebd-bee2-4bd8-b811-4b02521d5cc5.ead19762-ce50-42b4-a653-1cb7274676d3 is being set with open permissions: ugo+rw
Jul 14 16:41:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f2f44037-bd16-44db-a732-b5270e2ae257 tempest-ProjectReaderTests-1127203843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-dda47ebd-bee2-4bd8-b811-4b02521d5cc5.ead19762-ce50-42b4-a653-1cb7274676d3 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:32 devstack sudo[105058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-dda47ebd-bee2-4bd8-b811-4b02521d5cc5.ead19762-ce50-42b4-a653-1cb7274676d3
Jul 14 16:41:32 devstack sudo[105058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:32 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-52c9524f-38be-40a9-a189-668beab2329c tempest-CinderUnicodeTest-300502851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:41:32 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-52c9524f-38be-40a9-a189-668beab2329c tempest-CinderUnicodeTest-300502851 None] Flow 'volume_create_manager' (5951bebb-ad46-4535-b678-02c99c4c1451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:41:32 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-52c9524f-38be-40a9-a189-668beab2329c tempest-CinderUnicodeTest-300502851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c812552-be4e-44aa-8b47-413f0970b841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:32 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-52c9524f-38be-40a9-a189-668beab2329c tempest-CinderUnicodeTest-300502851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c812552-be4e-44aa-8b47-413f0970b841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:41:32Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c49a25f1-074e-4e84-a3a7-a5c1ffb45cba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c23ceb683e7b40e0a5de0516a4a8b83e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:41:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:41:32Z,use_quota=True,user_id='8877bee722054d1391e35c37dadd6577',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:32 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-52c9524f-38be-40a9-a189-668beab2329c tempest-CinderUnicodeTest-300502851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (970a1dd3-52e7-4674-82f7-58277cdb4f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:32 devstack sudo[105050]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:32 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-52c9524f-38be-40a9-a189-668beab2329c tempest-CinderUnicodeTest-300502851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (970a1dd3-52e7-4674-82f7-58277cdb4f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:32 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-52c9524f-38be-40a9-a189-668beab2329c tempest-CinderUnicodeTest-300502851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e48be10-f8f8-46ff-8c18-baadf16da273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:32 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-52c9524f-38be-40a9-a189-668beab2329c tempest-CinderUnicodeTest-300502851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e48be10-f8f8-46ff-8c18-baadf16da273) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c49a25f1-074e-4e84-a3a7-a5c1ffb45cba', 'volume_name': 'volume-c49a25f1-074e-4e84-a3a7-a5c1ffb45cba', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:32 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-52c9524f-38be-40a9-a189-668beab2329c tempest-CinderUnicodeTest-300502851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2ba8793-7bee-4d0c-800e-383ab9637bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:32 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-52c9524f-38be-40a9-a189-668beab2329c tempest-CinderUnicodeTest-300502851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2ba8793-7bee-4d0c-800e-383ab9637bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:32 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-52c9524f-38be-40a9-a189-668beab2329c tempest-CinderUnicodeTest-300502851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cacfdd35-56d7-4020-9b06-3f12c1d6e032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:32 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-52c9524f-38be-40a9-a189-668beab2329c tempest-CinderUnicodeTest-300502851 None] Volume c49a25f1-074e-4e84-a3a7-a5c1ffb45cba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c49a25f1-074e-4e84-a3a7-a5c1ffb45cba', 'volume_size': 1}
Jul 14 16:41:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-52c9524f-38be-40a9-a189-668beab2329c tempest-CinderUnicodeTest-300502851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3ee5e883-992e-48d4-a65a-91195783fbd9 tempest-CreateVolumesFromImageTest-272599248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cc4cecee-834b-4b4e-adef-09fe4d6ae9e9" returned: 0 in 0.521s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3ee5e883-992e-48d4-a65a-91195783fbd9 tempest-CreateVolumesFromImageTest-272599248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cc4cecee-834b-4b4e-adef-09fe4d6ae9e9 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:32 devstack sudo[105063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cc4cecee-834b-4b4e-adef-09fe4d6ae9e9
Jul 14 16:41:32 devstack sudo[105063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:32 devstack sudo[105058]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f2f44037-bd16-44db-a732-b5270e2ae257 tempest-ProjectReaderTests-1127203843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-dda47ebd-bee2-4bd8-b811-4b02521d5cc5.ead19762-ce50-42b4-a653-1cb7274676d3" returned: 0 in 0.256s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f2f44037-bd16-44db-a732-b5270e2ae257 tempest-ProjectReaderTests-1127203843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-dda47ebd-bee2-4bd8-b811-4b02521d5cc5.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:32 devstack sudo[105066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-dda47ebd-bee2-4bd8-b811-4b02521d5cc5.info
Jul 14 16:41:32 devstack sudo[105066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:32 devstack sudo[105063]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3ee5e883-992e-48d4-a65a-91195783fbd9 tempest-CreateVolumesFromImageTest-272599248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-cc4cecee-834b-4b4e-adef-09fe4d6ae9e9" returned: 0 in 0.266s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:32 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3ee5e883-992e-48d4-a65a-91195783fbd9 tempest-CreateVolumesFromImageTest-272599248 None] Lock "cinder-quobyte-cc4cecee-834b-4b4e-adef-09fe4d6ae9e9" released by "delete_volume" :: held 0.840s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:41:32 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-3ee5e883-992e-48d4-a65a-91195783fbd9 tempest-CreateVolumesFromImageTest-272599248 None] Created reservations ['584127ae-2302-44f0-8e7b-c7ea7fb8492f', '52fafde2-8c50-405c-b0fb-038dd8a68360', '084a3923-fac8-4fac-bdd2-1d192d4ca5e3', '8384be30-11e1-4e7b-8125-5e0d58385b9b'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:41:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3ee5e883-992e-48d4-a65a-91195783fbd9 tempest-CreateVolumesFromImageTest-272599248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3ee5e883-992e-48d4-a65a-91195783fbd9 tempest-CreateVolumesFromImageTest-272599248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:32 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-3ee5e883-992e-48d4-a65a-91195783fbd9 tempest-CreateVolumesFromImageTest-272599248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:41:32 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-3ee5e883-992e-48d4-a65a-91195783fbd9 tempest-CreateVolumesFromImageTest-272599248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:41:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3ee5e883-992e-48d4-a65a-91195783fbd9 tempest-CreateVolumesFromImageTest-272599248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3ee5e883-992e-48d4-a65a-91195783fbd9 tempest-CreateVolumesFromImageTest-272599248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:32 devstack sudo[105066]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f2f44037-bd16-44db-a732-b5270e2ae257 tempest-ProjectReaderTests-1127203843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-dda47ebd-bee2-4bd8-b811-4b02521d5cc5.info" returned: 0 in 0.275s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:32 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-f2f44037-bd16-44db-a732-b5270e2ae257 tempest-ProjectReaderTests-1127203843 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-dda47ebd-bee2-4bd8-b811-4b02521d5cc5.info is being set with open permissions: ugo+rw
Jul 14 16:41:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f2f44037-bd16-44db-a732-b5270e2ae257 tempest-ProjectReaderTests-1127203843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-dda47ebd-bee2-4bd8-b811-4b02521d5cc5.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:32 devstack sudo[105070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:41:32 devstack sudo[105070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:32 devstack sudo[105071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-dda47ebd-bee2-4bd8-b811-4b02521d5cc5.info
Jul 14 16:41:32 devstack sudo[105071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:32 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f5153b16-fdbe-4908-80e3-f155e18e17f4 tempest-CreateVolumesFromImageTest-272599248 None] Acquiring lock "cinder-b2079d13-2a96-471d-98a9-44bcf44e5b73-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:41:32 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f5153b16-fdbe-4908-80e3-f155e18e17f4 tempest-CreateVolumesFromImageTest-272599248 None] Lock "cinder-b2079d13-2a96-471d-98a9-44bcf44e5b73-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:41:33 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f5153b16-fdbe-4908-80e3-f155e18e17f4 tempest-CreateVolumesFromImageTest-272599248 None] Acquiring lock "cinder-quobyte-b2079d13-2a96-471d-98a9-44bcf44e5b73" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:41:33 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f5153b16-fdbe-4908-80e3-f155e18e17f4 tempest-CreateVolumesFromImageTest-272599248 None] Lock "cinder-quobyte-b2079d13-2a96-471d-98a9-44bcf44e5b73" acquired by "delete_volume" :: waited 0.022s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:41:33 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[da6a1cfd-4f31-4495-a2a3-d095a4883375]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:41:33 devstack sudo[105070]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f5153b16-fdbe-4908-80e3-f155e18e17f4 tempest-CreateVolumesFromImageTest-272599248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b2079d13-2a96-471d-98a9-44bcf44e5b73 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:33 devstack sudo[105071]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3ee5e883-992e-48d4-a65a-91195783fbd9 tempest-CreateVolumesFromImageTest-272599248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.308s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:33 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-3ee5e883-992e-48d4-a65a-91195783fbd9 tempest-CreateVolumesFromImageTest-272599248 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:41:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f2f44037-bd16-44db-a732-b5270e2ae257 tempest-ProjectReaderTests-1127203843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-dda47ebd-bee2-4bd8-b811-4b02521d5cc5.info" returned: 0 in 0.300s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f2f44037-bd16-44db-a732-b5270e2ae257 tempest-ProjectReaderTests-1127203843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.419s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cfb9a179-e4b3-4a1b-9a99-75809453f36c tempest-VolumeImageDependencyTests-1226837158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.473s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:33 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-cfb9a179-e4b3-4a1b-9a99-75809453f36c tempest-VolumeImageDependencyTests-1226837158 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:41:29Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46db7e4d-7cb6-441e-8e93-13d804a99975,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='286d05196c9145c78e310b19929cadbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:41:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:41:29Z,use_quota=True,user_id='c0d9e01082b840e0b1a18552e901326a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:41:33 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-cfb9a179-e4b3-4a1b-9a99-75809453f36c tempest-VolumeImageDependencyTests-1226837158 None] Creating volume 46db7e4d-7cb6-441e-8e93-13d804a99975 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:41:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cfb9a179-e4b3-4a1b-9a99-75809453f36c tempest-VolumeImageDependencyTests-1226837158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cfb9a179-e4b3-4a1b-9a99-75809453f36c tempest-VolumeImageDependencyTests-1226837158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:33 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-cfb9a179-e4b3-4a1b-9a99-75809453f36c tempest-VolumeImageDependencyTests-1226837158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:41:33 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-cfb9a179-e4b3-4a1b-9a99-75809453f36c tempest-VolumeImageDependencyTests-1226837158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:41:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cfb9a179-e4b3-4a1b-9a99-75809453f36c tempest-VolumeImageDependencyTests-1226837158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:33 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-cfb9a179-e4b3-4a1b-9a99-75809453f36c tempest-VolumeImageDependencyTests-1226837158 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:41:33 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-cfb9a179-e4b3-4a1b-9a99-75809453f36c tempest-VolumeImageDependencyTests-1226837158 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:41:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cfb9a179-e4b3-4a1b-9a99-75809453f36c tempest-VolumeImageDependencyTests-1226837158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-46db7e4d-7cb6-441e-8e93-13d804a99975 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:33 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-3ee5e883-992e-48d4-a65a-91195783fbd9 tempest-CreateVolumesFromImageTest-272599248 None] Deleted volume successfully.
Jul 14 16:41:33 devstack sudo[105077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-46db7e4d-7cb6-441e-8e93-13d804a99975 1073741824
Jul 14 16:41:33 devstack sudo[105077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:33 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3ee5e883-992e-48d4-a65a-91195783fbd9 tempest-CreateVolumesFromImageTest-272599248 None] Lock "cinder-cc4cecee-834b-4b4e-adef-09fe4d6ae9e9-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:41:33 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-f2f44037-bd16-44db-a732-b5270e2ae257 tempest-ProjectReaderTests-1127203843 None] Create snapshot completed successfully
Jul 14 16:41:33 devstack sudo[105076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b2079d13-2a96-471d-98a9-44bcf44e5b73
Jul 14 16:41:33 devstack sudo[105076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:33 devstack sudo[105076]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f5153b16-fdbe-4908-80e3-f155e18e17f4 tempest-CreateVolumesFromImageTest-272599248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b2079d13-2a96-471d-98a9-44bcf44e5b73" returned: 0 in 0.418s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f5153b16-fdbe-4908-80e3-f155e18e17f4 tempest-CreateVolumesFromImageTest-272599248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b2079d13-2a96-471d-98a9-44bcf44e5b73 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:33 devstack sudo[105086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b2079d13-2a96-471d-98a9-44bcf44e5b73
Jul 14 16:41:33 devstack sudo[105086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:33 devstack sudo[105077]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cfb9a179-e4b3-4a1b-9a99-75809453f36c tempest-VolumeImageDependencyTests-1226837158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-46db7e4d-7cb6-441e-8e93-13d804a99975 1073741824" returned: 0 in 0.457s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cfb9a179-e4b3-4a1b-9a99-75809453f36c tempest-VolumeImageDependencyTests-1226837158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-46db7e4d-7cb6-441e-8e93-13d804a99975 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:33 devstack sudo[105089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-46db7e4d-7cb6-441e-8e93-13d804a99975
Jul 14 16:41:33 devstack sudo[105089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:33 devstack sudo[105086]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f5153b16-fdbe-4908-80e3-f155e18e17f4 tempest-CreateVolumesFromImageTest-272599248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-b2079d13-2a96-471d-98a9-44bcf44e5b73" returned: 0 in 0.264s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:33 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f5153b16-fdbe-4908-80e3-f155e18e17f4 tempest-CreateVolumesFromImageTest-272599248 None] Lock "cinder-quobyte-b2079d13-2a96-471d-98a9-44bcf44e5b73" released by "delete_volume" :: held 0.738s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:41:33 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-f5153b16-fdbe-4908-80e3-f155e18e17f4 tempest-CreateVolumesFromImageTest-272599248 None] Created reservations ['63a4367d-fd32-4938-9b95-b6d51cfcd706', 'd2af3964-2023-44ba-9514-85778a574404', '75a903df-970b-4557-96f1-93c9347e43ba', 'e646a03e-97ca-4271-9f79-197d93d8871a'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:41:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f5153b16-fdbe-4908-80e3-f155e18e17f4 tempest-CreateVolumesFromImageTest-272599248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f5153b16-fdbe-4908-80e3-f155e18e17f4 tempest-CreateVolumesFromImageTest-272599248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:33 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f5153b16-fdbe-4908-80e3-f155e18e17f4 tempest-CreateVolumesFromImageTest-272599248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:41:33 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f5153b16-fdbe-4908-80e3-f155e18e17f4 tempest-CreateVolumesFromImageTest-272599248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:41:33 devstack sudo[105089]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f5153b16-fdbe-4908-80e3-f155e18e17f4 tempest-CreateVolumesFromImageTest-272599248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f5153b16-fdbe-4908-80e3-f155e18e17f4 tempest-CreateVolumesFromImageTest-272599248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cfb9a179-e4b3-4a1b-9a99-75809453f36c tempest-VolumeImageDependencyTests-1226837158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-46db7e4d-7cb6-441e-8e93-13d804a99975" returned: 0 in 0.281s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:33 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-cfb9a179-e4b3-4a1b-9a99-75809453f36c tempest-VolumeImageDependencyTests-1226837158 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:41:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cfb9a179-e4b3-4a1b-9a99-75809453f36c tempest-VolumeImageDependencyTests-1226837158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-52c9524f-38be-40a9-a189-668beab2329c tempest-CinderUnicodeTest-300502851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.564s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:33 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-52c9524f-38be-40a9-a189-668beab2329c tempest-CinderUnicodeTest-300502851 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:41:32Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c49a25f1-074e-4e84-a3a7-a5c1ffb45cba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c23ceb683e7b40e0a5de0516a4a8b83e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:41:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:41:32Z,use_quota=True,user_id='8877bee722054d1391e35c37dadd6577',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:41:33 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-52c9524f-38be-40a9-a189-668beab2329c tempest-CinderUnicodeTest-300502851 None] Creating volume c49a25f1-074e-4e84-a3a7-a5c1ffb45cba {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:41:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-52c9524f-38be-40a9-a189-668beab2329c tempest-CinderUnicodeTest-300502851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-52c9524f-38be-40a9-a189-668beab2329c tempest-CinderUnicodeTest-300502851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:33 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-52c9524f-38be-40a9-a189-668beab2329c tempest-CinderUnicodeTest-300502851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:41:33 devstack sudo[105094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:41:33 devstack sudo[105094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:33 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-52c9524f-38be-40a9-a189-668beab2329c tempest-CinderUnicodeTest-300502851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:41:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-52c9524f-38be-40a9-a189-668beab2329c tempest-CinderUnicodeTest-300502851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:33 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-52c9524f-38be-40a9-a189-668beab2329c tempest-CinderUnicodeTest-300502851 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:41:33 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-52c9524f-38be-40a9-a189-668beab2329c tempest-CinderUnicodeTest-300502851 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:41:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-52c9524f-38be-40a9-a189-668beab2329c tempest-CinderUnicodeTest-300502851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c49a25f1-074e-4e84-a3a7-a5c1ffb45cba 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:33 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-1c745135-77c6-4cb4-ba02-a2ca30756090 tempest-ProjectReaderTests-1127203843 None] Acquiring lock "cinder-ead19762-ce50-42b4-a653-1cb7274676d3-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:41:33 devstack sudo[105096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c49a25f1-074e-4e84-a3a7-a5c1ffb45cba 1073741824
Jul 14 16:41:33 devstack sudo[105096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:33 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-1c745135-77c6-4cb4-ba02-a2ca30756090 tempest-ProjectReaderTests-1127203843 None] Lock "cinder-ead19762-ce50-42b4-a653-1cb7274676d3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:41:33 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-1c745135-77c6-4cb4-ba02-a2ca30756090 tempest-ProjectReaderTests-1127203843 None] Acquiring lock "cinder-quobyte-dda47ebd-bee2-4bd8-b811-4b02521d5cc5" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:41:34 devstack cinder-volume[87166]: DEBUG cinder.volume.volume_utils [None req-cfb9a179-e4b3-4a1b-9a99-75809453f36c tempest-VolumeImageDependencyTests-1226837158 None] Attempting download of c3d674eb-ab89-4e7a-aac7-ef9e6ef74756 ((None, [{'url': 'file:///opt/stack/data/glance/images/c3d674eb-ab89-4e7a-aac7-ef9e6ef74756', 'metadata': {}}])) to volume 46db7e4d-7cb6-441e-8e93-13d804a99975. {{(pid=87166) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 14 16:41:34 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-1c745135-77c6-4cb4-ba02-a2ca30756090 tempest-ProjectReaderTests-1127203843 None] Lock "cinder-quobyte-dda47ebd-bee2-4bd8-b811-4b02521d5cc5" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:41:34 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-1c745135-77c6-4cb4-ba02-a2ca30756090 tempest-ProjectReaderTests-1127203843 None] Acquiring lock "cinder-quobyte-ead19762-ce50-42b4-a653-1cb7274676d3" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:41:34 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-1c745135-77c6-4cb4-ba02-a2ca30756090 tempest-ProjectReaderTests-1127203843 None] Lock "cinder-quobyte-ead19762-ce50-42b4-a653-1cb7274676d3" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:41:34 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-1c745135-77c6-4cb4-ba02-a2ca30756090 tempest-ProjectReaderTests-1127203843 None] Deleting offline snapshot ead19762-ce50-42b4-a653-1cb7274676d3 of volume dda47ebd-bee2-4bd8-b811-4b02521d5cc5 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 16:41:34 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-1c745135-77c6-4cb4-ba02-a2ca30756090 tempest-ProjectReaderTests-1127203843 None] snapshot_file for this snap is: volume-dda47ebd-bee2-4bd8-b811-4b02521d5cc5.ead19762-ce50-42b4-a653-1cb7274676d3 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 16:41:34 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c10f074-2b9b-41d1-b431-922752a746a3]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:41:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1c745135-77c6-4cb4-ba02-a2ca30756090 tempest-ProjectReaderTests-1127203843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-dda47ebd-bee2-4bd8-b811-4b02521d5cc5.ead19762-ce50-42b4-a653-1cb7274676d3 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:34 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4fa5ca-10f8-4fa7-ab88-6cf95996aad5]: (4, 'raw') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:41:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cfb9a179-e4b3-4a1b-9a99-75809453f36c tempest-VolumeImageDependencyTests-1226837158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c3d674eb-ab89-4e7a-aac7-ef9e6ef74756_fhuekaiw {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:34 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d28e6a4d-2df7-4518-9849-20d8aae5bcff tempest-CreateVolumesFromImageTest-272599248 None] Acquiring lock "cinder-53c36f02-0f36-42f7-a0e5-9383bc778540-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:41:34 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d28e6a4d-2df7-4518-9849-20d8aae5bcff tempest-CreateVolumesFromImageTest-272599248 None] Lock "cinder-53c36f02-0f36-42f7-a0e5-9383bc778540-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:41:34 devstack sudo[105094]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f5153b16-fdbe-4908-80e3-f155e18e17f4 tempest-CreateVolumesFromImageTest-272599248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.343s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:34 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-f5153b16-fdbe-4908-80e3-f155e18e17f4 tempest-CreateVolumesFromImageTest-272599248 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:41:34 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d28e6a4d-2df7-4518-9849-20d8aae5bcff tempest-CreateVolumesFromImageTest-272599248 None] Acquiring lock "cinder-quobyte-53c36f02-0f36-42f7-a0e5-9383bc778540" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:41:34 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-f5153b16-fdbe-4908-80e3-f155e18e17f4 tempest-CreateVolumesFromImageTest-272599248 None] Deleted volume successfully.
Jul 14 16:41:34 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d28e6a4d-2df7-4518-9849-20d8aae5bcff tempest-CreateVolumesFromImageTest-272599248 None] Lock "cinder-quobyte-53c36f02-0f36-42f7-a0e5-9383bc778540" acquired by "delete_volume" :: waited 0.040s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:41:34 devstack sudo[105098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-dda47ebd-bee2-4bd8-b811-4b02521d5cc5.ead19762-ce50-42b4-a653-1cb7274676d3
Jul 14 16:41:34 devstack sudo[105098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:34 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f5153b16-fdbe-4908-80e3-f155e18e17f4 tempest-CreateVolumesFromImageTest-272599248 None] Lock "cinder-b2079d13-2a96-471d-98a9-44bcf44e5b73-delete_volume" released by "delete_volume" :: held 1.393s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:41:34 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0dc112-0325-4f1a-9a58-b3a33f26411f]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:41:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d28e6a4d-2df7-4518-9849-20d8aae5bcff tempest-CreateVolumesFromImageTest-272599248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-53c36f02-0f36-42f7-a0e5-9383bc778540 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:34 devstack sudo[105099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c3d674eb-ab89-4e7a-aac7-ef9e6ef74756_fhuekaiw
Jul 14 16:41:34 devstack sudo[105099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:34 devstack sudo[105106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-53c36f02-0f36-42f7-a0e5-9383bc778540
Jul 14 16:41:34 devstack sudo[105106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:34 devstack sudo[105096]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-52c9524f-38be-40a9-a189-668beab2329c tempest-CinderUnicodeTest-300502851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c49a25f1-074e-4e84-a3a7-a5c1ffb45cba 1073741824" returned: 0 in 0.582s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-52c9524f-38be-40a9-a189-668beab2329c tempest-CinderUnicodeTest-300502851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c49a25f1-074e-4e84-a3a7-a5c1ffb45cba {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:34 devstack sudo[105099]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cfb9a179-e4b3-4a1b-9a99-75809453f36c tempest-VolumeImageDependencyTests-1226837158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c3d674eb-ab89-4e7a-aac7-ef9e6ef74756_fhuekaiw" returned: 0 in 0.484s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cfb9a179-e4b3-4a1b-9a99-75809453f36c tempest-VolumeImageDependencyTests-1226837158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c3d674eb-ab89-4e7a-aac7-ef9e6ef74756_fhuekaiw {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:34 devstack sudo[105114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c49a25f1-074e-4e84-a3a7-a5c1ffb45cba
Jul 14 16:41:34 devstack sudo[105114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:34 devstack sudo[105098]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1c745135-77c6-4cb4-ba02-a2ca30756090 tempest-ProjectReaderTests-1127203843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-dda47ebd-bee2-4bd8-b811-4b02521d5cc5.ead19762-ce50-42b4-a653-1cb7274676d3" returned: 0 in 0.540s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:34 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-1c745135-77c6-4cb4-ba02-a2ca30756090 tempest-ProjectReaderTests-1127203843 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dda47ebd-bee2-4bd8-b811-4b02521d5cc5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 16:41:34 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[0497221f-4282-4ce8-ae34-4804dbf466e6]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:41:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1c745135-77c6-4cb4-ba02-a2ca30756090 tempest-ProjectReaderTests-1127203843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-dda47ebd-bee2-4bd8-b811-4b02521d5cc5 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:34 devstack sudo[105115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c3d674eb-ab89-4e7a-aac7-ef9e6ef74756_fhuekaiw
Jul 14 16:41:34 devstack sudo[105115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:34 devstack sudo[105117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-dda47ebd-bee2-4bd8-b811-4b02521d5cc5
Jul 14 16:41:34 devstack sudo[105117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:34 devstack sudo[105106]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d28e6a4d-2df7-4518-9849-20d8aae5bcff tempest-CreateVolumesFromImageTest-272599248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-53c36f02-0f36-42f7-a0e5-9383bc778540" returned: 0 in 0.506s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d28e6a4d-2df7-4518-9849-20d8aae5bcff tempest-CreateVolumesFromImageTest-272599248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-53c36f02-0f36-42f7-a0e5-9383bc778540 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:34 devstack sudo[105114]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-52c9524f-38be-40a9-a189-668beab2329c tempest-CinderUnicodeTest-300502851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c49a25f1-074e-4e84-a3a7-a5c1ffb45cba" returned: 0 in 0.299s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:34 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-52c9524f-38be-40a9-a189-668beab2329c tempest-CinderUnicodeTest-300502851 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:41:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-52c9524f-38be-40a9-a189-668beab2329c tempest-CinderUnicodeTest-300502851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:34 devstack sudo[105124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-53c36f02-0f36-42f7-a0e5-9383bc778540
Jul 14 16:41:34 devstack sudo[105124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:34 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-52c9524f-38be-40a9-a189-668beab2329c tempest-CinderUnicodeTest-300502851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cacfdd35-56d7-4020-9b06-3f12c1d6e032) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c49a25f1-074e-4e84-a3a7-a5c1ffb45cba', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:34 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-52c9524f-38be-40a9-a189-668beab2329c tempest-CinderUnicodeTest-300502851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20632b63-fa5e-4226-a667-a1eaa4be4d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:34 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-52c9524f-38be-40a9-a189-668beab2329c tempest-CinderUnicodeTest-300502851 None] Volume volume-c49a25f1-074e-4e84-a3a7-a5c1ffb45cba (c49a25f1-074e-4e84-a3a7-a5c1ffb45cba): created successfully
Jul 14 16:41:34 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-52c9524f-38be-40a9-a189-668beab2329c tempest-CinderUnicodeTest-300502851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20632b63-fa5e-4226-a667-a1eaa4be4d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:34 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-52c9524f-38be-40a9-a189-668beab2329c tempest-CinderUnicodeTest-300502851 None] Flow 'volume_create_manager' (5951bebb-ad46-4535-b678-02c99c4c1451) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:41:34 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-52c9524f-38be-40a9-a189-668beab2329c tempest-CinderUnicodeTest-300502851 None] Created volume successfully.
Jul 14 16:41:35 devstack sudo[105115]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cfb9a179-e4b3-4a1b-9a99-75809453f36c tempest-VolumeImageDependencyTests-1226837158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c3d674eb-ab89-4e7a-aac7-ef9e6ef74756_fhuekaiw" returned: 1 in 0.411s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cfb9a179-e4b3-4a1b-9a99-75809453f36c tempest-VolumeImageDependencyTests-1226837158 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c3d674eb-ab89-4e7a-aac7-ef9e6ef74756_fhuekaiw' failed. Not Retrying. {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 16:41:35 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03927ff-85a3-4ac1-8e8c-184e82998b39]: (4, 'raw') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:41:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cfb9a179-e4b3-4a1b-9a99-75809453f36c tempest-VolumeImageDependencyTests-1226837158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c3d674eb-ab89-4e7a-aac7-ef9e6ef74756_9a33swuadevstack@QuobyteHD {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:35 devstack sudo[105117]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1c745135-77c6-4cb4-ba02-a2ca30756090 tempest-ProjectReaderTests-1127203843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-dda47ebd-bee2-4bd8-b811-4b02521d5cc5" returned: 0 in 0.426s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1c745135-77c6-4cb4-ba02-a2ca30756090 tempest-ProjectReaderTests-1127203843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-dda47ebd-bee2-4bd8-b811-4b02521d5cc5.ead19762-ce50-42b4-a653-1cb7274676d3 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:35 devstack sudo[105124]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:35 devstack sudo[105128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c3d674eb-ab89-4e7a-aac7-ef9e6ef74756_9a33swuadevstack@QuobyteHD
Jul 14 16:41:35 devstack sudo[105128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d28e6a4d-2df7-4518-9849-20d8aae5bcff tempest-CreateVolumesFromImageTest-272599248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-53c36f02-0f36-42f7-a0e5-9383bc778540" returned: 0 in 0.294s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:35 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d28e6a4d-2df7-4518-9849-20d8aae5bcff tempest-CreateVolumesFromImageTest-272599248 None] Lock "cinder-quobyte-53c36f02-0f36-42f7-a0e5-9383bc778540" released by "delete_volume" :: held 0.863s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:41:35 devstack sudo[105134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-dda47ebd-bee2-4bd8-b811-4b02521d5cc5.ead19762-ce50-42b4-a653-1cb7274676d3
Jul 14 16:41:35 devstack sudo[105134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:35 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-d28e6a4d-2df7-4518-9849-20d8aae5bcff tempest-CreateVolumesFromImageTest-272599248 None] Created reservations ['d822207e-bffa-4fd8-8c08-46bdea3ee5bb', '9c3c1ff9-c6a0-4afd-924c-da961883c086', '21b5f424-7745-4b3e-a1fb-0a7e78751065', '171ea6bf-0271-48fc-ab3a-2836674a2b84'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:41:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d28e6a4d-2df7-4518-9849-20d8aae5bcff tempest-CreateVolumesFromImageTest-272599248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d28e6a4d-2df7-4518-9849-20d8aae5bcff tempest-CreateVolumesFromImageTest-272599248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d28e6a4d-2df7-4518-9849-20d8aae5bcff tempest-CreateVolumesFromImageTest-272599248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:41:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d28e6a4d-2df7-4518-9849-20d8aae5bcff tempest-CreateVolumesFromImageTest-272599248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:41:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d28e6a4d-2df7-4518-9849-20d8aae5bcff tempest-CreateVolumesFromImageTest-272599248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d28e6a4d-2df7-4518-9849-20d8aae5bcff tempest-CreateVolumesFromImageTest-272599248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:35 devstack sudo[105137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:41:35 devstack sudo[105137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:35 devstack sudo[105128]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cfb9a179-e4b3-4a1b-9a99-75809453f36c tempest-VolumeImageDependencyTests-1226837158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c3d674eb-ab89-4e7a-aac7-ef9e6ef74756_9a33swuadevstack@QuobyteHD" returned: 0 in 0.397s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:35 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 16:41:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:41:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:41:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cfb9a179-e4b3-4a1b-9a99-75809453f36c tempest-VolumeImageDependencyTests-1226837158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c3d674eb-ab89-4e7a-aac7-ef9e6ef74756_9a33swuadevstack@QuobyteHD {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:35 devstack sudo[105144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:41:35 devstack sudo[105144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:35 devstack sudo[105145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c3d674eb-ab89-4e7a-aac7-ef9e6ef74756_9a33swuadevstack@QuobyteHD
Jul 14 16:41:35 devstack sudo[105145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:35 devstack sudo[105137]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:35 devstack sudo[105134]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1c745135-77c6-4cb4-ba02-a2ca30756090 tempest-ProjectReaderTests-1127203843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-dda47ebd-bee2-4bd8-b811-4b02521d5cc5.ead19762-ce50-42b4-a653-1cb7274676d3" returned: 0 in 0.595s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1c745135-77c6-4cb4-ba02-a2ca30756090 tempest-ProjectReaderTests-1127203843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-dda47ebd-bee2-4bd8-b811-4b02521d5cc5.ead19762-ce50-42b4-a653-1cb7274676d3 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d28e6a4d-2df7-4518-9849-20d8aae5bcff tempest-CreateVolumesFromImageTest-272599248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.445s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:35 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-d28e6a4d-2df7-4518-9849-20d8aae5bcff tempest-CreateVolumesFromImageTest-272599248 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:41:35 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-d28e6a4d-2df7-4518-9849-20d8aae5bcff tempest-CreateVolumesFromImageTest-272599248 None] Deleted volume successfully.
Jul 14 16:41:35 devstack sudo[105149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-dda47ebd-bee2-4bd8-b811-4b02521d5cc5.ead19762-ce50-42b4-a653-1cb7274676d3
Jul 14 16:41:35 devstack sudo[105149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:35 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d28e6a4d-2df7-4518-9849-20d8aae5bcff tempest-CreateVolumesFromImageTest-272599248 None] Lock "cinder-53c36f02-0f36-42f7-a0e5-9383bc778540-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:41:35 devstack sudo[105144]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.461s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:35 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:41:35 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Running periodic task VolumeManager._thread_info {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 16:41:35 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] thread count: 29 {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 14 16:41:35 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] thread info: [<_MainThread(MainThread, started 128606490927232)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128606415432960)>, <Thread(Thread-3 (stat_writer), started daemon 128606378859328)>, <Thread(Rabbit-heartbeat, started daemon 128606379646144)>, <Thread(Thread-5 (_runner), started daemon 128606377685824)>, <Thread(Thread-7 (_runner), started daemon 128606377701888)>, <Thread(fd_logger, started daemon 128606377091392)>, <Thread(privsep_reader, started daemon 128606375782080)>, <Thread(tpool_thread_0, started daemon 128606365607616)>, <Thread(tpool_thread_1, started daemon 128606357214912)>, <Thread(tpool_thread_2, started daemon 128606348822208)>, <Thread(tpool_thread_3, started daemon 128606340413120)>, <Thread(tpool_thread_4, started daemon 128606332004032)>, <Thread(tpool_thread_5, started daemon 128606323594944)>, <Thread(tpool_thread_6, started daemon 128606315185856)>, <Thread(tpool_thread_7, started daemon 128606306776768)>, <Thread(tpool_thread_8, started daemon 128606298367680)>, <Thread(tpool_thread_9, started daemon 128606289958592)>, <Thread(tpool_thread_10, started daemon 128606281549504)>, <Thread(tpool_thread_11, started daemon 128606273140416)>, <Thread(tpool_thread_12, started daemon 128606264731328)>, <Thread(tpool_thread_13, started daemon 128606256322240)>, <Thread(tpool_thread_14, started daemon 128606247913152)>, <Thread(tpool_thread_15, started daemon 128606239504064)>, <Thread(tpool_thread_16, started daemon 128606231094976)>, <Thread(tpool_thread_17, started daemon 128606222685888)>, <Thread(tpool_thread_18, started daemon 128606214276800)>, <Thread(tpool_thread_19, started daemon 128606205867712)>, <Thread(Rabbit-heartbeat, started daemon 128606368169344)>] {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 14 16:41:35 devstack sudo[105145]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cfb9a179-e4b3-4a1b-9a99-75809453f36c tempest-VolumeImageDependencyTests-1226837158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c3d674eb-ab89-4e7a-aac7-ef9e6ef74756_9a33swuadevstack@QuobyteHD" returned: 1 in 0.499s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cfb9a179-e4b3-4a1b-9a99-75809453f36c tempest-VolumeImageDependencyTests-1226837158 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c3d674eb-ab89-4e7a-aac7-ef9e6ef74756_9a33swuadevstack@QuobyteHD' failed. Not Retrying. {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 16:41:35 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-cfb9a179-e4b3-4a1b-9a99-75809453f36c tempest-VolumeImageDependencyTests-1226837158 None] c3d674eb-ab89-4e7a-aac7-ef9e6ef74756 was raw, converting to raw {{(pid=87166) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 14 16:41:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cfb9a179-e4b3-4a1b-9a99-75809453f36c tempest-VolumeImageDependencyTests-1226837158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c3d674eb-ab89-4e7a-aac7-ef9e6ef74756_9a33swuadevstack@QuobyteHD /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-46db7e4d-7cb6-441e-8e93-13d804a99975 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:36 devstack sudo[105155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c3d674eb-ab89-4e7a-aac7-ef9e6ef74756_9a33swuadevstack@QuobyteHD /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-46db7e4d-7cb6-441e-8e93-13d804a99975
Jul 14 16:41:36 devstack sudo[105155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:36 devstack sudo[105149]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1c745135-77c6-4cb4-ba02-a2ca30756090 tempest-ProjectReaderTests-1127203843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-dda47ebd-bee2-4bd8-b811-4b02521d5cc5.ead19762-ce50-42b4-a653-1cb7274676d3" returned: 0 in 0.398s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:36 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-1c745135-77c6-4cb4-ba02-a2ca30756090 tempest-ProjectReaderTests-1127203843 None] Lock "cinder-quobyte-ead19762-ce50-42b4-a653-1cb7274676d3" released by "_delete_snapshot" :: held 2.136s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:41:36 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-1c745135-77c6-4cb4-ba02-a2ca30756090 tempest-ProjectReaderTests-1127203843 None] Lock "cinder-quobyte-dda47ebd-bee2-4bd8-b811-4b02521d5cc5" released by "delete_snapshot" :: held 2.167s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:41:36 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-1c745135-77c6-4cb4-ba02-a2ca30756090 tempest-ProjectReaderTests-1127203843 None] Created reservations ['8fc65dfe-27cb-4ea3-a9d7-1d7e1e0d6640', '799fcb83-9e2d-4cda-9c83-ba2aa69c7544', '01a7bf88-36fd-4b56-a221-96d510ebfe59', '7b5d5363-b494-43db-ab20-85b50193f70e'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:41:36 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c48b8f1-8d1c-457d-8ff5-ec83b3aa9098 tempest-CinderUnicodeTest-300502851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:41:36 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1c48b8f1-8d1c-457d-8ff5-ec83b3aa9098 tempest-CinderUnicodeTest-300502851 None] Flow 'volume_create_manager' (563607a5-992f-4aea-a267-c45fc4559290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:41:36 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1c48b8f1-8d1c-457d-8ff5-ec83b3aa9098 tempest-CinderUnicodeTest-300502851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fac1aac-8b0d-4e5d-884a-5cc0201ed4b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:36 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1c48b8f1-8d1c-457d-8ff5-ec83b3aa9098 tempest-CinderUnicodeTest-300502851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fac1aac-8b0d-4e5d-884a-5cc0201ed4b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:41:36Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-390335796',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=101ecd0e-b276-468f-9a09-44d540f00265,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c23ceb683e7b40e0a5de0516a4a8b83e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:41:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:41:36Z,use_quota=True,user_id='8877bee722054d1391e35c37dadd6577',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:36 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1c48b8f1-8d1c-457d-8ff5-ec83b3aa9098 tempest-CinderUnicodeTest-300502851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bf2150c-35ef-4b15-9542-efa7086a1092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:36 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1c48b8f1-8d1c-457d-8ff5-ec83b3aa9098 tempest-CinderUnicodeTest-300502851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bf2150c-35ef-4b15-9542-efa7086a1092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:36 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1c48b8f1-8d1c-457d-8ff5-ec83b3aa9098 tempest-CinderUnicodeTest-300502851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1630d166-3a94-40a3-8a9b-671bf864e681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:36 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1c48b8f1-8d1c-457d-8ff5-ec83b3aa9098 tempest-CinderUnicodeTest-300502851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1630d166-3a94-40a3-8a9b-671bf864e681) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '101ecd0e-b276-468f-9a09-44d540f00265', 'volume_name': 'volume-101ecd0e-b276-468f-9a09-44d540f00265', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:36 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1c48b8f1-8d1c-457d-8ff5-ec83b3aa9098 tempest-CinderUnicodeTest-300502851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe415709-1142-400e-998e-3b4b9d8df800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:36 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1c48b8f1-8d1c-457d-8ff5-ec83b3aa9098 tempest-CinderUnicodeTest-300502851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe415709-1142-400e-998e-3b4b9d8df800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:36 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1c48b8f1-8d1c-457d-8ff5-ec83b3aa9098 tempest-CinderUnicodeTest-300502851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baf4eace-6b6e-40d8-93c4-3891eb4b59ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:36 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-1c48b8f1-8d1c-457d-8ff5-ec83b3aa9098 tempest-CinderUnicodeTest-300502851 None] Volume 101ecd0e-b276-468f-9a09-44d540f00265: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-101ecd0e-b276-468f-9a09-44d540f00265', 'volume_size': 1}
Jul 14 16:41:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1c48b8f1-8d1c-457d-8ff5-ec83b3aa9098 tempest-CinderUnicodeTest-300502851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1c48b8f1-8d1c-457d-8ff5-ec83b3aa9098 tempest-CinderUnicodeTest-300502851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:36 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-1c48b8f1-8d1c-457d-8ff5-ec83b3aa9098 tempest-CinderUnicodeTest-300502851 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:41:36Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-390335796',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=101ecd0e-b276-468f-9a09-44d540f00265,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c23ceb683e7b40e0a5de0516a4a8b83e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:41:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:41:36Z,use_quota=True,user_id='8877bee722054d1391e35c37dadd6577',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:41:36 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-1c48b8f1-8d1c-457d-8ff5-ec83b3aa9098 tempest-CinderUnicodeTest-300502851 None] Creating volume 101ecd0e-b276-468f-9a09-44d540f00265 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:41:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1c48b8f1-8d1c-457d-8ff5-ec83b3aa9098 tempest-CinderUnicodeTest-300502851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1c48b8f1-8d1c-457d-8ff5-ec83b3aa9098 tempest-CinderUnicodeTest-300502851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:36 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-1c48b8f1-8d1c-457d-8ff5-ec83b3aa9098 tempest-CinderUnicodeTest-300502851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:41:36 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-1c48b8f1-8d1c-457d-8ff5-ec83b3aa9098 tempest-CinderUnicodeTest-300502851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:41:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1c48b8f1-8d1c-457d-8ff5-ec83b3aa9098 tempest-CinderUnicodeTest-300502851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:36 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-1c48b8f1-8d1c-457d-8ff5-ec83b3aa9098 tempest-CinderUnicodeTest-300502851 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:41:36 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-1c48b8f1-8d1c-457d-8ff5-ec83b3aa9098 tempest-CinderUnicodeTest-300502851 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:41:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1c48b8f1-8d1c-457d-8ff5-ec83b3aa9098 tempest-CinderUnicodeTest-300502851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-101ecd0e-b276-468f-9a09-44d540f00265 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:36 devstack sudo[105163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-101ecd0e-b276-468f-9a09-44d540f00265 1073741824
Jul 14 16:41:36 devstack sudo[105163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:36 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-1c745135-77c6-4cb4-ba02-a2ca30756090 tempest-ProjectReaderTests-1127203843 None] Delete snapshot completed successfully.
Jul 14 16:41:36 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-1c745135-77c6-4cb4-ba02-a2ca30756090 tempest-ProjectReaderTests-1127203843 None] Lock "cinder-ead19762-ce50-42b4-a653-1cb7274676d3-delete_snapshot" released by "delete_snapshot" :: held 2.511s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:41:36 devstack sudo[105155]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cfb9a179-e4b3-4a1b-9a99-75809453f36c tempest-VolumeImageDependencyTests-1226837158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c3d674eb-ab89-4e7a-aac7-ef9e6ef74756_9a33swuadevstack@QuobyteHD /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-46db7e4d-7cb6-441e-8e93-13d804a99975" returned: 0 in 0.537s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:36 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-cfb9a179-e4b3-4a1b-9a99-75809453f36c tempest-VolumeImageDependencyTests-1226837158 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c3d674eb-ab89-4e7a-aac7-ef9e6ef74756_9a33swuadevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-46db7e4d-7cb6-441e-8e93-13d804a99975 {{(pid=87166) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 14 16:41:36 devstack cinder-volume[87166]: INFO cinder.image.image_utils [None req-cfb9a179-e4b3-4a1b-9a99-75809453f36c tempest-VolumeImageDependencyTests-1226837158 None] Converted 0.00 MB image at 0.00 MB/s
Jul 14 16:41:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cfb9a179-e4b3-4a1b-9a99-75809453f36c tempest-VolumeImageDependencyTests-1226837158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-46db7e4d-7cb6-441e-8e93-13d804a99975 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:36 devstack sudo[105165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-46db7e4d-7cb6-441e-8e93-13d804a99975 1G
Jul 14 16:41:36 devstack sudo[105165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:36 devstack sudo[105165]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cfb9a179-e4b3-4a1b-9a99-75809453f36c tempest-VolumeImageDependencyTests-1226837158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-46db7e4d-7cb6-441e-8e93-13d804a99975 1G" returned: 0 in 0.308s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:36 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[7101e743-8219-4863-be09-912ba189484e]: (4, 'raw') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:41:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cfb9a179-e4b3-4a1b-9a99-75809453f36c tempest-VolumeImageDependencyTests-1226837158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-46db7e4d-7cb6-441e-8e93-13d804a99975 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:36 devstack sudo[105163]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1c48b8f1-8d1c-457d-8ff5-ec83b3aa9098 tempest-CinderUnicodeTest-300502851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-101ecd0e-b276-468f-9a09-44d540f00265 1073741824" returned: 0 in 0.531s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:37 devstack sudo[105174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-46db7e4d-7cb6-441e-8e93-13d804a99975
Jul 14 16:41:37 devstack sudo[105174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1c48b8f1-8d1c-457d-8ff5-ec83b3aa9098 tempest-CinderUnicodeTest-300502851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-101ecd0e-b276-468f-9a09-44d540f00265 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:37 devstack sudo[105176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-101ecd0e-b276-468f-9a09-44d540f00265
Jul 14 16:41:37 devstack sudo[105176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:37 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-106e3593-7bb4-4687-8b35-ae71267ddf1e tempest-ProjectReaderTests-1127203843 None] Acquiring lock "cinder-dda47ebd-bee2-4bd8-b811-4b02521d5cc5-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:41:37 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-106e3593-7bb4-4687-8b35-ae71267ddf1e tempest-ProjectReaderTests-1127203843 None] Lock "cinder-dda47ebd-bee2-4bd8-b811-4b02521d5cc5-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:41:37 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-106e3593-7bb4-4687-8b35-ae71267ddf1e tempest-ProjectReaderTests-1127203843 None] Acquiring lock "cinder-quobyte-dda47ebd-bee2-4bd8-b811-4b02521d5cc5" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:41:37 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-106e3593-7bb4-4687-8b35-ae71267ddf1e tempest-ProjectReaderTests-1127203843 None] Lock "cinder-quobyte-dda47ebd-bee2-4bd8-b811-4b02521d5cc5" acquired by "delete_volume" :: waited 0.024s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:41:37 devstack sudo[105174]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cfb9a179-e4b3-4a1b-9a99-75809453f36c tempest-VolumeImageDependencyTests-1226837158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-46db7e4d-7cb6-441e-8e93-13d804a99975" returned: 0 in 0.471s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cfb9a179-e4b3-4a1b-9a99-75809453f36c tempest-VolumeImageDependencyTests-1226837158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-46db7e4d-7cb6-441e-8e93-13d804a99975 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:37 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[400327e3-e301-4d8f-9ac0-90c56858db34]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:41:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-106e3593-7bb4-4687-8b35-ae71267ddf1e tempest-ProjectReaderTests-1127203843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-dda47ebd-bee2-4bd8-b811-4b02521d5cc5 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:37 devstack sudo[105176]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1c48b8f1-8d1c-457d-8ff5-ec83b3aa9098 tempest-CinderUnicodeTest-300502851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-101ecd0e-b276-468f-9a09-44d540f00265" returned: 0 in 0.391s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:37 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-1c48b8f1-8d1c-457d-8ff5-ec83b3aa9098 tempest-CinderUnicodeTest-300502851 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:41:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1c48b8f1-8d1c-457d-8ff5-ec83b3aa9098 tempest-CinderUnicodeTest-300502851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1c48b8f1-8d1c-457d-8ff5-ec83b3aa9098 tempest-CinderUnicodeTest-300502851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baf4eace-6b6e-40d8-93c4-3891eb4b59ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-101ecd0e-b276-468f-9a09-44d540f00265', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1c48b8f1-8d1c-457d-8ff5-ec83b3aa9098 tempest-CinderUnicodeTest-300502851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7929fb25-0c32-429a-bfcc-eb3465ad9894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:37 devstack sudo[105180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-46db7e4d-7cb6-441e-8e93-13d804a99975
Jul 14 16:41:37 devstack sudo[105180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:37 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-1c48b8f1-8d1c-457d-8ff5-ec83b3aa9098 tempest-CinderUnicodeTest-300502851 None] Volume volume-101ecd0e-b276-468f-9a09-44d540f00265 (101ecd0e-b276-468f-9a09-44d540f00265): created successfully
Jul 14 16:41:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1c48b8f1-8d1c-457d-8ff5-ec83b3aa9098 tempest-CinderUnicodeTest-300502851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7929fb25-0c32-429a-bfcc-eb3465ad9894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1c48b8f1-8d1c-457d-8ff5-ec83b3aa9098 tempest-CinderUnicodeTest-300502851 None] Flow 'volume_create_manager' (563607a5-992f-4aea-a267-c45fc4559290) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:41:37 devstack sudo[105181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-dda47ebd-bee2-4bd8-b811-4b02521d5cc5
Jul 14 16:41:37 devstack sudo[105181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:37 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-1c48b8f1-8d1c-457d-8ff5-ec83b3aa9098 tempest-CinderUnicodeTest-300502851 None] Created volume successfully.
Jul 14 16:41:37 devstack sudo[105180]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cfb9a179-e4b3-4a1b-9a99-75809453f36c tempest-VolumeImageDependencyTests-1226837158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-46db7e4d-7cb6-441e-8e93-13d804a99975" returned: 1 in 0.423s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cfb9a179-e4b3-4a1b-9a99-75809453f36c tempest-VolumeImageDependencyTests-1226837158 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-46db7e4d-7cb6-441e-8e93-13d804a99975' failed. Not Retrying. {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 16:41:37 devstack cinder-volume[87166]: DEBUG cinder.volume.volume_utils [None req-cfb9a179-e4b3-4a1b-9a99-75809453f36c tempest-VolumeImageDependencyTests-1226837158 None] Downloaded image c3d674eb-ab89-4e7a-aac7-ef9e6ef74756 ((None, [{'url': 'file:///opt/stack/data/glance/images/c3d674eb-ab89-4e7a-aac7-ef9e6ef74756', 'metadata': {}}])) to volume 46db7e4d-7cb6-441e-8e93-13d804a99975 successfully. {{(pid=87166) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 14 16:41:37 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-cfb9a179-e4b3-4a1b-9a99-75809453f36c tempest-VolumeImageDependencyTests-1226837158 None] Temporary image c3d674eb-ab89-4e7a-aac7-ef9e6ef74756 for user c0d9e01082b840e0b1a18552e901326a is deleted. {{(pid=87166) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 14 16:41:37 devstack cinder-volume[87166]: DEBUG cinder.volume.volume_utils [None req-cfb9a179-e4b3-4a1b-9a99-75809453f36c tempest-VolumeImageDependencyTests-1226837158 None] Marking volume 46db7e4d-7cb6-441e-8e93-13d804a99975 as bootable. {{(pid=87166) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 14 16:41:37 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfb9a179-e4b3-4a1b-9a99-75809453f36c tempest-VolumeImageDependencyTests-1226837158 None] Copying metadata from image c3d674eb-ab89-4e7a-aac7-ef9e6ef74756 to 46db7e4d-7cb6-441e-8e93-13d804a99975. {{(pid=87166) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 14 16:41:37 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfb9a179-e4b3-4a1b-9a99-75809453f36c tempest-VolumeImageDependencyTests-1226837158 None] Creating volume glance metadata for volume 46db7e4d-7cb6-441e-8e93-13d804a99975 backed by image c3d674eb-ab89-4e7a-aac7-ef9e6ef74756 with: {'image_id': 'c3d674eb-ab89-4e7a-aac7-ef9e6ef74756', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '9333cd536bc8e93b7c95ca1d635c62c9', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87166) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 14 16:41:37 devstack sudo[105181]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-106e3593-7bb4-4687-8b35-ae71267ddf1e tempest-ProjectReaderTests-1127203843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-dda47ebd-bee2-4bd8-b811-4b02521d5cc5" returned: 0 in 0.440s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-106e3593-7bb4-4687-8b35-ae71267ddf1e tempest-ProjectReaderTests-1127203843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-dda47ebd-bee2-4bd8-b811-4b02521d5cc5 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:37 devstack sudo[105191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-dda47ebd-bee2-4bd8-b811-4b02521d5cc5
Jul 14 16:41:37 devstack sudo[105191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cfb9a179-e4b3-4a1b-9a99-75809453f36c tempest-VolumeImageDependencyTests-1226837158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c60be4d-54d6-49f3-926f-d4b0921a1e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46db7e4d-7cb6-441e-8e93-13d804a99975', 'volume_size': 1, 'image_id': 'c3d674eb-ab89-4e7a-aac7-ef9e6ef74756', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c3d674eb-ab89-4e7a-aac7-ef9e6ef74756', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9333cd536bc8e93b7c95ca1d635c62c9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '286d05196c9145c78e310b19929cadbe', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '31a32528c8bd2e92b9eebc9d08f86e13f2096fa76540f81bf0705c9d35f725b65e001aab8fc27e7b53ec6088f5d92736b27283a49fdf86b69a59eb75495e46c8', 'id': 'c3d674eb-ab89-4e7a-aac7-ef9e6ef74756', 'created_at': datetime.datetime(2026, 7, 14, 14, 41, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 14, 14, 41, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c3d674eb-ab89-4e7a-aac7-ef9e6ef74756/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x74f7769a6a50>}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cfb9a179-e4b3-4a1b-9a99-75809453f36c tempest-VolumeImageDependencyTests-1226837158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d82c1ee7-3c1e-4e98-9546-0e9a7440bdd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:37 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-cfb9a179-e4b3-4a1b-9a99-75809453f36c tempest-VolumeImageDependencyTests-1226837158 None] Volume volume-46db7e4d-7cb6-441e-8e93-13d804a99975 (46db7e4d-7cb6-441e-8e93-13d804a99975): created successfully
Jul 14 16:41:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cfb9a179-e4b3-4a1b-9a99-75809453f36c tempest-VolumeImageDependencyTests-1226837158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d82c1ee7-3c1e-4e98-9546-0e9a7440bdd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cfb9a179-e4b3-4a1b-9a99-75809453f36c tempest-VolumeImageDependencyTests-1226837158 None] Flow 'volume_create_manager' (6ed522e5-8f3e-4616-af5c-51f7bdbc845b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:41:37 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-cfb9a179-e4b3-4a1b-9a99-75809453f36c tempest-VolumeImageDependencyTests-1226837158 None] Created volume successfully.
Jul 14 16:41:38 devstack sudo[105191]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-106e3593-7bb4-4687-8b35-ae71267ddf1e tempest-ProjectReaderTests-1127203843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-dda47ebd-bee2-4bd8-b811-4b02521d5cc5" returned: 0 in 0.271s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:38 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-106e3593-7bb4-4687-8b35-ae71267ddf1e tempest-ProjectReaderTests-1127203843 None] Lock "cinder-quobyte-dda47ebd-bee2-4bd8-b811-4b02521d5cc5" released by "delete_volume" :: held 0.777s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:41:38 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-106e3593-7bb4-4687-8b35-ae71267ddf1e tempest-ProjectReaderTests-1127203843 None] Created reservations ['98604ab5-c974-4b7c-8f33-f5d3bcc95427', '39d1e110-11a0-49a5-8fb6-2eebc9d2db1d', '61e31a43-9bde-4277-92de-a9382ba91f2e', 'd74bd87c-f20a-43a9-ba19-1d1d60928b11'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:41:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-106e3593-7bb4-4687-8b35-ae71267ddf1e tempest-ProjectReaderTests-1127203843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-106e3593-7bb4-4687-8b35-ae71267ddf1e tempest-ProjectReaderTests-1127203843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:38 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-106e3593-7bb4-4687-8b35-ae71267ddf1e tempest-ProjectReaderTests-1127203843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:41:38 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-106e3593-7bb4-4687-8b35-ae71267ddf1e tempest-ProjectReaderTests-1127203843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:41:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-106e3593-7bb4-4687-8b35-ae71267ddf1e tempest-ProjectReaderTests-1127203843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-106e3593-7bb4-4687-8b35-ae71267ddf1e tempest-ProjectReaderTests-1127203843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:38 devstack sudo[105194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:41:38 devstack sudo[105194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:38 devstack sudo[105194]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-106e3593-7bb4-4687-8b35-ae71267ddf1e tempest-ProjectReaderTests-1127203843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.279s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:38 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-106e3593-7bb4-4687-8b35-ae71267ddf1e tempest-ProjectReaderTests-1127203843 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:41:38 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-106e3593-7bb4-4687-8b35-ae71267ddf1e tempest-ProjectReaderTests-1127203843 None] Deleted volume successfully.
Jul 14 16:41:38 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-106e3593-7bb4-4687-8b35-ae71267ddf1e tempest-ProjectReaderTests-1127203843 None] Lock "cinder-dda47ebd-bee2-4bd8-b811-4b02521d5cc5-delete_volume" released by "delete_volume" :: held 1.296s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:41:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-318ebb95-4169-4bd9-936d-6339f5097bd6 tempest-CinderUnicodeTest-300502851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-318ebb95-4169-4bd9-936d-6339f5097bd6 tempest-CinderUnicodeTest-300502851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:38 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-318ebb95-4169-4bd9-936d-6339f5097bd6 tempest-CinderUnicodeTest-300502851 None] Creating offline snapshot 49d40350-f04a-4c0d-bed6-1dd240ca13d1 of volume 101ecd0e-b276-468f-9a09-44d540f00265 {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 16:41:38 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[5836cb01-403a-48d5-b5e7-f2c87d6ccf61]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:41:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-318ebb95-4169-4bd9-936d-6339f5097bd6 tempest-CinderUnicodeTest-300502851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-101ecd0e-b276-468f-9a09-44d540f00265 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:38 devstack sudo[105197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-101ecd0e-b276-468f-9a09-44d540f00265
Jul 14 16:41:38 devstack sudo[105197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:38 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d8ee10a-65a7-426c-a91d-7b2a93491fb8 tempest-VolumeDependencyTests-307173949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:41:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-7d8ee10a-65a7-426c-a91d-7b2a93491fb8 tempest-VolumeDependencyTests-307173949 None] Flow 'volume_create_manager' (8265f2b7-b730-40c4-b22a-101d9290c70a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:41:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-7d8ee10a-65a7-426c-a91d-7b2a93491fb8 tempest-VolumeDependencyTests-307173949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79f0a078-ccf7-40ae-a419-7d3337a15b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:39 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-279d0d4c-a182-4056-8fe4-26eca7d4881c tempest-VolumeImageDependencyTests-1226837158 None] Acquiring lock "cinder-46db7e4d-7cb6-441e-8e93-13d804a99975-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:41:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-7d8ee10a-65a7-426c-a91d-7b2a93491fb8 tempest-VolumeDependencyTests-307173949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79f0a078-ccf7-40ae-a419-7d3337a15b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:41:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1983461905',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=967743ea-8490-465b-8b46-a4ac4168240f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='682f0e7fd10645918b3b86c9ba18e745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:41:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:41:39Z,use_quota=True,user_id='30ec843111194d99bafe51fae263e352',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-7d8ee10a-65a7-426c-a91d-7b2a93491fb8 tempest-VolumeDependencyTests-307173949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27df1c8b-9ce0-4fd7-865d-667d753f2370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-7d8ee10a-65a7-426c-a91d-7b2a93491fb8 tempest-VolumeDependencyTests-307173949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27df1c8b-9ce0-4fd7-865d-667d753f2370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-7d8ee10a-65a7-426c-a91d-7b2a93491fb8 tempest-VolumeDependencyTests-307173949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1a40203-8836-4881-8b4a-4df200dcbceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-7d8ee10a-65a7-426c-a91d-7b2a93491fb8 tempest-VolumeDependencyTests-307173949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1a40203-8836-4881-8b4a-4df200dcbceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '967743ea-8490-465b-8b46-a4ac4168240f', 'volume_name': 'volume-967743ea-8490-465b-8b46-a4ac4168240f', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-7d8ee10a-65a7-426c-a91d-7b2a93491fb8 tempest-VolumeDependencyTests-307173949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (251b9f5d-ef23-4613-8371-172c60d02ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-7d8ee10a-65a7-426c-a91d-7b2a93491fb8 tempest-VolumeDependencyTests-307173949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (251b9f5d-ef23-4613-8371-172c60d02ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-7d8ee10a-65a7-426c-a91d-7b2a93491fb8 tempest-VolumeDependencyTests-307173949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33399172-a216-487f-8108-5389c3ee8860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:39 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-7d8ee10a-65a7-426c-a91d-7b2a93491fb8 tempest-VolumeDependencyTests-307173949 None] Volume 967743ea-8490-465b-8b46-a4ac4168240f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-967743ea-8490-465b-8b46-a4ac4168240f', 'volume_size': 1}
Jul 14 16:41:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-7d8ee10a-65a7-426c-a91d-7b2a93491fb8 tempest-VolumeDependencyTests-307173949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:39 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-279d0d4c-a182-4056-8fe4-26eca7d4881c tempest-VolumeImageDependencyTests-1226837158 None] Lock "cinder-46db7e4d-7cb6-441e-8e93-13d804a99975-delete_volume" acquired by "delete_volume" :: waited 0.106s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:41:39 devstack sudo[105197]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:39 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-279d0d4c-a182-4056-8fe4-26eca7d4881c tempest-VolumeImageDependencyTests-1226837158 None] Acquiring lock "cinder-quobyte-46db7e4d-7cb6-441e-8e93-13d804a99975" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:41:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-318ebb95-4169-4bd9-936d-6339f5097bd6 tempest-CinderUnicodeTest-300502851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-101ecd0e-b276-468f-9a09-44d540f00265" returned: 0 in 0.481s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-318ebb95-4169-4bd9-936d-6339f5097bd6 tempest-CinderUnicodeTest-300502851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-101ecd0e-b276-468f-9a09-44d540f00265,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-101ecd0e-b276-468f-9a09-44d540f00265.49d40350-f04a-4c0d-bed6-1dd240ca13d1 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:39 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-279d0d4c-a182-4056-8fe4-26eca7d4881c tempest-VolumeImageDependencyTests-1226837158 None] Lock "cinder-quobyte-46db7e4d-7cb6-441e-8e93-13d804a99975" acquired by "delete_volume" :: waited 0.030s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:41:39 devstack sudo[105203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-101ecd0e-b276-468f-9a09-44d540f00265,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-101ecd0e-b276-468f-9a09-44d540f00265.49d40350-f04a-4c0d-bed6-1dd240ca13d1 1G
Jul 14 16:41:39 devstack sudo[105203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:39 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[d60806e1-1808-4bf8-9a78-65b8988e66fe]: (4, 'raw') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:41:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-279d0d4c-a182-4056-8fe4-26eca7d4881c tempest-VolumeImageDependencyTests-1226837158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-46db7e4d-7cb6-441e-8e93-13d804a99975 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:39 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecf092c1-3298-4e3a-9add-03d0f72e1f43 tempest-ProjectReaderTests-1127203843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:41:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ecf092c1-3298-4e3a-9add-03d0f72e1f43 tempest-ProjectReaderTests-1127203843 None] Flow 'volume_create_manager' (66a30534-d4b9-4ae2-acbd-8497bd409f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:41:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ecf092c1-3298-4e3a-9add-03d0f72e1f43 tempest-ProjectReaderTests-1127203843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d0ad67b-5fcd-426c-bd81-48c323476886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ecf092c1-3298-4e3a-9add-03d0f72e1f43 tempest-ProjectReaderTests-1127203843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d0ad67b-5fcd-426c-bd81-48c323476886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:41:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-23276431',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4736ad83-dfb5-471d-a894-e8c41f362e31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='883944e7bf4f4b4dbc774e64e3e27858',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:41:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:41:39Z,use_quota=True,user_id='edcf2b7f48504051a3973d82e7b0fa86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ecf092c1-3298-4e3a-9add-03d0f72e1f43 tempest-ProjectReaderTests-1127203843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9091001b-d8ac-4512-91fc-1b691cebf9f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ecf092c1-3298-4e3a-9add-03d0f72e1f43 tempest-ProjectReaderTests-1127203843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9091001b-d8ac-4512-91fc-1b691cebf9f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ecf092c1-3298-4e3a-9add-03d0f72e1f43 tempest-ProjectReaderTests-1127203843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cce74d3-e69d-4491-b120-94b5d4b18fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ecf092c1-3298-4e3a-9add-03d0f72e1f43 tempest-ProjectReaderTests-1127203843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cce74d3-e69d-4491-b120-94b5d4b18fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4736ad83-dfb5-471d-a894-e8c41f362e31', 'volume_name': 'volume-4736ad83-dfb5-471d-a894-e8c41f362e31', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ecf092c1-3298-4e3a-9add-03d0f72e1f43 tempest-ProjectReaderTests-1127203843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61d6acfd-f74e-49de-815d-718c09a6c942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:39 devstack sudo[105205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-46db7e4d-7cb6-441e-8e93-13d804a99975
Jul 14 16:41:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ecf092c1-3298-4e3a-9add-03d0f72e1f43 tempest-ProjectReaderTests-1127203843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61d6acfd-f74e-49de-815d-718c09a6c942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:39 devstack sudo[105205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ecf092c1-3298-4e3a-9add-03d0f72e1f43 tempest-ProjectReaderTests-1127203843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2517121e-facc-412a-ba96-9731a12c4592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:39 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-ecf092c1-3298-4e3a-9add-03d0f72e1f43 tempest-ProjectReaderTests-1127203843 None] Volume 4736ad83-dfb5-471d-a894-e8c41f362e31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4736ad83-dfb5-471d-a894-e8c41f362e31', 'volume_size': 1}
Jul 14 16:41:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ecf092c1-3298-4e3a-9add-03d0f72e1f43 tempest-ProjectReaderTests-1127203843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:39 devstack sudo[105203]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-318ebb95-4169-4bd9-936d-6339f5097bd6 tempest-CinderUnicodeTest-300502851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-101ecd0e-b276-468f-9a09-44d540f00265,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-101ecd0e-b276-468f-9a09-44d540f00265.49d40350-f04a-4c0d-bed6-1dd240ca13d1 1G" returned: 0 in 0.442s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-318ebb95-4169-4bd9-936d-6339f5097bd6 tempest-CinderUnicodeTest-300502851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-101ecd0e-b276-468f-9a09-44d540f00265 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-101ecd0e-b276-468f-9a09-44d540f00265.49d40350-f04a-4c0d-bed6-1dd240ca13d1 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:39 devstack sudo[105213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-101ecd0e-b276-468f-9a09-44d540f00265 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-101ecd0e-b276-468f-9a09-44d540f00265.49d40350-f04a-4c0d-bed6-1dd240ca13d1
Jul 14 16:41:39 devstack sudo[105213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:39 devstack sudo[105205]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-279d0d4c-a182-4056-8fe4-26eca7d4881c tempest-VolumeImageDependencyTests-1226837158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-46db7e4d-7cb6-441e-8e93-13d804a99975" returned: 0 in 0.396s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-279d0d4c-a182-4056-8fe4-26eca7d4881c tempest-VolumeImageDependencyTests-1226837158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-46db7e4d-7cb6-441e-8e93-13d804a99975 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:39 devstack sudo[105215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-46db7e4d-7cb6-441e-8e93-13d804a99975
Jul 14 16:41:39 devstack sudo[105215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:39 devstack sudo[105213]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-318ebb95-4169-4bd9-936d-6339f5097bd6 tempest-CinderUnicodeTest-300502851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-101ecd0e-b276-468f-9a09-44d540f00265 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-101ecd0e-b276-468f-9a09-44d540f00265.49d40350-f04a-4c0d-bed6-1dd240ca13d1" returned: 0 in 0.319s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:39 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-318ebb95-4169-4bd9-936d-6339f5097bd6 tempest-CinderUnicodeTest-300502851 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-101ecd0e-b276-468f-9a09-44d540f00265.49d40350-f04a-4c0d-bed6-1dd240ca13d1 is being set with open permissions: ugo+rw
Jul 14 16:41:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-318ebb95-4169-4bd9-936d-6339f5097bd6 tempest-CinderUnicodeTest-300502851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-101ecd0e-b276-468f-9a09-44d540f00265.49d40350-f04a-4c0d-bed6-1dd240ca13d1 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:39 devstack sudo[105221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-101ecd0e-b276-468f-9a09-44d540f00265.49d40350-f04a-4c0d-bed6-1dd240ca13d1
Jul 14 16:41:39 devstack sudo[105221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:40 devstack sudo[105215]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-279d0d4c-a182-4056-8fe4-26eca7d4881c tempest-VolumeImageDependencyTests-1226837158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-46db7e4d-7cb6-441e-8e93-13d804a99975" returned: 1 in 0.363s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-279d0d4c-a182-4056-8fe4-26eca7d4881c tempest-VolumeImageDependencyTests-1226837158 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-46db7e4d-7cb6-441e-8e93-13d804a99975' failed. Not Retrying. {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 14 16:41:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-279d0d4c-a182-4056-8fe4-26eca7d4881c tempest-VolumeImageDependencyTests-1226837158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-46db7e4d-7cb6-441e-8e93-13d804a99975 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:40 devstack sudo[105226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-46db7e4d-7cb6-441e-8e93-13d804a99975
Jul 14 16:41:40 devstack sudo[105226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:40 devstack sudo[105221]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-318ebb95-4169-4bd9-936d-6339f5097bd6 tempest-CinderUnicodeTest-300502851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-101ecd0e-b276-468f-9a09-44d540f00265.49d40350-f04a-4c0d-bed6-1dd240ca13d1" returned: 0 in 0.254s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-318ebb95-4169-4bd9-936d-6339f5097bd6 tempest-CinderUnicodeTest-300502851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-101ecd0e-b276-468f-9a09-44d540f00265.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:40 devstack sudo[105226]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-279d0d4c-a182-4056-8fe4-26eca7d4881c tempest-VolumeImageDependencyTests-1226837158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-46db7e4d-7cb6-441e-8e93-13d804a99975" returned: 0 in 0.251s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:40 devstack sudo[105230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-101ecd0e-b276-468f-9a09-44d540f00265.info
Jul 14 16:41:40 devstack sudo[105230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:40 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-279d0d4c-a182-4056-8fe4-26eca7d4881c tempest-VolumeImageDependencyTests-1226837158 None] Lock "cinder-quobyte-46db7e4d-7cb6-441e-8e93-13d804a99975" released by "delete_volume" :: held 1.085s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:41:40 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-279d0d4c-a182-4056-8fe4-26eca7d4881c tempest-VolumeImageDependencyTests-1226837158 None] Created reservations ['94f7824e-6469-446a-9941-7e6c79d9bbf8', '77387c0b-f9fd-48cb-99ef-cf1397a0d538', '9c2e012d-d2c2-425c-9bbd-3f874167f7e4', '1f5e40cf-1eb6-4975-aa8e-fb07d9c8a5a1'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:41:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-279d0d4c-a182-4056-8fe4-26eca7d4881c tempest-VolumeImageDependencyTests-1226837158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-279d0d4c-a182-4056-8fe4-26eca7d4881c tempest-VolumeImageDependencyTests-1226837158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:40 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-279d0d4c-a182-4056-8fe4-26eca7d4881c tempest-VolumeImageDependencyTests-1226837158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:41:40 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-279d0d4c-a182-4056-8fe4-26eca7d4881c tempest-VolumeImageDependencyTests-1226837158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:41:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-279d0d4c-a182-4056-8fe4-26eca7d4881c tempest-VolumeImageDependencyTests-1226837158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-279d0d4c-a182-4056-8fe4-26eca7d4881c tempest-VolumeImageDependencyTests-1226837158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:40 devstack sudo[105232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:41:40 devstack sudo[105232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:40 devstack sudo[105230]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-318ebb95-4169-4bd9-936d-6339f5097bd6 tempest-CinderUnicodeTest-300502851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-101ecd0e-b276-468f-9a09-44d540f00265.info" returned: 0 in 0.265s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:40 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-318ebb95-4169-4bd9-936d-6339f5097bd6 tempest-CinderUnicodeTest-300502851 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-101ecd0e-b276-468f-9a09-44d540f00265.info is being set with open permissions: ugo+rw
Jul 14 16:41:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-318ebb95-4169-4bd9-936d-6339f5097bd6 tempest-CinderUnicodeTest-300502851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-101ecd0e-b276-468f-9a09-44d540f00265.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:40 devstack sudo[105235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-101ecd0e-b276-468f-9a09-44d540f00265.info
Jul 14 16:41:40 devstack sudo[105235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:40 devstack sudo[105232]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-279d0d4c-a182-4056-8fe4-26eca7d4881c tempest-VolumeImageDependencyTests-1226837158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.260s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:40 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-279d0d4c-a182-4056-8fe4-26eca7d4881c tempest-VolumeImageDependencyTests-1226837158 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:41:40 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-279d0d4c-a182-4056-8fe4-26eca7d4881c tempest-VolumeImageDependencyTests-1226837158 None] Deleted volume successfully.
Jul 14 16:41:40 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-279d0d4c-a182-4056-8fe4-26eca7d4881c tempest-VolumeImageDependencyTests-1226837158 None] Lock "cinder-46db7e4d-7cb6-441e-8e93-13d804a99975-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:41:40 devstack sudo[105235]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-318ebb95-4169-4bd9-936d-6339f5097bd6 tempest-CinderUnicodeTest-300502851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-101ecd0e-b276-468f-9a09-44d540f00265.info" returned: 0 in 0.265s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-318ebb95-4169-4bd9-936d-6339f5097bd6 tempest-CinderUnicodeTest-300502851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.158s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-7d8ee10a-65a7-426c-a91d-7b2a93491fb8 tempest-VolumeDependencyTests-307173949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.689s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:40 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-7d8ee10a-65a7-426c-a91d-7b2a93491fb8 tempest-VolumeDependencyTests-307173949 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:41:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1983461905',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=967743ea-8490-465b-8b46-a4ac4168240f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='682f0e7fd10645918b3b86c9ba18e745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:41:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:41:39Z,use_quota=True,user_id='30ec843111194d99bafe51fae263e352',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:41:40 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-7d8ee10a-65a7-426c-a91d-7b2a93491fb8 tempest-VolumeDependencyTests-307173949 None] Creating volume 967743ea-8490-465b-8b46-a4ac4168240f {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:41:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-7d8ee10a-65a7-426c-a91d-7b2a93491fb8 tempest-VolumeDependencyTests-307173949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-7d8ee10a-65a7-426c-a91d-7b2a93491fb8 tempest-VolumeDependencyTests-307173949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:40 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-7d8ee10a-65a7-426c-a91d-7b2a93491fb8 tempest-VolumeDependencyTests-307173949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:41:40 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-7d8ee10a-65a7-426c-a91d-7b2a93491fb8 tempest-VolumeDependencyTests-307173949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:41:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-7d8ee10a-65a7-426c-a91d-7b2a93491fb8 tempest-VolumeDependencyTests-307173949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:40 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-7d8ee10a-65a7-426c-a91d-7b2a93491fb8 tempest-VolumeDependencyTests-307173949 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:41:40 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-7d8ee10a-65a7-426c-a91d-7b2a93491fb8 tempest-VolumeDependencyTests-307173949 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:41:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7d8ee10a-65a7-426c-a91d-7b2a93491fb8 tempest-VolumeDependencyTests-307173949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-967743ea-8490-465b-8b46-a4ac4168240f 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:40 devstack sudo[105239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-967743ea-8490-465b-8b46-a4ac4168240f 1073741824
Jul 14 16:41:40 devstack sudo[105239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:40 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-318ebb95-4169-4bd9-936d-6339f5097bd6 tempest-CinderUnicodeTest-300502851 None] Create snapshot completed successfully
Jul 14 16:41:41 devstack sudo[105239]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7d8ee10a-65a7-426c-a91d-7b2a93491fb8 tempest-VolumeDependencyTests-307173949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-967743ea-8490-465b-8b46-a4ac4168240f 1073741824" returned: 0 in 0.428s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7d8ee10a-65a7-426c-a91d-7b2a93491fb8 tempest-VolumeDependencyTests-307173949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-967743ea-8490-465b-8b46-a4ac4168240f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:41 devstack sudo[105244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-967743ea-8490-465b-8b46-a4ac4168240f
Jul 14 16:41:41 devstack sudo[105244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:41 devstack sudo[105244]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7d8ee10a-65a7-426c-a91d-7b2a93491fb8 tempest-VolumeDependencyTests-307173949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-967743ea-8490-465b-8b46-a4ac4168240f" returned: 0 in 0.264s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:41 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-7d8ee10a-65a7-426c-a91d-7b2a93491fb8 tempest-VolumeDependencyTests-307173949 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:41:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-7d8ee10a-65a7-426c-a91d-7b2a93491fb8 tempest-VolumeDependencyTests-307173949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ecf092c1-3298-4e3a-9add-03d0f72e1f43 tempest-ProjectReaderTests-1127203843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.156s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:41 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ecf092c1-3298-4e3a-9add-03d0f72e1f43 tempest-ProjectReaderTests-1127203843 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:41:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-23276431',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4736ad83-dfb5-471d-a894-e8c41f362e31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='883944e7bf4f4b4dbc774e64e3e27858',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:41:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:41:39Z,use_quota=True,user_id='edcf2b7f48504051a3973d82e7b0fa86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:41:41 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-ecf092c1-3298-4e3a-9add-03d0f72e1f43 tempest-ProjectReaderTests-1127203843 None] Creating volume 4736ad83-dfb5-471d-a894-e8c41f362e31 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:41:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ecf092c1-3298-4e3a-9add-03d0f72e1f43 tempest-ProjectReaderTests-1127203843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ecf092c1-3298-4e3a-9add-03d0f72e1f43 tempest-ProjectReaderTests-1127203843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:41 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ecf092c1-3298-4e3a-9add-03d0f72e1f43 tempest-ProjectReaderTests-1127203843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:41:41 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ecf092c1-3298-4e3a-9add-03d0f72e1f43 tempest-ProjectReaderTests-1127203843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:41:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ecf092c1-3298-4e3a-9add-03d0f72e1f43 tempest-ProjectReaderTests-1127203843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:41 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ecf092c1-3298-4e3a-9add-03d0f72e1f43 tempest-ProjectReaderTests-1127203843 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:41:41 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-ecf092c1-3298-4e3a-9add-03d0f72e1f43 tempest-ProjectReaderTests-1127203843 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:41:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ecf092c1-3298-4e3a-9add-03d0f72e1f43 tempest-ProjectReaderTests-1127203843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4736ad83-dfb5-471d-a894-e8c41f362e31 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:41 devstack sudo[105247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4736ad83-dfb5-471d-a894-e8c41f362e31 1073741824
Jul 14 16:41:41 devstack sudo[105247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-7d8ee10a-65a7-426c-a91d-7b2a93491fb8 tempest-VolumeDependencyTests-307173949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33399172-a216-487f-8108-5389c3ee8860) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-967743ea-8490-465b-8b46-a4ac4168240f', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-7d8ee10a-65a7-426c-a91d-7b2a93491fb8 tempest-VolumeDependencyTests-307173949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f225565-10b6-4c61-a3fa-401cd01b9044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:41 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-7d8ee10a-65a7-426c-a91d-7b2a93491fb8 tempest-VolumeDependencyTests-307173949 None] Volume volume-967743ea-8490-465b-8b46-a4ac4168240f (967743ea-8490-465b-8b46-a4ac4168240f): created successfully
Jul 14 16:41:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-7d8ee10a-65a7-426c-a91d-7b2a93491fb8 tempest-VolumeDependencyTests-307173949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f225565-10b6-4c61-a3fa-401cd01b9044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-7d8ee10a-65a7-426c-a91d-7b2a93491fb8 tempest-VolumeDependencyTests-307173949 None] Flow 'volume_create_manager' (8265f2b7-b730-40c4-b22a-101d9290c70a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:41:41 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-7d8ee10a-65a7-426c-a91d-7b2a93491fb8 tempest-VolumeDependencyTests-307173949 None] Created volume successfully.
Jul 14 16:41:41 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6d2d9029-dac6-4de3-bb0f-6b5ba0020214 tempest-CinderUnicodeTest-300502851 None] Acquiring lock "cinder-49d40350-f04a-4c0d-bed6-1dd240ca13d1-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:41:42 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6d2d9029-dac6-4de3-bb0f-6b5ba0020214 tempest-CinderUnicodeTest-300502851 None] Lock "cinder-49d40350-f04a-4c0d-bed6-1dd240ca13d1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:41:42 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6d2d9029-dac6-4de3-bb0f-6b5ba0020214 tempest-CinderUnicodeTest-300502851 None] Acquiring lock "cinder-quobyte-101ecd0e-b276-468f-9a09-44d540f00265" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:41:42 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6d2d9029-dac6-4de3-bb0f-6b5ba0020214 tempest-CinderUnicodeTest-300502851 None] Lock "cinder-quobyte-101ecd0e-b276-468f-9a09-44d540f00265" acquired by "delete_snapshot" :: waited 0.083s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:41:42 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6d2d9029-dac6-4de3-bb0f-6b5ba0020214 tempest-CinderUnicodeTest-300502851 None] Acquiring lock "cinder-quobyte-49d40350-f04a-4c0d-bed6-1dd240ca13d1" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:41:42 devstack sudo[105247]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ecf092c1-3298-4e3a-9add-03d0f72e1f43 tempest-ProjectReaderTests-1127203843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4736ad83-dfb5-471d-a894-e8c41f362e31 1073741824" returned: 0 in 0.557s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:42 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6d2d9029-dac6-4de3-bb0f-6b5ba0020214 tempest-CinderUnicodeTest-300502851 None] Lock "cinder-quobyte-49d40350-f04a-4c0d-bed6-1dd240ca13d1" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:41:42 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-6d2d9029-dac6-4de3-bb0f-6b5ba0020214 tempest-CinderUnicodeTest-300502851 None] Deleting offline snapshot 49d40350-f04a-4c0d-bed6-1dd240ca13d1 of volume 101ecd0e-b276-468f-9a09-44d540f00265 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 16:41:42 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-6d2d9029-dac6-4de3-bb0f-6b5ba0020214 tempest-CinderUnicodeTest-300502851 None] snapshot_file for this snap is: volume-101ecd0e-b276-468f-9a09-44d540f00265.49d40350-f04a-4c0d-bed6-1dd240ca13d1 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 16:41:42 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[0510b036-d73e-4bb0-ae72-5eeffb9b79b7]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:41:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6d2d9029-dac6-4de3-bb0f-6b5ba0020214 tempest-CinderUnicodeTest-300502851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-101ecd0e-b276-468f-9a09-44d540f00265.49d40350-f04a-4c0d-bed6-1dd240ca13d1 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ecf092c1-3298-4e3a-9add-03d0f72e1f43 tempest-ProjectReaderTests-1127203843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4736ad83-dfb5-471d-a894-e8c41f362e31 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:42 devstack sudo[105253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4736ad83-dfb5-471d-a894-e8c41f362e31
Jul 14 16:41:42 devstack sudo[105253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:42 devstack sudo[105252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-101ecd0e-b276-468f-9a09-44d540f00265.49d40350-f04a-4c0d-bed6-1dd240ca13d1
Jul 14 16:41:42 devstack sudo[105252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1b5133c1-f109-489b-90b8-5716e58e3299 tempest-VolumeDependencyTests-307173949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:42 devstack sudo[105253]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ecf092c1-3298-4e3a-9add-03d0f72e1f43 tempest-ProjectReaderTests-1127203843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4736ad83-dfb5-471d-a894-e8c41f362e31" returned: 0 in 0.342s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:42 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ecf092c1-3298-4e3a-9add-03d0f72e1f43 tempest-ProjectReaderTests-1127203843 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:41:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ecf092c1-3298-4e3a-9add-03d0f72e1f43 tempest-ProjectReaderTests-1127203843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1b5133c1-f109-489b-90b8-5716e58e3299 tempest-VolumeDependencyTests-307173949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.064s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:42 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-1b5133c1-f109-489b-90b8-5716e58e3299 tempest-VolumeDependencyTests-307173949 None] Creating offline snapshot d39583e0-4f8e-4b6b-9457-1aafd48a67dc of volume 967743ea-8490-465b-8b46-a4ac4168240f {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 16:41:42 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ecf092c1-3298-4e3a-9add-03d0f72e1f43 tempest-ProjectReaderTests-1127203843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2517121e-facc-412a-ba96-9731a12c4592) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4736ad83-dfb5-471d-a894-e8c41f362e31', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:42 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ecf092c1-3298-4e3a-9add-03d0f72e1f43 tempest-ProjectReaderTests-1127203843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6ca4f0f-c336-45a3-a679-454a90322976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:42 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb4e1d7-5e5b-4bc0-8596-4a91d0076772]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:41:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1b5133c1-f109-489b-90b8-5716e58e3299 tempest-VolumeDependencyTests-307173949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-967743ea-8490-465b-8b46-a4ac4168240f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:42 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-ecf092c1-3298-4e3a-9add-03d0f72e1f43 tempest-ProjectReaderTests-1127203843 None] Volume volume-4736ad83-dfb5-471d-a894-e8c41f362e31 (4736ad83-dfb5-471d-a894-e8c41f362e31): created successfully
Jul 14 16:41:42 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ecf092c1-3298-4e3a-9add-03d0f72e1f43 tempest-ProjectReaderTests-1127203843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6ca4f0f-c336-45a3-a679-454a90322976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:42 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ecf092c1-3298-4e3a-9add-03d0f72e1f43 tempest-ProjectReaderTests-1127203843 None] Flow 'volume_create_manager' (66a30534-d4b9-4ae2-acbd-8497bd409f0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:41:42 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-ecf092c1-3298-4e3a-9add-03d0f72e1f43 tempest-ProjectReaderTests-1127203843 None] Created volume successfully.
Jul 14 16:41:42 devstack sudo[105252]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6d2d9029-dac6-4de3-bb0f-6b5ba0020214 tempest-CinderUnicodeTest-300502851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-101ecd0e-b276-468f-9a09-44d540f00265.49d40350-f04a-4c0d-bed6-1dd240ca13d1" returned: 0 in 0.518s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:42 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-6d2d9029-dac6-4de3-bb0f-6b5ba0020214 tempest-CinderUnicodeTest-300502851 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-101ecd0e-b276-468f-9a09-44d540f00265(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 16:41:42 devstack sudo[105258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-967743ea-8490-465b-8b46-a4ac4168240f
Jul 14 16:41:42 devstack sudo[105258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:42 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ccfca9-ce20-4c1f-9b60-1b656e86ce27]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:41:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6d2d9029-dac6-4de3-bb0f-6b5ba0020214 tempest-CinderUnicodeTest-300502851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-101ecd0e-b276-468f-9a09-44d540f00265 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:42 devstack sudo[105262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-101ecd0e-b276-468f-9a09-44d540f00265
Jul 14 16:41:42 devstack sudo[105262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:43 devstack sudo[105258]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1b5133c1-f109-489b-90b8-5716e58e3299 tempest-VolumeDependencyTests-307173949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-967743ea-8490-465b-8b46-a4ac4168240f" returned: 0 in 0.421s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1b5133c1-f109-489b-90b8-5716e58e3299 tempest-VolumeDependencyTests-307173949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-967743ea-8490-465b-8b46-a4ac4168240f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-967743ea-8490-465b-8b46-a4ac4168240f.d39583e0-4f8e-4b6b-9457-1aafd48a67dc 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:43 devstack sudo[105267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-967743ea-8490-465b-8b46-a4ac4168240f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-967743ea-8490-465b-8b46-a4ac4168240f.d39583e0-4f8e-4b6b-9457-1aafd48a67dc 1G
Jul 14 16:41:43 devstack sudo[105267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:43 devstack sudo[105262]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6d2d9029-dac6-4de3-bb0f-6b5ba0020214 tempest-CinderUnicodeTest-300502851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-101ecd0e-b276-468f-9a09-44d540f00265" returned: 0 in 0.448s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6d2d9029-dac6-4de3-bb0f-6b5ba0020214 tempest-CinderUnicodeTest-300502851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-101ecd0e-b276-468f-9a09-44d540f00265.49d40350-f04a-4c0d-bed6-1dd240ca13d1 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:43 devstack sudo[105272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-101ecd0e-b276-468f-9a09-44d540f00265.49d40350-f04a-4c0d-bed6-1dd240ca13d1
Jul 14 16:41:43 devstack sudo[105272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:43 devstack sudo[105267]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1b5133c1-f109-489b-90b8-5716e58e3299 tempest-VolumeDependencyTests-307173949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-967743ea-8490-465b-8b46-a4ac4168240f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-967743ea-8490-465b-8b46-a4ac4168240f.d39583e0-4f8e-4b6b-9457-1aafd48a67dc 1G" returned: 0 in 0.486s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1b5133c1-f109-489b-90b8-5716e58e3299 tempest-VolumeDependencyTests-307173949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-967743ea-8490-465b-8b46-a4ac4168240f -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-967743ea-8490-465b-8b46-a4ac4168240f.d39583e0-4f8e-4b6b-9457-1aafd48a67dc {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:43 devstack sudo[105280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-967743ea-8490-465b-8b46-a4ac4168240f -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-967743ea-8490-465b-8b46-a4ac4168240f.d39583e0-4f8e-4b6b-9457-1aafd48a67dc
Jul 14 16:41:43 devstack sudo[105280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:43 devstack sudo[105272]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6d2d9029-dac6-4de3-bb0f-6b5ba0020214 tempest-CinderUnicodeTest-300502851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-101ecd0e-b276-468f-9a09-44d540f00265.49d40350-f04a-4c0d-bed6-1dd240ca13d1" returned: 0 in 0.441s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6d2d9029-dac6-4de3-bb0f-6b5ba0020214 tempest-CinderUnicodeTest-300502851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-101ecd0e-b276-468f-9a09-44d540f00265.49d40350-f04a-4c0d-bed6-1dd240ca13d1 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:43 devstack sudo[105284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-101ecd0e-b276-468f-9a09-44d540f00265.49d40350-f04a-4c0d-bed6-1dd240ca13d1
Jul 14 16:41:43 devstack sudo[105284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5974aecb-61b5-4a69-96c0-f4a63b537575 tempest-ProjectReaderTests-1127203843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:43 devstack sudo[105280]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1b5133c1-f109-489b-90b8-5716e58e3299 tempest-VolumeDependencyTests-307173949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-967743ea-8490-465b-8b46-a4ac4168240f -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-967743ea-8490-465b-8b46-a4ac4168240f.d39583e0-4f8e-4b6b-9457-1aafd48a67dc" returned: 0 in 0.394s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:43 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-1b5133c1-f109-489b-90b8-5716e58e3299 tempest-VolumeDependencyTests-307173949 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-967743ea-8490-465b-8b46-a4ac4168240f.d39583e0-4f8e-4b6b-9457-1aafd48a67dc is being set with open permissions: ugo+rw
Jul 14 16:41:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1b5133c1-f109-489b-90b8-5716e58e3299 tempest-VolumeDependencyTests-307173949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-967743ea-8490-465b-8b46-a4ac4168240f.d39583e0-4f8e-4b6b-9457-1aafd48a67dc {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:43 devstack sudo[105290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-967743ea-8490-465b-8b46-a4ac4168240f.d39583e0-4f8e-4b6b-9457-1aafd48a67dc
Jul 14 16:41:43 devstack sudo[105290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:43 devstack sudo[105284]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6d2d9029-dac6-4de3-bb0f-6b5ba0020214 tempest-CinderUnicodeTest-300502851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-101ecd0e-b276-468f-9a09-44d540f00265.49d40350-f04a-4c0d-bed6-1dd240ca13d1" returned: 0 in 0.332s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:44 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6d2d9029-dac6-4de3-bb0f-6b5ba0020214 tempest-CinderUnicodeTest-300502851 None] Lock "cinder-quobyte-49d40350-f04a-4c0d-bed6-1dd240ca13d1" released by "_delete_snapshot" :: held 1.898s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:41:44 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6d2d9029-dac6-4de3-bb0f-6b5ba0020214 tempest-CinderUnicodeTest-300502851 None] Lock "cinder-quobyte-101ecd0e-b276-468f-9a09-44d540f00265" released by "delete_snapshot" :: held 1.926s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:41:44 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-6d2d9029-dac6-4de3-bb0f-6b5ba0020214 tempest-CinderUnicodeTest-300502851 None] Created reservations ['0884c958-0331-45e6-861c-a3fee3658991', '5fd04ff5-3db0-46c6-aa67-b05f61b806f9', '34b47d30-290c-4d46-b48e-b2819140f478', '3f9e13a7-fd2d-405b-b05c-1b7830dbae18'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:41:44 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-6d2d9029-dac6-4de3-bb0f-6b5ba0020214 tempest-CinderUnicodeTest-300502851 None] Delete snapshot completed successfully.
Jul 14 16:41:44 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6d2d9029-dac6-4de3-bb0f-6b5ba0020214 tempest-CinderUnicodeTest-300502851 None] Lock "cinder-49d40350-f04a-4c0d-bed6-1dd240ca13d1-delete_snapshot" released by "delete_snapshot" :: held 2.147s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:41:44 devstack sudo[105290]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1b5133c1-f109-489b-90b8-5716e58e3299 tempest-VolumeDependencyTests-307173949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-967743ea-8490-465b-8b46-a4ac4168240f.d39583e0-4f8e-4b6b-9457-1aafd48a67dc" returned: 0 in 0.299s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:44 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c3dd1bca-3ba1-4536-ac78-a87ba10d0927 tempest-CinderUnicodeTest-300502851 None] Acquiring lock "cinder-101ecd0e-b276-468f-9a09-44d540f00265-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:41:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1b5133c1-f109-489b-90b8-5716e58e3299 tempest-VolumeDependencyTests-307173949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-967743ea-8490-465b-8b46-a4ac4168240f.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:44 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c3dd1bca-3ba1-4536-ac78-a87ba10d0927 tempest-CinderUnicodeTest-300502851 None] Lock "cinder-101ecd0e-b276-468f-9a09-44d540f00265-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:41:44 devstack sudo[105293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-967743ea-8490-465b-8b46-a4ac4168240f.info
Jul 14 16:41:44 devstack sudo[105293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:44 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c3dd1bca-3ba1-4536-ac78-a87ba10d0927 tempest-CinderUnicodeTest-300502851 None] Acquiring lock "cinder-quobyte-101ecd0e-b276-468f-9a09-44d540f00265" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:41:44 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c3dd1bca-3ba1-4536-ac78-a87ba10d0927 tempest-CinderUnicodeTest-300502851 None] Lock "cinder-quobyte-101ecd0e-b276-468f-9a09-44d540f00265" acquired by "delete_volume" :: waited 0.021s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:41:44 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb23e955-6bce-4934-9d2f-7d3df3519b02]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:41:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c3dd1bca-3ba1-4536-ac78-a87ba10d0927 tempest-CinderUnicodeTest-300502851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-101ecd0e-b276-468f-9a09-44d540f00265 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:44 devstack sudo[105295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-101ecd0e-b276-468f-9a09-44d540f00265
Jul 14 16:41:44 devstack sudo[105295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:44 devstack sudo[105293]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1b5133c1-f109-489b-90b8-5716e58e3299 tempest-VolumeDependencyTests-307173949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-967743ea-8490-465b-8b46-a4ac4168240f.info" returned: 0 in 0.310s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:44 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-1b5133c1-f109-489b-90b8-5716e58e3299 tempest-VolumeDependencyTests-307173949 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-967743ea-8490-465b-8b46-a4ac4168240f.info is being set with open permissions: ugo+rw
Jul 14 16:41:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1b5133c1-f109-489b-90b8-5716e58e3299 tempest-VolumeDependencyTests-307173949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-967743ea-8490-465b-8b46-a4ac4168240f.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:44 devstack sudo[105298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-967743ea-8490-465b-8b46-a4ac4168240f.info
Jul 14 16:41:44 devstack sudo[105298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:44 devstack sudo[105295]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c3dd1bca-3ba1-4536-ac78-a87ba10d0927 tempest-CinderUnicodeTest-300502851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-101ecd0e-b276-468f-9a09-44d540f00265" returned: 0 in 0.397s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c3dd1bca-3ba1-4536-ac78-a87ba10d0927 tempest-CinderUnicodeTest-300502851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-101ecd0e-b276-468f-9a09-44d540f00265 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:44 devstack sudo[105303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-101ecd0e-b276-468f-9a09-44d540f00265
Jul 14 16:41:44 devstack sudo[105303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:44 devstack sudo[105298]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1b5133c1-f109-489b-90b8-5716e58e3299 tempest-VolumeDependencyTests-307173949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-967743ea-8490-465b-8b46-a4ac4168240f.info" returned: 0 in 0.294s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1b5133c1-f109-489b-90b8-5716e58e3299 tempest-VolumeDependencyTests-307173949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.314s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5974aecb-61b5-4a69-96c0-f4a63b537575 tempest-ProjectReaderTests-1127203843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.079s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:44 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-5974aecb-61b5-4a69-96c0-f4a63b537575 tempest-ProjectReaderTests-1127203843 None] Creating offline snapshot 2c2283c1-57c3-4a6f-bfdf-ed1eaa22be12 of volume 4736ad83-dfb5-471d-a894-e8c41f362e31 {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 16:41:44 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-1b5133c1-f109-489b-90b8-5716e58e3299 tempest-VolumeDependencyTests-307173949 None] Create snapshot completed successfully
Jul 14 16:41:44 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[c34fd6d1-27c6-44c0-a9eb-a807150605fc]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:41:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5974aecb-61b5-4a69-96c0-f4a63b537575 tempest-ProjectReaderTests-1127203843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4736ad83-dfb5-471d-a894-e8c41f362e31 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:45 devstack sudo[105306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4736ad83-dfb5-471d-a894-e8c41f362e31
Jul 14 16:41:45 devstack sudo[105306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:45 devstack sudo[105303]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c3dd1bca-3ba1-4536-ac78-a87ba10d0927 tempest-CinderUnicodeTest-300502851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-101ecd0e-b276-468f-9a09-44d540f00265" returned: 0 in 0.290s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:45 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c3dd1bca-3ba1-4536-ac78-a87ba10d0927 tempest-CinderUnicodeTest-300502851 None] Lock "cinder-quobyte-101ecd0e-b276-468f-9a09-44d540f00265" released by "delete_volume" :: held 0.774s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:41:45 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-c3dd1bca-3ba1-4536-ac78-a87ba10d0927 tempest-CinderUnicodeTest-300502851 None] Created reservations ['5ee5012f-6b32-4128-9cc6-b9b0d54e5895', '5867d14f-33e2-4602-959b-781ec97a792d', 'eb641cf7-ae58-4b90-b75c-95e04038676e', '32a794dc-ffa8-4973-843c-0634343a9ce9'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:41:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c3dd1bca-3ba1-4536-ac78-a87ba10d0927 tempest-CinderUnicodeTest-300502851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c3dd1bca-3ba1-4536-ac78-a87ba10d0927 tempest-CinderUnicodeTest-300502851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:45 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-c3dd1bca-3ba1-4536-ac78-a87ba10d0927 tempest-CinderUnicodeTest-300502851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:41:45 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-c3dd1bca-3ba1-4536-ac78-a87ba10d0927 tempest-CinderUnicodeTest-300502851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:41:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c3dd1bca-3ba1-4536-ac78-a87ba10d0927 tempest-CinderUnicodeTest-300502851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c3dd1bca-3ba1-4536-ac78-a87ba10d0927 tempest-CinderUnicodeTest-300502851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:45 devstack sudo[105309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:41:45 devstack sudo[105309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:45 devstack sudo[105306]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5974aecb-61b5-4a69-96c0-f4a63b537575 tempest-ProjectReaderTests-1127203843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4736ad83-dfb5-471d-a894-e8c41f362e31" returned: 0 in 0.489s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5974aecb-61b5-4a69-96c0-f4a63b537575 tempest-ProjectReaderTests-1127203843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4736ad83-dfb5-471d-a894-e8c41f362e31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4736ad83-dfb5-471d-a894-e8c41f362e31.2c2283c1-57c3-4a6f-bfdf-ed1eaa22be12 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:45 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-db6a5506-43a7-4608-a599-5b97cb5a80c9 tempest-CinderUnicodeTest-300502851 None] Acquiring lock "cinder-c49a25f1-074e-4e84-a3a7-a5c1ffb45cba-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:41:45 devstack sudo[105314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4736ad83-dfb5-471d-a894-e8c41f362e31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4736ad83-dfb5-471d-a894-e8c41f362e31.2c2283c1-57c3-4a6f-bfdf-ed1eaa22be12 1G
Jul 14 16:41:45 devstack sudo[105314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:45 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-db6a5506-43a7-4608-a599-5b97cb5a80c9 tempest-CinderUnicodeTest-300502851 None] Lock "cinder-c49a25f1-074e-4e84-a3a7-a5c1ffb45cba-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:41:45 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-db6a5506-43a7-4608-a599-5b97cb5a80c9 tempest-CinderUnicodeTest-300502851 None] Acquiring lock "cinder-quobyte-c49a25f1-074e-4e84-a3a7-a5c1ffb45cba" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:41:45 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-db6a5506-43a7-4608-a599-5b97cb5a80c9 tempest-CinderUnicodeTest-300502851 None] Lock "cinder-quobyte-c49a25f1-074e-4e84-a3a7-a5c1ffb45cba" acquired by "delete_volume" :: waited 0.024s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:41:45 devstack sudo[105309]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c3dd1bca-3ba1-4536-ac78-a87ba10d0927 tempest-CinderUnicodeTest-300502851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.361s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:45 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-c3dd1bca-3ba1-4536-ac78-a87ba10d0927 tempest-CinderUnicodeTest-300502851 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:41:45 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-96f71784-8194-4dbd-9107-bbdf5fe64c8e tempest-ProjectMemberTests-1242181671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:41:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-96f71784-8194-4dbd-9107-bbdf5fe64c8e tempest-ProjectMemberTests-1242181671 None] Flow 'volume_create_manager' (cfeb151c-607f-41ba-b4b9-fdd88a76780f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:41:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-96f71784-8194-4dbd-9107-bbdf5fe64c8e tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe103613-eda3-401a-99a7-e836d9759f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:45 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec4def6c-d6b9-42d8-9822-b55134bbd373]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:41:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-db6a5506-43a7-4608-a599-5b97cb5a80c9 tempest-CinderUnicodeTest-300502851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c49a25f1-074e-4e84-a3a7-a5c1ffb45cba {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:45 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-c3dd1bca-3ba1-4536-ac78-a87ba10d0927 tempest-CinderUnicodeTest-300502851 None] Deleted volume successfully.
Jul 14 16:41:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-96f71784-8194-4dbd-9107-bbdf5fe64c8e tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe103613-eda3-401a-99a7-e836d9759f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:41:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1041613306',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afd7ab5b-70b4-4887-a8aa-71e0c2b355ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dfc230bd6d54b87b4b187751f9a7039',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:41:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:41:45Z,use_quota=True,user_id='68f1fe3510e3473e91988f26916b8e51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-96f71784-8194-4dbd-9107-bbdf5fe64c8e tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb948d8e-49b6-4015-a2cd-03c56842eb51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-96f71784-8194-4dbd-9107-bbdf5fe64c8e tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb948d8e-49b6-4015-a2cd-03c56842eb51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-96f71784-8194-4dbd-9107-bbdf5fe64c8e tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b6448ed-2e63-4f2a-8ea8-71ce982cc552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-96f71784-8194-4dbd-9107-bbdf5fe64c8e tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b6448ed-2e63-4f2a-8ea8-71ce982cc552) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afd7ab5b-70b4-4887-a8aa-71e0c2b355ac', 'volume_name': 'volume-afd7ab5b-70b4-4887-a8aa-71e0c2b355ac', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-96f71784-8194-4dbd-9107-bbdf5fe64c8e tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (217ac3cb-be68-42da-9c64-8fd0c151837c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-96f71784-8194-4dbd-9107-bbdf5fe64c8e tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (217ac3cb-be68-42da-9c64-8fd0c151837c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-96f71784-8194-4dbd-9107-bbdf5fe64c8e tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c9092a4-d6ea-4c26-9844-717d32975a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:45 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-96f71784-8194-4dbd-9107-bbdf5fe64c8e tempest-ProjectMemberTests-1242181671 None] Volume afd7ab5b-70b4-4887-a8aa-71e0c2b355ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afd7ab5b-70b4-4887-a8aa-71e0c2b355ac', 'volume_size': 1}
Jul 14 16:41:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-96f71784-8194-4dbd-9107-bbdf5fe64c8e tempest-ProjectMemberTests-1242181671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:45 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c3dd1bca-3ba1-4536-ac78-a87ba10d0927 tempest-CinderUnicodeTest-300502851 None] Lock "cinder-101ecd0e-b276-468f-9a09-44d540f00265-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:41:45 devstack sudo[105317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c49a25f1-074e-4e84-a3a7-a5c1ffb45cba
Jul 14 16:41:45 devstack sudo[105317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:45 devstack sudo[105314]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5974aecb-61b5-4a69-96c0-f4a63b537575 tempest-ProjectReaderTests-1127203843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4736ad83-dfb5-471d-a894-e8c41f362e31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4736ad83-dfb5-471d-a894-e8c41f362e31.2c2283c1-57c3-4a6f-bfdf-ed1eaa22be12 1G" returned: 0 in 0.538s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5974aecb-61b5-4a69-96c0-f4a63b537575 tempest-ProjectReaderTests-1127203843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4736ad83-dfb5-471d-a894-e8c41f362e31 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4736ad83-dfb5-471d-a894-e8c41f362e31.2c2283c1-57c3-4a6f-bfdf-ed1eaa22be12 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:45 devstack sudo[105325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4736ad83-dfb5-471d-a894-e8c41f362e31 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4736ad83-dfb5-471d-a894-e8c41f362e31.2c2283c1-57c3-4a6f-bfdf-ed1eaa22be12
Jul 14 16:41:45 devstack sudo[105325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:46 devstack sudo[105317]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-db6a5506-43a7-4608-a599-5b97cb5a80c9 tempest-CinderUnicodeTest-300502851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c49a25f1-074e-4e84-a3a7-a5c1ffb45cba" returned: 0 in 0.432s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-db6a5506-43a7-4608-a599-5b97cb5a80c9 tempest-CinderUnicodeTest-300502851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c49a25f1-074e-4e84-a3a7-a5c1ffb45cba {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:46 devstack sudo[105328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c49a25f1-074e-4e84-a3a7-a5c1ffb45cba
Jul 14 16:41:46 devstack sudo[105328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:46 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-20b8ea14-23bd-47ae-a1a5-290e4a86769f tempest-VolumeDependencyTests-307173949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:41:46 devstack sudo[105325]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5974aecb-61b5-4a69-96c0-f4a63b537575 tempest-ProjectReaderTests-1127203843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4736ad83-dfb5-471d-a894-e8c41f362e31 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4736ad83-dfb5-471d-a894-e8c41f362e31.2c2283c1-57c3-4a6f-bfdf-ed1eaa22be12" returned: 0 in 0.336s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:46 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-5974aecb-61b5-4a69-96c0-f4a63b537575 tempest-ProjectReaderTests-1127203843 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4736ad83-dfb5-471d-a894-e8c41f362e31.2c2283c1-57c3-4a6f-bfdf-ed1eaa22be12 is being set with open permissions: ugo+rw
Jul 14 16:41:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5974aecb-61b5-4a69-96c0-f4a63b537575 tempest-ProjectReaderTests-1127203843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4736ad83-dfb5-471d-a894-e8c41f362e31.2c2283c1-57c3-4a6f-bfdf-ed1eaa22be12 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:46 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-20b8ea14-23bd-47ae-a1a5-290e4a86769f tempest-VolumeDependencyTests-307173949 None] Flow 'volume_create_manager' (7f8ca42f-4cf3-4e65-becc-b6b758d87a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:41:46 devstack sudo[105333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4736ad83-dfb5-471d-a894-e8c41f362e31.2c2283c1-57c3-4a6f-bfdf-ed1eaa22be12
Jul 14 16:41:46 devstack sudo[105333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:46 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-20b8ea14-23bd-47ae-a1a5-290e4a86769f tempest-VolumeDependencyTests-307173949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab47baf4-3984-4f3e-a738-f950829fa7ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:46 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-20b8ea14-23bd-47ae-a1a5-290e4a86769f tempest-VolumeDependencyTests-307173949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab47baf4-3984-4f3e-a738-f950829fa7ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:41:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1017170607',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d097c6b-b693-4d0c-b7e2-4fa2c74c8236,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='682f0e7fd10645918b3b86c9ba18e745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:41:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d39583e0-4f8e-4b6b-9457-1aafd48a67dc,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:41:46Z,use_quota=True,user_id='30ec843111194d99bafe51fae263e352',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:46 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-20b8ea14-23bd-47ae-a1a5-290e4a86769f tempest-VolumeDependencyTests-307173949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e456b578-2289-43b5-8199-75129390138f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:46 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-20b8ea14-23bd-47ae-a1a5-290e4a86769f tempest-VolumeDependencyTests-307173949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e456b578-2289-43b5-8199-75129390138f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:46 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-20b8ea14-23bd-47ae-a1a5-290e4a86769f tempest-VolumeDependencyTests-307173949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2809ddc6-6a2b-4426-92e0-2024c434e616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:46 devstack sudo[105328]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:46 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-20b8ea14-23bd-47ae-a1a5-290e4a86769f tempest-VolumeDependencyTests-307173949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2809ddc6-6a2b-4426-92e0-2024c434e616) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8d097c6b-b693-4d0c-b7e2-4fa2c74c8236', 'volume_name': 'volume-8d097c6b-b693-4d0c-b7e2-4fa2c74c8236', 'volume_size': 1, 'snapshot_id': 'd39583e0-4f8e-4b6b-9457-1aafd48a67dc'}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:46 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-20b8ea14-23bd-47ae-a1a5-290e4a86769f tempest-VolumeDependencyTests-307173949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54d88224-8b11-42a1-b06d-ab0020eb7cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:46 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-20b8ea14-23bd-47ae-a1a5-290e4a86769f tempest-VolumeDependencyTests-307173949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54d88224-8b11-42a1-b06d-ab0020eb7cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:46 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-20b8ea14-23bd-47ae-a1a5-290e4a86769f tempest-VolumeDependencyTests-307173949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15b10db5-d3cb-4584-82f9-a2017e3760e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:46 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-20b8ea14-23bd-47ae-a1a5-290e4a86769f tempest-VolumeDependencyTests-307173949 None] Volume 8d097c6b-b693-4d0c-b7e2-4fa2c74c8236: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8d097c6b-b693-4d0c-b7e2-4fa2c74c8236', 'volume_size': 1, 'snapshot_id': 'd39583e0-4f8e-4b6b-9457-1aafd48a67dc'}
Jul 14 16:41:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-db6a5506-43a7-4608-a599-5b97cb5a80c9 tempest-CinderUnicodeTest-300502851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-c49a25f1-074e-4e84-a3a7-a5c1ffb45cba" returned: 0 in 0.318s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-20b8ea14-23bd-47ae-a1a5-290e4a86769f tempest-VolumeDependencyTests-307173949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:46 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-db6a5506-43a7-4608-a599-5b97cb5a80c9 tempest-CinderUnicodeTest-300502851 None] Lock "cinder-quobyte-c49a25f1-074e-4e84-a3a7-a5c1ffb45cba" released by "delete_volume" :: held 0.848s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:41:46 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-db6a5506-43a7-4608-a599-5b97cb5a80c9 tempest-CinderUnicodeTest-300502851 None] Created reservations ['e5536b85-1b2b-40c9-bab9-0e1c01cc686f', 'ed73b230-f6ba-4b9c-86de-cae9d456aa4d', '396549ea-d075-452a-a046-3e2d3a8bcfc2', '2e76224d-cdec-4405-8ee0-d7a0ef0c76df'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:41:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-db6a5506-43a7-4608-a599-5b97cb5a80c9 tempest-CinderUnicodeTest-300502851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-db6a5506-43a7-4608-a599-5b97cb5a80c9 tempest-CinderUnicodeTest-300502851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:46 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-db6a5506-43a7-4608-a599-5b97cb5a80c9 tempest-CinderUnicodeTest-300502851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:41:46 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-db6a5506-43a7-4608-a599-5b97cb5a80c9 tempest-CinderUnicodeTest-300502851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:41:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-db6a5506-43a7-4608-a599-5b97cb5a80c9 tempest-CinderUnicodeTest-300502851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-db6a5506-43a7-4608-a599-5b97cb5a80c9 tempest-CinderUnicodeTest-300502851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:46 devstack sudo[105333]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5974aecb-61b5-4a69-96c0-f4a63b537575 tempest-ProjectReaderTests-1127203843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4736ad83-dfb5-471d-a894-e8c41f362e31.2c2283c1-57c3-4a6f-bfdf-ed1eaa22be12" returned: 0 in 0.282s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:46 devstack sudo[105337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:41:46 devstack sudo[105337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5974aecb-61b5-4a69-96c0-f4a63b537575 tempest-ProjectReaderTests-1127203843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4736ad83-dfb5-471d-a894-e8c41f362e31.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:46 devstack sudo[105339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4736ad83-dfb5-471d-a894-e8c41f362e31.info
Jul 14 16:41:46 devstack sudo[105339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:46 devstack sudo[105337]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-db6a5506-43a7-4608-a599-5b97cb5a80c9 tempest-CinderUnicodeTest-300502851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.246s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:46 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-db6a5506-43a7-4608-a599-5b97cb5a80c9 tempest-CinderUnicodeTest-300502851 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:41:46 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-db6a5506-43a7-4608-a599-5b97cb5a80c9 tempest-CinderUnicodeTest-300502851 None] Deleted volume successfully.
Jul 14 16:41:46 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-db6a5506-43a7-4608-a599-5b97cb5a80c9 tempest-CinderUnicodeTest-300502851 None] Lock "cinder-c49a25f1-074e-4e84-a3a7-a5c1ffb45cba-delete_volume" released by "delete_volume" :: held 1.365s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:41:46 devstack sudo[105339]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5974aecb-61b5-4a69-96c0-f4a63b537575 tempest-ProjectReaderTests-1127203843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4736ad83-dfb5-471d-a894-e8c41f362e31.info" returned: 0 in 0.276s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:46 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-5974aecb-61b5-4a69-96c0-f4a63b537575 tempest-ProjectReaderTests-1127203843 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4736ad83-dfb5-471d-a894-e8c41f362e31.info is being set with open permissions: ugo+rw
Jul 14 16:41:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5974aecb-61b5-4a69-96c0-f4a63b537575 tempest-ProjectReaderTests-1127203843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4736ad83-dfb5-471d-a894-e8c41f362e31.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:46 devstack sudo[105343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4736ad83-dfb5-471d-a894-e8c41f362e31.info
Jul 14 16:41:46 devstack sudo[105343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:47 devstack sudo[105343]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5974aecb-61b5-4a69-96c0-f4a63b537575 tempest-ProjectReaderTests-1127203843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4736ad83-dfb5-471d-a894-e8c41f362e31.info" returned: 0 in 0.253s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5974aecb-61b5-4a69-96c0-f4a63b537575 tempest-ProjectReaderTests-1127203843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.285s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-96f71784-8194-4dbd-9107-bbdf5fe64c8e tempest-ProjectMemberTests-1242181671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.447s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:47 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-96f71784-8194-4dbd-9107-bbdf5fe64c8e tempest-ProjectMemberTests-1242181671 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:41:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1041613306',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afd7ab5b-70b4-4887-a8aa-71e0c2b355ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dfc230bd6d54b87b4b187751f9a7039',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:41:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:41:45Z,use_quota=True,user_id='68f1fe3510e3473e91988f26916b8e51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:41:47 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-96f71784-8194-4dbd-9107-bbdf5fe64c8e tempest-ProjectMemberTests-1242181671 None] Creating volume afd7ab5b-70b4-4887-a8aa-71e0c2b355ac {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:41:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-96f71784-8194-4dbd-9107-bbdf5fe64c8e tempest-ProjectMemberTests-1242181671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-96f71784-8194-4dbd-9107-bbdf5fe64c8e tempest-ProjectMemberTests-1242181671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:47 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-96f71784-8194-4dbd-9107-bbdf5fe64c8e tempest-ProjectMemberTests-1242181671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:41:47 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-96f71784-8194-4dbd-9107-bbdf5fe64c8e tempest-ProjectMemberTests-1242181671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:41:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-96f71784-8194-4dbd-9107-bbdf5fe64c8e tempest-ProjectMemberTests-1242181671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:47 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-96f71784-8194-4dbd-9107-bbdf5fe64c8e tempest-ProjectMemberTests-1242181671 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:41:47 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-96f71784-8194-4dbd-9107-bbdf5fe64c8e tempest-ProjectMemberTests-1242181671 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:41:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-96f71784-8194-4dbd-9107-bbdf5fe64c8e tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-afd7ab5b-70b4-4887-a8aa-71e0c2b355ac 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:47 devstack sudo[105346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-afd7ab5b-70b4-4887-a8aa-71e0c2b355ac 1073741824
Jul 14 16:41:47 devstack sudo[105346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:47 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-5974aecb-61b5-4a69-96c0-f4a63b537575 tempest-ProjectReaderTests-1127203843 None] Create snapshot completed successfully
Jul 14 16:41:47 devstack sudo[105346]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-96f71784-8194-4dbd-9107-bbdf5fe64c8e tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-afd7ab5b-70b4-4887-a8aa-71e0c2b355ac 1073741824" returned: 0 in 0.469s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-96f71784-8194-4dbd-9107-bbdf5fe64c8e tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-afd7ab5b-70b4-4887-a8aa-71e0c2b355ac {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:47 devstack sudo[105352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-afd7ab5b-70b4-4887-a8aa-71e0c2b355ac
Jul 14 16:41:47 devstack sudo[105352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:47 devstack sudo[105352]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-96f71784-8194-4dbd-9107-bbdf5fe64c8e tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-afd7ab5b-70b4-4887-a8aa-71e0c2b355ac" returned: 0 in 0.264s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:47 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-96f71784-8194-4dbd-9107-bbdf5fe64c8e tempest-ProjectMemberTests-1242181671 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:41:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-96f71784-8194-4dbd-9107-bbdf5fe64c8e tempest-ProjectMemberTests-1242181671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-20b8ea14-23bd-47ae-a1a5-290e4a86769f tempest-VolumeDependencyTests-307173949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.542s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:47 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-20b8ea14-23bd-47ae-a1a5-290e4a86769f tempest-VolumeDependencyTests-307173949 None] Acquiring lock "cinder-quobyte-d39583e0-4f8e-4b6b-9457-1aafd48a67dc-8d097c6b-b693-4d0c-b7e2-4fa2c74c8236" by "_create_volume_from_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:41:47 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-96f71784-8194-4dbd-9107-bbdf5fe64c8e tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c9092a4-d6ea-4c26-9844-717d32975a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afd7ab5b-70b4-4887-a8aa-71e0c2b355ac', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:47 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-96f71784-8194-4dbd-9107-bbdf5fe64c8e tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (992f13c5-2a99-4018-92a6-b584c61b2c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:47 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-20b8ea14-23bd-47ae-a1a5-290e4a86769f tempest-VolumeDependencyTests-307173949 None] Lock "cinder-quobyte-d39583e0-4f8e-4b6b-9457-1aafd48a67dc-8d097c6b-b693-4d0c-b7e2-4fa2c74c8236" acquired by "_create_volume_from_snapshot" :: waited 0.038s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:41:47 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-20b8ea14-23bd-47ae-a1a5-290e4a86769f tempest-VolumeDependencyTests-307173949 None] Creating volume 8d097c6b-b693-4d0c-b7e2-4fa2c74c8236 from snapshot d39583e0-4f8e-4b6b-9457-1aafd48a67dc {{(pid=87166) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 14 16:41:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-20b8ea14-23bd-47ae-a1a5-290e4a86769f tempest-VolumeDependencyTests-307173949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-20b8ea14-23bd-47ae-a1a5-290e4a86769f tempest-VolumeDependencyTests-307173949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:47 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-20b8ea14-23bd-47ae-a1a5-290e4a86769f tempest-VolumeDependencyTests-307173949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:41:47 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-20b8ea14-23bd-47ae-a1a5-290e4a86769f tempest-VolumeDependencyTests-307173949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:41:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-20b8ea14-23bd-47ae-a1a5-290e4a86769f tempest-VolumeDependencyTests-307173949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:47 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-20b8ea14-23bd-47ae-a1a5-290e4a86769f tempest-VolumeDependencyTests-307173949 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:41:47 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-20b8ea14-23bd-47ae-a1a5-290e4a86769f tempest-VolumeDependencyTests-307173949 None] Acquiring lock "cinder-quobyte-8d097c6b-b693-4d0c-b7e2-4fa2c74c8236" by "_copy_volume_from_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:41:48 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-96f71784-8194-4dbd-9107-bbdf5fe64c8e tempest-ProjectMemberTests-1242181671 None] Volume volume-afd7ab5b-70b4-4887-a8aa-71e0c2b355ac (afd7ab5b-70b4-4887-a8aa-71e0c2b355ac): created successfully
Jul 14 16:41:48 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-96f71784-8194-4dbd-9107-bbdf5fe64c8e tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (992f13c5-2a99-4018-92a6-b584c61b2c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:48 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-96f71784-8194-4dbd-9107-bbdf5fe64c8e tempest-ProjectMemberTests-1242181671 None] Flow 'volume_create_manager' (cfeb151c-607f-41ba-b4b9-fdd88a76780f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:41:48 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-20b8ea14-23bd-47ae-a1a5-290e4a86769f tempest-VolumeDependencyTests-307173949 None] Lock "cinder-quobyte-8d097c6b-b693-4d0c-b7e2-4fa2c74c8236" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:41:48 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-20b8ea14-23bd-47ae-a1a5-290e4a86769f tempest-VolumeDependencyTests-307173949 None] snapshot: d39583e0-4f8e-4b6b-9457-1aafd48a67dc, volume: 8d097c6b-b693-4d0c-b7e2-4fa2c74c8236,  {{(pid=87166) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 14 16:41:48 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-dbe62282-4d1f-48f4-b358-e5d163d65f05 tempest-ProjectReaderTests-1127203843 None] Acquiring lock "cinder-2c2283c1-57c3-4a6f-bfdf-ed1eaa22be12-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:41:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-20b8ea14-23bd-47ae-a1a5-290e4a86769f tempest-VolumeDependencyTests-307173949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-20b8ea14-23bd-47ae-a1a5-290e4a86769f tempest-VolumeDependencyTests-307173949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:48 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-20b8ea14-23bd-47ae-a1a5-290e4a86769f tempest-VolumeDependencyTests-307173949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:41:48 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-20b8ea14-23bd-47ae-a1a5-290e4a86769f tempest-VolumeDependencyTests-307173949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:41:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-20b8ea14-23bd-47ae-a1a5-290e4a86769f tempest-VolumeDependencyTests-307173949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:48 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-96f71784-8194-4dbd-9107-bbdf5fe64c8e tempest-ProjectMemberTests-1242181671 None] Created volume successfully.
Jul 14 16:41:48 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-dbe62282-4d1f-48f4-b358-e5d163d65f05 tempest-ProjectReaderTests-1127203843 None] Lock "cinder-2c2283c1-57c3-4a6f-bfdf-ed1eaa22be12-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:41:48 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-dbe62282-4d1f-48f4-b358-e5d163d65f05 tempest-ProjectReaderTests-1127203843 None] Acquiring lock "cinder-quobyte-4736ad83-dfb5-471d-a894-e8c41f362e31" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:41:48 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[339d1273-85d5-4ce8-b036-4b5ca3df8474]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:41:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-20b8ea14-23bd-47ae-a1a5-290e4a86769f tempest-VolumeDependencyTests-307173949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-967743ea-8490-465b-8b46-a4ac4168240f.d39583e0-4f8e-4b6b-9457-1aafd48a67dc {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:48 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-dbe62282-4d1f-48f4-b358-e5d163d65f05 tempest-ProjectReaderTests-1127203843 None] Lock "cinder-quobyte-4736ad83-dfb5-471d-a894-e8c41f362e31" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:41:48 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-dbe62282-4d1f-48f4-b358-e5d163d65f05 tempest-ProjectReaderTests-1127203843 None] Acquiring lock "cinder-quobyte-2c2283c1-57c3-4a6f-bfdf-ed1eaa22be12" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:41:48 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-dbe62282-4d1f-48f4-b358-e5d163d65f05 tempest-ProjectReaderTests-1127203843 None] Lock "cinder-quobyte-2c2283c1-57c3-4a6f-bfdf-ed1eaa22be12" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:41:48 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-dbe62282-4d1f-48f4-b358-e5d163d65f05 tempest-ProjectReaderTests-1127203843 None] Deleting offline snapshot 2c2283c1-57c3-4a6f-bfdf-ed1eaa22be12 of volume 4736ad83-dfb5-471d-a894-e8c41f362e31 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 16:41:48 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-dbe62282-4d1f-48f4-b358-e5d163d65f05 tempest-ProjectReaderTests-1127203843 None] snapshot_file for this snap is: volume-4736ad83-dfb5-471d-a894-e8c41f362e31.2c2283c1-57c3-4a6f-bfdf-ed1eaa22be12 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 16:41:48 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[5569ff1a-668c-4ffd-b361-8a89936c34e0]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:41:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-dbe62282-4d1f-48f4-b358-e5d163d65f05 tempest-ProjectReaderTests-1127203843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4736ad83-dfb5-471d-a894-e8c41f362e31.2c2283c1-57c3-4a6f-bfdf-ed1eaa22be12 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:48 devstack sudo[105355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-967743ea-8490-465b-8b46-a4ac4168240f.d39583e0-4f8e-4b6b-9457-1aafd48a67dc
Jul 14 16:41:48 devstack sudo[105355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:48 devstack sudo[105356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4736ad83-dfb5-471d-a894-e8c41f362e31.2c2283c1-57c3-4a6f-bfdf-ed1eaa22be12
Jul 14 16:41:48 devstack sudo[105356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:48 devstack sudo[105355]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-20b8ea14-23bd-47ae-a1a5-290e4a86769f tempest-VolumeDependencyTests-307173949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-967743ea-8490-465b-8b46-a4ac4168240f.d39583e0-4f8e-4b6b-9457-1aafd48a67dc" returned: 0 in 0.394s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:48 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-20b8ea14-23bd-47ae-a1a5-290e4a86769f tempest-VolumeDependencyTests-307173949 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-967743ea-8490-465b-8b46-a4ac4168240f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 16:41:48 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-20b8ea14-23bd-47ae-a1a5-290e4a86769f tempest-VolumeDependencyTests-307173949 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-967743ea-8490-465b-8b46-a4ac4168240f {{(pid=87166) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 14 16:41:48 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-20b8ea14-23bd-47ae-a1a5-290e4a86769f tempest-VolumeDependencyTests-307173949 None] Creating direct copy from snapshot {{(pid=87166) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 14 16:41:48 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[298375ac-fef2-4765-acf5-a910a94333e8]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:41:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-20b8ea14-23bd-47ae-a1a5-290e4a86769f tempest-VolumeDependencyTests-307173949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-967743ea-8490-465b-8b46-a4ac4168240f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:48 devstack sudo[105356]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-dbe62282-4d1f-48f4-b358-e5d163d65f05 tempest-ProjectReaderTests-1127203843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4736ad83-dfb5-471d-a894-e8c41f362e31.2c2283c1-57c3-4a6f-bfdf-ed1eaa22be12" returned: 0 in 0.450s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:48 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-dbe62282-4d1f-48f4-b358-e5d163d65f05 tempest-ProjectReaderTests-1127203843 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4736ad83-dfb5-471d-a894-e8c41f362e31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 16:41:48 devstack sudo[105364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-967743ea-8490-465b-8b46-a4ac4168240f
Jul 14 16:41:48 devstack sudo[105364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:48 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b48cce-8f91-4144-97ad-a10669ff6248]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:41:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-dbe62282-4d1f-48f4-b358-e5d163d65f05 tempest-ProjectReaderTests-1127203843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4736ad83-dfb5-471d-a894-e8c41f362e31 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:48 devstack sudo[105367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4736ad83-dfb5-471d-a894-e8c41f362e31
Jul 14 16:41:48 devstack sudo[105367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:48 devstack sudo[105364]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-20b8ea14-23bd-47ae-a1a5-290e4a86769f tempest-VolumeDependencyTests-307173949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-967743ea-8490-465b-8b46-a4ac4168240f" returned: 0 in 0.420s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:48 devstack cinder-volume[87166]: DEBUG cinder.utils [None req-20b8ea14-23bd-47ae-a1a5-290e4a86769f tempest-VolumeDependencyTests-307173949 None] Path /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8d097c6b-b693-4d0c-b7e2-4fa2c74c8236 not found in is_blk_device check {{(pid=87166) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 14 16:41:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-20b8ea14-23bd-47ae-a1a5-290e4a86769f tempest-VolumeDependencyTests-307173949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-967743ea-8490-465b-8b46-a4ac4168240f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8d097c6b-b693-4d0c-b7e2-4fa2c74c8236 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:48 devstack sudo[105373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-967743ea-8490-465b-8b46-a4ac4168240f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8d097c6b-b693-4d0c-b7e2-4fa2c74c8236
Jul 14 16:41:48 devstack sudo[105373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:49 devstack sudo[105367]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-dbe62282-4d1f-48f4-b358-e5d163d65f05 tempest-ProjectReaderTests-1127203843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4736ad83-dfb5-471d-a894-e8c41f362e31" returned: 0 in 0.426s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-dbe62282-4d1f-48f4-b358-e5d163d65f05 tempest-ProjectReaderTests-1127203843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4736ad83-dfb5-471d-a894-e8c41f362e31.2c2283c1-57c3-4a6f-bfdf-ed1eaa22be12 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:49 devstack sudo[105379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4736ad83-dfb5-471d-a894-e8c41f362e31.2c2283c1-57c3-4a6f-bfdf-ed1eaa22be12
Jul 14 16:41:49 devstack sudo[105379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:49 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:UPDATE=319,cinder:SELECT=221,cinder:DELETE=37,cinder:INSERT=85 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 16:41:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cb0855b8-88d1-49b6-a1dc-adee9f2568fa tempest-ProjectMemberTests-1242181671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:49 devstack sudo[105379]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-dbe62282-4d1f-48f4-b358-e5d163d65f05 tempest-ProjectReaderTests-1127203843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4736ad83-dfb5-471d-a894-e8c41f362e31.2c2283c1-57c3-4a6f-bfdf-ed1eaa22be12" returned: 0 in 0.491s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-dbe62282-4d1f-48f4-b358-e5d163d65f05 tempest-ProjectReaderTests-1127203843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4736ad83-dfb5-471d-a894-e8c41f362e31.2c2283c1-57c3-4a6f-bfdf-ed1eaa22be12 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:49 devstack sudo[105396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4736ad83-dfb5-471d-a894-e8c41f362e31.2c2283c1-57c3-4a6f-bfdf-ed1eaa22be12
Jul 14 16:41:49 devstack sudo[105396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:50 devstack sudo[105396]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-dbe62282-4d1f-48f4-b358-e5d163d65f05 tempest-ProjectReaderTests-1127203843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4736ad83-dfb5-471d-a894-e8c41f362e31.2c2283c1-57c3-4a6f-bfdf-ed1eaa22be12" returned: 0 in 0.491s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:50 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-dbe62282-4d1f-48f4-b358-e5d163d65f05 tempest-ProjectReaderTests-1127203843 None] Lock "cinder-quobyte-2c2283c1-57c3-4a6f-bfdf-ed1eaa22be12" released by "_delete_snapshot" :: held 2.031s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:41:50 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-dbe62282-4d1f-48f4-b358-e5d163d65f05 tempest-ProjectReaderTests-1127203843 None] Lock "cinder-quobyte-4736ad83-dfb5-471d-a894-e8c41f362e31" released by "delete_snapshot" :: held 2.090s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:41:50 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4b75efda-77e9-459e-b073-242d74b5bb8a tempest-ProjectAdminTests-1620156009 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6650619506836, 'free_capacity_gb': 1775.6650619506836, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87166) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jul 14 16:41:50 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-dbe62282-4d1f-48f4-b358-e5d163d65f05 tempest-ProjectReaderTests-1127203843 None] Created reservations ['18bb6522-b960-4f75-a3ec-118ead4e3bdf', 'a45a6f78-19e8-4350-95b6-6373e5dd24af', 'de89a974-ba98-4d3a-ae6e-46d54743db2d', '625abff4-8fca-47d3-bbfb-33c41082a940'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:41:50 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-dbe62282-4d1f-48f4-b358-e5d163d65f05 tempest-ProjectReaderTests-1127203843 None] Delete snapshot completed successfully.
Jul 14 16:41:50 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-dbe62282-4d1f-48f4-b358-e5d163d65f05 tempest-ProjectReaderTests-1127203843 None] Lock "cinder-2c2283c1-57c3-4a6f-bfdf-ed1eaa22be12-delete_snapshot" released by "delete_snapshot" :: held 2.456s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:41:51 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-48e9b82f-51f1-43c8-ab8c-5ffdfc05b718 tempest-ProjectReaderTests-1127203843 None] Acquiring lock "cinder-4736ad83-dfb5-471d-a894-e8c41f362e31-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:41:51 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-48e9b82f-51f1-43c8-ab8c-5ffdfc05b718 tempest-ProjectReaderTests-1127203843 None] Lock "cinder-4736ad83-dfb5-471d-a894-e8c41f362e31-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:41:51 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-48e9b82f-51f1-43c8-ab8c-5ffdfc05b718 tempest-ProjectReaderTests-1127203843 None] Acquiring lock "cinder-quobyte-4736ad83-dfb5-471d-a894-e8c41f362e31" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:41:51 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-48e9b82f-51f1-43c8-ab8c-5ffdfc05b718 tempest-ProjectReaderTests-1127203843 None] Lock "cinder-quobyte-4736ad83-dfb5-471d-a894-e8c41f362e31" acquired by "delete_volume" :: waited 0.036s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:41:51 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ccc81ce-03dd-4241-b0b2-19cae01d9fa7]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:41:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-48e9b82f-51f1-43c8-ab8c-5ffdfc05b718 tempest-ProjectReaderTests-1127203843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4736ad83-dfb5-471d-a894-e8c41f362e31 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:51 devstack sudo[105400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4736ad83-dfb5-471d-a894-e8c41f362e31
Jul 14 16:41:51 devstack sudo[105400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:52 devstack sudo[105400]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-48e9b82f-51f1-43c8-ab8c-5ffdfc05b718 tempest-ProjectReaderTests-1127203843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4736ad83-dfb5-471d-a894-e8c41f362e31" returned: 0 in 0.742s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-48e9b82f-51f1-43c8-ab8c-5ffdfc05b718 tempest-ProjectReaderTests-1127203843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4736ad83-dfb5-471d-a894-e8c41f362e31 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:52 devstack sudo[105405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4736ad83-dfb5-471d-a894-e8c41f362e31
Jul 14 16:41:52 devstack sudo[105405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:53 devstack sudo[105405]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-48e9b82f-51f1-43c8-ab8c-5ffdfc05b718 tempest-ProjectReaderTests-1127203843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4736ad83-dfb5-471d-a894-e8c41f362e31" returned: 0 in 0.985s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:53 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-48e9b82f-51f1-43c8-ab8c-5ffdfc05b718 tempest-ProjectReaderTests-1127203843 None] Lock "cinder-quobyte-4736ad83-dfb5-471d-a894-e8c41f362e31" released by "delete_volume" :: held 1.883s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:41:53 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-48e9b82f-51f1-43c8-ab8c-5ffdfc05b718 tempest-ProjectReaderTests-1127203843 None] Created reservations ['cc01dfd7-82d5-4618-8a7d-0de6c18987d4', '0bc4c0ee-0eb4-4388-b453-60f47c88d165', 'c689df4a-1b96-4d04-8679-e46428bc057c', '8ff457f1-00b1-4be3-b7b8-6725351a3eee'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:41:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-48e9b82f-51f1-43c8-ab8c-5ffdfc05b718 tempest-ProjectReaderTests-1127203843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-48e9b82f-51f1-43c8-ab8c-5ffdfc05b718 tempest-ProjectReaderTests-1127203843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:53 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-48e9b82f-51f1-43c8-ab8c-5ffdfc05b718 tempest-ProjectReaderTests-1127203843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:41:53 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-48e9b82f-51f1-43c8-ab8c-5ffdfc05b718 tempest-ProjectReaderTests-1127203843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:41:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-48e9b82f-51f1-43c8-ab8c-5ffdfc05b718 tempest-ProjectReaderTests-1127203843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-48e9b82f-51f1-43c8-ab8c-5ffdfc05b718 tempest-ProjectReaderTests-1127203843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:53 devstack sudo[105408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:41:53 devstack sudo[105408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:54 devstack sudo[105408]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-48e9b82f-51f1-43c8-ab8c-5ffdfc05b718 tempest-ProjectReaderTests-1127203843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.658s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:54 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-48e9b82f-51f1-43c8-ab8c-5ffdfc05b718 tempest-ProjectReaderTests-1127203843 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:41:54 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-48e9b82f-51f1-43c8-ab8c-5ffdfc05b718 tempest-ProjectReaderTests-1127203843 None] Deleted volume successfully.
Jul 14 16:41:54 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-48e9b82f-51f1-43c8-ab8c-5ffdfc05b718 tempest-ProjectReaderTests-1127203843 None] Lock "cinder-4736ad83-dfb5-471d-a894-e8c41f362e31-delete_volume" released by "delete_volume" :: held 2.996s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:41:54 devstack sudo[105373]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-20b8ea14-23bd-47ae-a1a5-290e4a86769f tempest-VolumeDependencyTests-307173949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-967743ea-8490-465b-8b46-a4ac4168240f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8d097c6b-b693-4d0c-b7e2-4fa2c74c8236" returned: 0 in 5.707s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:54 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[661b2667-8b3d-4486-a74c-f57554f03317]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:41:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-20b8ea14-23bd-47ae-a1a5-290e4a86769f tempest-VolumeDependencyTests-307173949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-967743ea-8490-465b-8b46-a4ac4168240f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:54 devstack sudo[105411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-967743ea-8490-465b-8b46-a4ac4168240f
Jul 14 16:41:54 devstack sudo[105411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:54 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c549e19-f01b-4896-b436-51993e807c25 tempest-ProjectReaderTests-1127203843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:41:55 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2c549e19-f01b-4896-b436-51993e807c25 tempest-ProjectReaderTests-1127203843 None] Flow 'volume_create_manager' (0503d3ef-72f1-4ed8-9b43-a7122445fee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:41:55 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2c549e19-f01b-4896-b436-51993e807c25 tempest-ProjectReaderTests-1127203843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7014d87c-7e48-46c7-9609-156273429589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:55 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2c549e19-f01b-4896-b436-51993e807c25 tempest-ProjectReaderTests-1127203843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7014d87c-7e48-46c7-9609-156273429589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:41:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2032922232',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0c8f3a1-c8cf-4f4b-a171-5bc2eb648463,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='883944e7bf4f4b4dbc774e64e3e27858',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:41:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:41:55Z,use_quota=True,user_id='edcf2b7f48504051a3973d82e7b0fa86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:55 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2c549e19-f01b-4896-b436-51993e807c25 tempest-ProjectReaderTests-1127203843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3d005a4-ec25-4686-a2b3-8d54c9097c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:55 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2c549e19-f01b-4896-b436-51993e807c25 tempest-ProjectReaderTests-1127203843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3d005a4-ec25-4686-a2b3-8d54c9097c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:55 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2c549e19-f01b-4896-b436-51993e807c25 tempest-ProjectReaderTests-1127203843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5a357dd-5785-48d5-806b-efe2c4af5d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:55 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2c549e19-f01b-4896-b436-51993e807c25 tempest-ProjectReaderTests-1127203843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5a357dd-5785-48d5-806b-efe2c4af5d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0c8f3a1-c8cf-4f4b-a171-5bc2eb648463', 'volume_name': 'volume-d0c8f3a1-c8cf-4f4b-a171-5bc2eb648463', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:55 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2c549e19-f01b-4896-b436-51993e807c25 tempest-ProjectReaderTests-1127203843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f9d1d8b-2202-4a1f-a372-9256dfc461b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:55 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2c549e19-f01b-4896-b436-51993e807c25 tempest-ProjectReaderTests-1127203843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f9d1d8b-2202-4a1f-a372-9256dfc461b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:55 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2c549e19-f01b-4896-b436-51993e807c25 tempest-ProjectReaderTests-1127203843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d0e0e56-f46e-4e80-a0c4-a436ddf732dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:55 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-2c549e19-f01b-4896-b436-51993e807c25 tempest-ProjectReaderTests-1127203843 None] Volume d0c8f3a1-c8cf-4f4b-a171-5bc2eb648463: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0c8f3a1-c8cf-4f4b-a171-5bc2eb648463', 'volume_size': 1}
Jul 14 16:41:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2c549e19-f01b-4896-b436-51993e807c25 tempest-ProjectReaderTests-1127203843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:55 devstack sudo[105411]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-20b8ea14-23bd-47ae-a1a5-290e4a86769f tempest-VolumeDependencyTests-307173949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-967743ea-8490-465b-8b46-a4ac4168240f" returned: 0 in 0.597s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:55 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-20b8ea14-23bd-47ae-a1a5-290e4a86769f tempest-VolumeDependencyTests-307173949 None] Image conversion details: src /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-967743ea-8490-465b-8b46-a4ac4168240f, size 1024.00 MB, duration 5.71 sec, destination /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8d097c6b-b693-4d0c-b7e2-4fa2c74c8236 {{(pid=87166) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 14 16:41:55 devstack cinder-volume[87166]: INFO cinder.image.image_utils [None req-20b8ea14-23bd-47ae-a1a5-290e4a86769f tempest-VolumeDependencyTests-307173949 None] Converted 1024.00 MB image at 179.41 MB/s
Jul 14 16:41:55 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-20b8ea14-23bd-47ae-a1a5-290e4a86769f tempest-VolumeDependencyTests-307173949 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8d097c6b-b693-4d0c-b7e2-4fa2c74c8236 is being set with open permissions: ugo+rw
Jul 14 16:41:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-20b8ea14-23bd-47ae-a1a5-290e4a86769f tempest-VolumeDependencyTests-307173949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8d097c6b-b693-4d0c-b7e2-4fa2c74c8236 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:55 devstack sudo[105416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8d097c6b-b693-4d0c-b7e2-4fa2c74c8236
Jul 14 16:41:55 devstack sudo[105416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:55 devstack sudo[105416]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-20b8ea14-23bd-47ae-a1a5-290e4a86769f tempest-VolumeDependencyTests-307173949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8d097c6b-b693-4d0c-b7e2-4fa2c74c8236" returned: 0 in 0.272s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:55 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-20b8ea14-23bd-47ae-a1a5-290e4a86769f tempest-VolumeDependencyTests-307173949 None] Lock "cinder-quobyte-8d097c6b-b693-4d0c-b7e2-4fa2c74c8236" released by "_copy_volume_from_snapshot" :: held 7.514s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:41:55 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-20b8ea14-23bd-47ae-a1a5-290e4a86769f tempest-VolumeDependencyTests-307173949 None] Lock "cinder-quobyte-d39583e0-4f8e-4b6b-9457-1aafd48a67dc-8d097c6b-b693-4d0c-b7e2-4fa2c74c8236" released by "_create_volume_from_snapshot" :: held 7.571s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:41:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-20b8ea14-23bd-47ae-a1a5-290e4a86769f tempest-VolumeDependencyTests-307173949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.611s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cb0855b8-88d1-49b6-a1dc-adee9f2568fa tempest-ProjectMemberTests-1242181671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.306s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:55 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-cb0855b8-88d1-49b6-a1dc-adee9f2568fa tempest-ProjectMemberTests-1242181671 None] Creating offline snapshot fce73f42-545a-4a71-94c5-a65d9c4901e9 of volume afd7ab5b-70b4-4887-a8aa-71e0c2b355ac {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 16:41:55 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[9156db69-3815-4c0d-973c-d9fefb94cdf9]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:41:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cb0855b8-88d1-49b6-a1dc-adee9f2568fa tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-afd7ab5b-70b4-4887-a8aa-71e0c2b355ac {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:55 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-20b8ea14-23bd-47ae-a1a5-290e4a86769f tempest-VolumeDependencyTests-307173949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15b10db5-d3cb-4584-82f9-a2017e3760e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d097c6b-b693-4d0c-b7e2-4fa2c74c8236', 'volume_size': 1, 'snapshot_id': 'd39583e0-4f8e-4b6b-9457-1aafd48a67dc'}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:55 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-20b8ea14-23bd-47ae-a1a5-290e4a86769f tempest-VolumeDependencyTests-307173949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c8fc378-65b8-4789-873e-9b776c08f238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:55 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-20b8ea14-23bd-47ae-a1a5-290e4a86769f tempest-VolumeDependencyTests-307173949 None] Volume volume-8d097c6b-b693-4d0c-b7e2-4fa2c74c8236 (8d097c6b-b693-4d0c-b7e2-4fa2c74c8236): created successfully
Jul 14 16:41:55 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-20b8ea14-23bd-47ae-a1a5-290e4a86769f tempest-VolumeDependencyTests-307173949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c8fc378-65b8-4789-873e-9b776c08f238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:55 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-20b8ea14-23bd-47ae-a1a5-290e4a86769f tempest-VolumeDependencyTests-307173949 None] Flow 'volume_create_manager' (7f8ca42f-4cf3-4e65-becc-b6b758d87a04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:41:55 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-20b8ea14-23bd-47ae-a1a5-290e4a86769f tempest-VolumeDependencyTests-307173949 None] Created volume successfully.
Jul 14 16:41:55 devstack sudo[105419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-afd7ab5b-70b4-4887-a8aa-71e0c2b355ac
Jul 14 16:41:55 devstack sudo[105419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:56 devstack sudo[105419]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cb0855b8-88d1-49b6-a1dc-adee9f2568fa tempest-ProjectMemberTests-1242181671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-afd7ab5b-70b4-4887-a8aa-71e0c2b355ac" returned: 0 in 0.436s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cb0855b8-88d1-49b6-a1dc-adee9f2568fa tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-afd7ab5b-70b4-4887-a8aa-71e0c2b355ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-afd7ab5b-70b4-4887-a8aa-71e0c2b355ac.fce73f42-545a-4a71-94c5-a65d9c4901e9 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:56 devstack sudo[105424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-afd7ab5b-70b4-4887-a8aa-71e0c2b355ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-afd7ab5b-70b4-4887-a8aa-71e0c2b355ac.fce73f42-545a-4a71-94c5-a65d9c4901e9 1G
Jul 14 16:41:56 devstack sudo[105424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:56 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-80a13ac5-211b-4f76-bfac-d82b5f23dce0 tempest-VolumeDependencyTests-307173949 None] Acquiring lock "cinder-d39583e0-4f8e-4b6b-9457-1aafd48a67dc-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:41:56 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-80a13ac5-211b-4f76-bfac-d82b5f23dce0 tempest-VolumeDependencyTests-307173949 None] Lock "cinder-d39583e0-4f8e-4b6b-9457-1aafd48a67dc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:41:56 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-80a13ac5-211b-4f76-bfac-d82b5f23dce0 tempest-VolumeDependencyTests-307173949 None] Acquiring lock "cinder-quobyte-967743ea-8490-465b-8b46-a4ac4168240f" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:41:56 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-80a13ac5-211b-4f76-bfac-d82b5f23dce0 tempest-VolumeDependencyTests-307173949 None] Lock "cinder-quobyte-967743ea-8490-465b-8b46-a4ac4168240f" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:41:56 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-80a13ac5-211b-4f76-bfac-d82b5f23dce0 tempest-VolumeDependencyTests-307173949 None] Acquiring lock "cinder-quobyte-d39583e0-4f8e-4b6b-9457-1aafd48a67dc" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:41:56 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-80a13ac5-211b-4f76-bfac-d82b5f23dce0 tempest-VolumeDependencyTests-307173949 None] Lock "cinder-quobyte-d39583e0-4f8e-4b6b-9457-1aafd48a67dc" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:41:56 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-80a13ac5-211b-4f76-bfac-d82b5f23dce0 tempest-VolumeDependencyTests-307173949 None] Deleting offline snapshot d39583e0-4f8e-4b6b-9457-1aafd48a67dc of volume 967743ea-8490-465b-8b46-a4ac4168240f {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 16:41:56 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-80a13ac5-211b-4f76-bfac-d82b5f23dce0 tempest-VolumeDependencyTests-307173949 None] snapshot_file for this snap is: volume-967743ea-8490-465b-8b46-a4ac4168240f.d39583e0-4f8e-4b6b-9457-1aafd48a67dc {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 16:41:56 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9af434e-8d78-4a61-a84b-64781b2fb757]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:41:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-80a13ac5-211b-4f76-bfac-d82b5f23dce0 tempest-VolumeDependencyTests-307173949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-967743ea-8490-465b-8b46-a4ac4168240f.d39583e0-4f8e-4b6b-9457-1aafd48a67dc {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:56 devstack sudo[105424]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cb0855b8-88d1-49b6-a1dc-adee9f2568fa tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-afd7ab5b-70b4-4887-a8aa-71e0c2b355ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-afd7ab5b-70b4-4887-a8aa-71e0c2b355ac.fce73f42-545a-4a71-94c5-a65d9c4901e9 1G" returned: 0 in 0.470s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cb0855b8-88d1-49b6-a1dc-adee9f2568fa tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afd7ab5b-70b4-4887-a8aa-71e0c2b355ac -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-afd7ab5b-70b4-4887-a8aa-71e0c2b355ac.fce73f42-545a-4a71-94c5-a65d9c4901e9 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:56 devstack sudo[105431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afd7ab5b-70b4-4887-a8aa-71e0c2b355ac -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-afd7ab5b-70b4-4887-a8aa-71e0c2b355ac.fce73f42-545a-4a71-94c5-a65d9c4901e9
Jul 14 16:41:56 devstack sudo[105431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:56 devstack sudo[105429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-967743ea-8490-465b-8b46-a4ac4168240f.d39583e0-4f8e-4b6b-9457-1aafd48a67dc
Jul 14 16:41:56 devstack sudo[105429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:56 devstack sudo[105429]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-80a13ac5-211b-4f76-bfac-d82b5f23dce0 tempest-VolumeDependencyTests-307173949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-967743ea-8490-465b-8b46-a4ac4168240f.d39583e0-4f8e-4b6b-9457-1aafd48a67dc" returned: 0 in 0.413s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:56 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-80a13ac5-211b-4f76-bfac-d82b5f23dce0 tempest-VolumeDependencyTests-307173949 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-967743ea-8490-465b-8b46-a4ac4168240f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 16:41:56 devstack sudo[105431]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cb0855b8-88d1-49b6-a1dc-adee9f2568fa tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afd7ab5b-70b4-4887-a8aa-71e0c2b355ac -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-afd7ab5b-70b4-4887-a8aa-71e0c2b355ac.fce73f42-545a-4a71-94c5-a65d9c4901e9" returned: 0 in 0.359s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:56 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-cb0855b8-88d1-49b6-a1dc-adee9f2568fa tempest-ProjectMemberTests-1242181671 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-afd7ab5b-70b4-4887-a8aa-71e0c2b355ac.fce73f42-545a-4a71-94c5-a65d9c4901e9 is being set with open permissions: ugo+rw
Jul 14 16:41:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cb0855b8-88d1-49b6-a1dc-adee9f2568fa tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-afd7ab5b-70b4-4887-a8aa-71e0c2b355ac.fce73f42-545a-4a71-94c5-a65d9c4901e9 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:56 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[2594fd4c-9102-4bf6-8d1f-61eec63721a6]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:41:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-80a13ac5-211b-4f76-bfac-d82b5f23dce0 tempest-VolumeDependencyTests-307173949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-967743ea-8490-465b-8b46-a4ac4168240f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:56 devstack sudo[105440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-afd7ab5b-70b4-4887-a8aa-71e0c2b355ac.fce73f42-545a-4a71-94c5-a65d9c4901e9
Jul 14 16:41:56 devstack sudo[105440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:57 devstack sudo[105441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-967743ea-8490-465b-8b46-a4ac4168240f
Jul 14 16:41:57 devstack sudo[105441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:57 devstack sudo[105440]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cb0855b8-88d1-49b6-a1dc-adee9f2568fa tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-afd7ab5b-70b4-4887-a8aa-71e0c2b355ac.fce73f42-545a-4a71-94c5-a65d9c4901e9" returned: 0 in 0.298s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cb0855b8-88d1-49b6-a1dc-adee9f2568fa tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-afd7ab5b-70b4-4887-a8aa-71e0c2b355ac.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:57 devstack sudo[105446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-afd7ab5b-70b4-4887-a8aa-71e0c2b355ac.info
Jul 14 16:41:57 devstack sudo[105446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:57 devstack sudo[105441]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-80a13ac5-211b-4f76-bfac-d82b5f23dce0 tempest-VolumeDependencyTests-307173949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-967743ea-8490-465b-8b46-a4ac4168240f" returned: 0 in 0.423s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-80a13ac5-211b-4f76-bfac-d82b5f23dce0 tempest-VolumeDependencyTests-307173949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-967743ea-8490-465b-8b46-a4ac4168240f.d39583e0-4f8e-4b6b-9457-1aafd48a67dc {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:57 devstack sudo[105450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-967743ea-8490-465b-8b46-a4ac4168240f.d39583e0-4f8e-4b6b-9457-1aafd48a67dc
Jul 14 16:41:57 devstack sudo[105450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:57 devstack sudo[105446]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cb0855b8-88d1-49b6-a1dc-adee9f2568fa tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-afd7ab5b-70b4-4887-a8aa-71e0c2b355ac.info" returned: 0 in 0.301s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:57 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-cb0855b8-88d1-49b6-a1dc-adee9f2568fa tempest-ProjectMemberTests-1242181671 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-afd7ab5b-70b4-4887-a8aa-71e0c2b355ac.info is being set with open permissions: ugo+rw
Jul 14 16:41:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cb0855b8-88d1-49b6-a1dc-adee9f2568fa tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-afd7ab5b-70b4-4887-a8aa-71e0c2b355ac.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:57 devstack sudo[105453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-afd7ab5b-70b4-4887-a8aa-71e0c2b355ac.info
Jul 14 16:41:57 devstack sudo[105453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:57 devstack sudo[105450]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-80a13ac5-211b-4f76-bfac-d82b5f23dce0 tempest-VolumeDependencyTests-307173949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-967743ea-8490-465b-8b46-a4ac4168240f.d39583e0-4f8e-4b6b-9457-1aafd48a67dc" returned: 0 in 0.364s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-80a13ac5-211b-4f76-bfac-d82b5f23dce0 tempest-VolumeDependencyTests-307173949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-967743ea-8490-465b-8b46-a4ac4168240f.d39583e0-4f8e-4b6b-9457-1aafd48a67dc {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:57 devstack sudo[105459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-967743ea-8490-465b-8b46-a4ac4168240f.d39583e0-4f8e-4b6b-9457-1aafd48a67dc
Jul 14 16:41:57 devstack sudo[105459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:57 devstack sudo[105453]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cb0855b8-88d1-49b6-a1dc-adee9f2568fa tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-afd7ab5b-70b4-4887-a8aa-71e0c2b355ac.info" returned: 0 in 0.278s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cb0855b8-88d1-49b6-a1dc-adee9f2568fa tempest-ProjectMemberTests-1242181671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.257s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2c549e19-f01b-4896-b436-51993e807c25 tempest-ProjectReaderTests-1127203843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.747s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:57 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2c549e19-f01b-4896-b436-51993e807c25 tempest-ProjectReaderTests-1127203843 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:41:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2032922232',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0c8f3a1-c8cf-4f4b-a171-5bc2eb648463,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='883944e7bf4f4b4dbc774e64e3e27858',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:41:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:41:55Z,use_quota=True,user_id='edcf2b7f48504051a3973d82e7b0fa86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:41:57 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-2c549e19-f01b-4896-b436-51993e807c25 tempest-ProjectReaderTests-1127203843 None] Creating volume d0c8f3a1-c8cf-4f4b-a171-5bc2eb648463 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:41:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2c549e19-f01b-4896-b436-51993e807c25 tempest-ProjectReaderTests-1127203843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2c549e19-f01b-4896-b436-51993e807c25 tempest-ProjectReaderTests-1127203843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:57 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2c549e19-f01b-4896-b436-51993e807c25 tempest-ProjectReaderTests-1127203843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:41:57 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2c549e19-f01b-4896-b436-51993e807c25 tempest-ProjectReaderTests-1127203843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:41:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2c549e19-f01b-4896-b436-51993e807c25 tempest-ProjectReaderTests-1127203843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:57 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2c549e19-f01b-4896-b436-51993e807c25 tempest-ProjectReaderTests-1127203843 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:41:57 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-2c549e19-f01b-4896-b436-51993e807c25 tempest-ProjectReaderTests-1127203843 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:41:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2c549e19-f01b-4896-b436-51993e807c25 tempest-ProjectReaderTests-1127203843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d0c8f3a1-c8cf-4f4b-a171-5bc2eb648463 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:57 devstack sudo[105462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d0c8f3a1-c8cf-4f4b-a171-5bc2eb648463 1073741824
Jul 14 16:41:57 devstack sudo[105462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:57 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-cb0855b8-88d1-49b6-a1dc-adee9f2568fa tempest-ProjectMemberTests-1242181671 None] Create snapshot completed successfully
Jul 14 16:41:57 devstack sudo[105459]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-80a13ac5-211b-4f76-bfac-d82b5f23dce0 tempest-VolumeDependencyTests-307173949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-967743ea-8490-465b-8b46-a4ac4168240f.d39583e0-4f8e-4b6b-9457-1aafd48a67dc" returned: 0 in 0.311s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:58 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-80a13ac5-211b-4f76-bfac-d82b5f23dce0 tempest-VolumeDependencyTests-307173949 None] Lock "cinder-quobyte-d39583e0-4f8e-4b6b-9457-1aafd48a67dc" released by "_delete_snapshot" :: held 1.658s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:41:58 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-80a13ac5-211b-4f76-bfac-d82b5f23dce0 tempest-VolumeDependencyTests-307173949 None] Lock "cinder-quobyte-967743ea-8490-465b-8b46-a4ac4168240f" released by "delete_snapshot" :: held 1.696s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:41:58 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:SELECT=261,cinder:UPDATE=325,cinder:INSERT=89,cinder:DELETE=21 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 16:41:58 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-80a13ac5-211b-4f76-bfac-d82b5f23dce0 tempest-VolumeDependencyTests-307173949 None] Created reservations ['8460d883-13d6-4f3e-bada-cb03d2cddcfe', '52177d73-7d25-40b6-b409-23702e1097b4', '79f69b03-a9e4-4789-bcb9-d9f79a6cdff4', '06db630e-9385-44f3-8700-20717b56dfba'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:41:58 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-80a13ac5-211b-4f76-bfac-d82b5f23dce0 tempest-VolumeDependencyTests-307173949 None] Delete snapshot completed successfully.
Jul 14 16:41:58 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-80a13ac5-211b-4f76-bfac-d82b5f23dce0 tempest-VolumeDependencyTests-307173949 None] Lock "cinder-d39583e0-4f8e-4b6b-9457-1aafd48a67dc-delete_snapshot" released by "delete_snapshot" :: held 1.890s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:41:58 devstack sudo[105462]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2c549e19-f01b-4896-b436-51993e807c25 tempest-ProjectReaderTests-1127203843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d0c8f3a1-c8cf-4f4b-a171-5bc2eb648463 1073741824" returned: 0 in 0.521s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2c549e19-f01b-4896-b436-51993e807c25 tempest-ProjectReaderTests-1127203843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d0c8f3a1-c8cf-4f4b-a171-5bc2eb648463 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:58 devstack sudo[105469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d0c8f3a1-c8cf-4f4b-a171-5bc2eb648463
Jul 14 16:41:58 devstack sudo[105469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:58 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c1fa77d8-b5a4-46fc-98bf-409cf7a4892e tempest-VolumeDependencyTests-307173949 None] Acquiring lock "cinder-967743ea-8490-465b-8b46-a4ac4168240f-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:41:58 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c1fa77d8-b5a4-46fc-98bf-409cf7a4892e tempest-VolumeDependencyTests-307173949 None] Lock "cinder-967743ea-8490-465b-8b46-a4ac4168240f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:41:58 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c1fa77d8-b5a4-46fc-98bf-409cf7a4892e tempest-VolumeDependencyTests-307173949 None] Acquiring lock "cinder-quobyte-967743ea-8490-465b-8b46-a4ac4168240f" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:41:58 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c1fa77d8-b5a4-46fc-98bf-409cf7a4892e tempest-VolumeDependencyTests-307173949 None] Lock "cinder-quobyte-967743ea-8490-465b-8b46-a4ac4168240f" acquired by "delete_volume" :: waited 0.027s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:41:58 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef57dc1c-7a9d-4831-951c-48e2ec86704a]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:41:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c1fa77d8-b5a4-46fc-98bf-409cf7a4892e tempest-VolumeDependencyTests-307173949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-967743ea-8490-465b-8b46-a4ac4168240f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:58 devstack sudo[105469]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2c549e19-f01b-4896-b436-51993e807c25 tempest-ProjectReaderTests-1127203843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d0c8f3a1-c8cf-4f4b-a171-5bc2eb648463" returned: 0 in 0.306s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:58 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2c549e19-f01b-4896-b436-51993e807c25 tempest-ProjectReaderTests-1127203843 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:41:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2c549e19-f01b-4896-b436-51993e807c25 tempest-ProjectReaderTests-1127203843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:58 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2c549e19-f01b-4896-b436-51993e807c25 tempest-ProjectReaderTests-1127203843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d0e0e56-f46e-4e80-a0c4-a436ddf732dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0c8f3a1-c8cf-4f4b-a171-5bc2eb648463', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:58 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2c549e19-f01b-4896-b436-51993e807c25 tempest-ProjectReaderTests-1127203843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (925029e3-f6cc-4a94-aa94-e93ebf568797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:41:58 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-2c549e19-f01b-4896-b436-51993e807c25 tempest-ProjectReaderTests-1127203843 None] Volume volume-d0c8f3a1-c8cf-4f4b-a171-5bc2eb648463 (d0c8f3a1-c8cf-4f4b-a171-5bc2eb648463): created successfully
Jul 14 16:41:58 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2c549e19-f01b-4896-b436-51993e807c25 tempest-ProjectReaderTests-1127203843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (925029e3-f6cc-4a94-aa94-e93ebf568797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:41:58 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2c549e19-f01b-4896-b436-51993e807c25 tempest-ProjectReaderTests-1127203843 None] Flow 'volume_create_manager' (0503d3ef-72f1-4ed8-9b43-a7122445fee3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:41:58 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-2c549e19-f01b-4896-b436-51993e807c25 tempest-ProjectReaderTests-1127203843 None] Created volume successfully.
Jul 14 16:41:58 devstack sudo[105472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-967743ea-8490-465b-8b46-a4ac4168240f
Jul 14 16:41:58 devstack sudo[105472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:58 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7d49548c-3b4c-4556-91af-50c8304c65c2 tempest-ProjectMemberTests-1242181671 None] Acquiring lock "cinder-fce73f42-545a-4a71-94c5-a65d9c4901e9-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:41:59 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7d49548c-3b4c-4556-91af-50c8304c65c2 tempest-ProjectMemberTests-1242181671 None] Lock "cinder-fce73f42-545a-4a71-94c5-a65d9c4901e9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:41:59 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7d49548c-3b4c-4556-91af-50c8304c65c2 tempest-ProjectMemberTests-1242181671 None] Acquiring lock "cinder-quobyte-afd7ab5b-70b4-4887-a8aa-71e0c2b355ac" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:41:59 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7d49548c-3b4c-4556-91af-50c8304c65c2 tempest-ProjectMemberTests-1242181671 None] Lock "cinder-quobyte-afd7ab5b-70b4-4887-a8aa-71e0c2b355ac" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:41:59 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7d49548c-3b4c-4556-91af-50c8304c65c2 tempest-ProjectMemberTests-1242181671 None] Acquiring lock "cinder-quobyte-fce73f42-545a-4a71-94c5-a65d9c4901e9" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:41:59 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7d49548c-3b4c-4556-91af-50c8304c65c2 tempest-ProjectMemberTests-1242181671 None] Lock "cinder-quobyte-fce73f42-545a-4a71-94c5-a65d9c4901e9" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:41:59 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-7d49548c-3b4c-4556-91af-50c8304c65c2 tempest-ProjectMemberTests-1242181671 None] Deleting offline snapshot fce73f42-545a-4a71-94c5-a65d9c4901e9 of volume afd7ab5b-70b4-4887-a8aa-71e0c2b355ac {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 16:41:59 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-7d49548c-3b4c-4556-91af-50c8304c65c2 tempest-ProjectMemberTests-1242181671 None] snapshot_file for this snap is: volume-afd7ab5b-70b4-4887-a8aa-71e0c2b355ac.fce73f42-545a-4a71-94c5-a65d9c4901e9 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 16:41:59 devstack sudo[105472]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:59 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[9170f2eb-e5f4-46ff-8c1f-53bb7d57b9ba]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:41:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7d49548c-3b4c-4556-91af-50c8304c65c2 tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-afd7ab5b-70b4-4887-a8aa-71e0c2b355ac.fce73f42-545a-4a71-94c5-a65d9c4901e9 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c1fa77d8-b5a4-46fc-98bf-409cf7a4892e tempest-VolumeDependencyTests-307173949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-967743ea-8490-465b-8b46-a4ac4168240f" returned: 0 in 0.449s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c1fa77d8-b5a4-46fc-98bf-409cf7a4892e tempest-VolumeDependencyTests-307173949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-967743ea-8490-465b-8b46-a4ac4168240f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:59 devstack sudo[105479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-967743ea-8490-465b-8b46-a4ac4168240f
Jul 14 16:41:59 devstack sudo[105479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:59 devstack sudo[105478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-afd7ab5b-70b4-4887-a8aa-71e0c2b355ac.fce73f42-545a-4a71-94c5-a65d9c4901e9
Jul 14 16:41:59 devstack sudo[105478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b2e1a755-0cc5-48a4-96f7-accca859a1ed tempest-ProjectReaderTests-1127203843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b2e1a755-0cc5-48a4-96f7-accca859a1ed tempest-ProjectReaderTests-1127203843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:59 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-b2e1a755-0cc5-48a4-96f7-accca859a1ed tempest-ProjectReaderTests-1127203843 None] Creating offline snapshot c3755f8e-07d3-4a2a-96f5-614229eb2242 of volume d0c8f3a1-c8cf-4f4b-a171-5bc2eb648463 {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 16:41:59 devstack sudo[105479]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c1fa77d8-b5a4-46fc-98bf-409cf7a4892e tempest-VolumeDependencyTests-307173949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-967743ea-8490-465b-8b46-a4ac4168240f" returned: 0 in 0.371s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:59 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f4e5f7b-f21c-4e7c-871d-abca57a1e371]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:41:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b2e1a755-0cc5-48a4-96f7-accca859a1ed tempest-ProjectReaderTests-1127203843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d0c8f3a1-c8cf-4f4b-a171-5bc2eb648463 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:59 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c1fa77d8-b5a4-46fc-98bf-409cf7a4892e tempest-VolumeDependencyTests-307173949 None] Lock "cinder-quobyte-967743ea-8490-465b-8b46-a4ac4168240f" released by "delete_volume" :: held 0.902s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:41:59 devstack sudo[105478]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7d49548c-3b4c-4556-91af-50c8304c65c2 tempest-ProjectMemberTests-1242181671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-afd7ab5b-70b4-4887-a8aa-71e0c2b355ac.fce73f42-545a-4a71-94c5-a65d9c4901e9" returned: 0 in 0.484s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:59 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-7d49548c-3b4c-4556-91af-50c8304c65c2 tempest-ProjectMemberTests-1242181671 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-afd7ab5b-70b4-4887-a8aa-71e0c2b355ac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 16:41:59 devstack sudo[105486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d0c8f3a1-c8cf-4f4b-a171-5bc2eb648463
Jul 14 16:41:59 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[da496163-5630-4f16-816c-d02abd7b1241]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:41:59 devstack sudo[105486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7d49548c-3b4c-4556-91af-50c8304c65c2 tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-afd7ab5b-70b4-4887-a8aa-71e0c2b355ac {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:59 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-c1fa77d8-b5a4-46fc-98bf-409cf7a4892e tempest-VolumeDependencyTests-307173949 None] Created reservations ['c9d49ae8-7f6b-42c3-b4ba-e598b8378d03', 'e8330612-0d51-456e-a2e2-4c3f35c4cb20', '415a9012-910b-4612-9200-6b49799122e0', '1936c9e3-9bca-4108-b487-bfd3e68bbad4'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:41:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c1fa77d8-b5a4-46fc-98bf-409cf7a4892e tempest-VolumeDependencyTests-307173949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:41:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c1fa77d8-b5a4-46fc-98bf-409cf7a4892e tempest-VolumeDependencyTests-307173949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:41:59 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-c1fa77d8-b5a4-46fc-98bf-409cf7a4892e tempest-VolumeDependencyTests-307173949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:41:59 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-c1fa77d8-b5a4-46fc-98bf-409cf7a4892e tempest-VolumeDependencyTests-307173949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:41:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c1fa77d8-b5a4-46fc-98bf-409cf7a4892e tempest-VolumeDependencyTests-307173949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:41:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c1fa77d8-b5a4-46fc-98bf-409cf7a4892e tempest-VolumeDependencyTests-307173949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:59 devstack sudo[105489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-afd7ab5b-70b4-4887-a8aa-71e0c2b355ac
Jul 14 16:41:59 devstack sudo[105489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:59 devstack sudo[105490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:41:59 devstack sudo[105490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:41:59 devstack sudo[105486]: pam_unix(sudo:session): session closed for user root
Jul 14 16:41:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b2e1a755-0cc5-48a4-96f7-accca859a1ed tempest-ProjectReaderTests-1127203843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d0c8f3a1-c8cf-4f4b-a171-5bc2eb648463" returned: 0 in 0.410s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:41:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b2e1a755-0cc5-48a4-96f7-accca859a1ed tempest-ProjectReaderTests-1127203843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d0c8f3a1-c8cf-4f4b-a171-5bc2eb648463,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d0c8f3a1-c8cf-4f4b-a171-5bc2eb648463.c3755f8e-07d3-4a2a-96f5-614229eb2242 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:41:59 devstack sudo[105497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d0c8f3a1-c8cf-4f4b-a171-5bc2eb648463,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d0c8f3a1-c8cf-4f4b-a171-5bc2eb648463.c3755f8e-07d3-4a2a-96f5-614229eb2242 1G
Jul 14 16:41:59 devstack sudo[105497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:00 devstack sudo[105490]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c1fa77d8-b5a4-46fc-98bf-409cf7a4892e tempest-VolumeDependencyTests-307173949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.300s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:00 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-c1fa77d8-b5a4-46fc-98bf-409cf7a4892e tempest-VolumeDependencyTests-307173949 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:42:00 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-c1fa77d8-b5a4-46fc-98bf-409cf7a4892e tempest-VolumeDependencyTests-307173949 None] Deleted volume successfully.
Jul 14 16:42:00 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c1fa77d8-b5a4-46fc-98bf-409cf7a4892e tempest-VolumeDependencyTests-307173949 None] Lock "cinder-967743ea-8490-465b-8b46-a4ac4168240f-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:42:00 devstack sudo[105489]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7d49548c-3b4c-4556-91af-50c8304c65c2 tempest-ProjectMemberTests-1242181671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-afd7ab5b-70b4-4887-a8aa-71e0c2b355ac" returned: 0 in 0.502s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7d49548c-3b4c-4556-91af-50c8304c65c2 tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-afd7ab5b-70b4-4887-a8aa-71e0c2b355ac.fce73f42-545a-4a71-94c5-a65d9c4901e9 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:00 devstack sudo[105503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-afd7ab5b-70b4-4887-a8aa-71e0c2b355ac.fce73f42-545a-4a71-94c5-a65d9c4901e9
Jul 14 16:42:00 devstack sudo[105503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:00 devstack sudo[105497]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b2e1a755-0cc5-48a4-96f7-accca859a1ed tempest-ProjectReaderTests-1127203843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d0c8f3a1-c8cf-4f4b-a171-5bc2eb648463,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d0c8f3a1-c8cf-4f4b-a171-5bc2eb648463.c3755f8e-07d3-4a2a-96f5-614229eb2242 1G" returned: 0 in 0.510s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b2e1a755-0cc5-48a4-96f7-accca859a1ed tempest-ProjectReaderTests-1127203843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0c8f3a1-c8cf-4f4b-a171-5bc2eb648463 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d0c8f3a1-c8cf-4f4b-a171-5bc2eb648463.c3755f8e-07d3-4a2a-96f5-614229eb2242 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:00 devstack sudo[105512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0c8f3a1-c8cf-4f4b-a171-5bc2eb648463 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d0c8f3a1-c8cf-4f4b-a171-5bc2eb648463.c3755f8e-07d3-4a2a-96f5-614229eb2242
Jul 14 16:42:00 devstack sudo[105512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:00 devstack sudo[105503]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7d49548c-3b4c-4556-91af-50c8304c65c2 tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-afd7ab5b-70b4-4887-a8aa-71e0c2b355ac.fce73f42-545a-4a71-94c5-a65d9c4901e9" returned: 0 in 0.420s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7d49548c-3b4c-4556-91af-50c8304c65c2 tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-afd7ab5b-70b4-4887-a8aa-71e0c2b355ac.fce73f42-545a-4a71-94c5-a65d9c4901e9 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:00 devstack sudo[105515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-afd7ab5b-70b4-4887-a8aa-71e0c2b355ac.fce73f42-545a-4a71-94c5-a65d9c4901e9
Jul 14 16:42:00 devstack sudo[105515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:00 devstack sudo[105512]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b2e1a755-0cc5-48a4-96f7-accca859a1ed tempest-ProjectReaderTests-1127203843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0c8f3a1-c8cf-4f4b-a171-5bc2eb648463 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d0c8f3a1-c8cf-4f4b-a171-5bc2eb648463.c3755f8e-07d3-4a2a-96f5-614229eb2242" returned: 0 in 0.370s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:00 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-b2e1a755-0cc5-48a4-96f7-accca859a1ed tempest-ProjectReaderTests-1127203843 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d0c8f3a1-c8cf-4f4b-a171-5bc2eb648463.c3755f8e-07d3-4a2a-96f5-614229eb2242 is being set with open permissions: ugo+rw
Jul 14 16:42:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b2e1a755-0cc5-48a4-96f7-accca859a1ed tempest-ProjectReaderTests-1127203843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d0c8f3a1-c8cf-4f4b-a171-5bc2eb648463.c3755f8e-07d3-4a2a-96f5-614229eb2242 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:00 devstack sudo[105521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d0c8f3a1-c8cf-4f4b-a171-5bc2eb648463.c3755f8e-07d3-4a2a-96f5-614229eb2242
Jul 14 16:42:00 devstack sudo[105521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:00 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b0b59301-d3fa-4f2f-bce5-30578a68ec85 tempest-VolumeDependencyTests-307173949 None] Acquiring lock "cinder-8d097c6b-b693-4d0c-b7e2-4fa2c74c8236-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:42:00 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b0b59301-d3fa-4f2f-bce5-30578a68ec85 tempest-VolumeDependencyTests-307173949 None] Lock "cinder-8d097c6b-b693-4d0c-b7e2-4fa2c74c8236-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:42:00 devstack sudo[105515]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7d49548c-3b4c-4556-91af-50c8304c65c2 tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-afd7ab5b-70b4-4887-a8aa-71e0c2b355ac.fce73f42-545a-4a71-94c5-a65d9c4901e9" returned: 0 in 0.370s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:00 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b0b59301-d3fa-4f2f-bce5-30578a68ec85 tempest-VolumeDependencyTests-307173949 None] Acquiring lock "cinder-quobyte-8d097c6b-b693-4d0c-b7e2-4fa2c74c8236" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:42:00 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b0b59301-d3fa-4f2f-bce5-30578a68ec85 tempest-VolumeDependencyTests-307173949 None] Lock "cinder-quobyte-8d097c6b-b693-4d0c-b7e2-4fa2c74c8236" acquired by "delete_volume" :: waited 0.037s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:42:01 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7d49548c-3b4c-4556-91af-50c8304c65c2 tempest-ProjectMemberTests-1242181671 None] Lock "cinder-quobyte-fce73f42-545a-4a71-94c5-a65d9c4901e9" released by "_delete_snapshot" :: held 1.956s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:42:01 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7d49548c-3b4c-4556-91af-50c8304c65c2 tempest-ProjectMemberTests-1242181671 None] Lock "cinder-quobyte-afd7ab5b-70b4-4887-a8aa-71e0c2b355ac" released by "delete_snapshot" :: held 1.984s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:42:01 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ca08b4-b28e-4e57-b44d-b5fd6ee49bca]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:42:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b0b59301-d3fa-4f2f-bce5-30578a68ec85 tempest-VolumeDependencyTests-307173949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8d097c6b-b693-4d0c-b7e2-4fa2c74c8236 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:01 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-7d49548c-3b4c-4556-91af-50c8304c65c2 tempest-ProjectMemberTests-1242181671 None] Created reservations ['219f8102-c1c5-4e1c-9c12-ad8c7bd92330', 'dfba483c-a499-4b18-8a87-27701ab694bf', 'd2c56dc1-c1f1-4ccd-940c-4bc5a87a73c0', '547ad8b1-e3ff-4de4-b6a8-16a9e2bd9aa7'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:42:01 devstack sudo[105524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8d097c6b-b693-4d0c-b7e2-4fa2c74c8236
Jul 14 16:42:01 devstack sudo[105524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:01 devstack sudo[105521]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b2e1a755-0cc5-48a4-96f7-accca859a1ed tempest-ProjectReaderTests-1127203843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d0c8f3a1-c8cf-4f4b-a171-5bc2eb648463.c3755f8e-07d3-4a2a-96f5-614229eb2242" returned: 0 in 0.379s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b2e1a755-0cc5-48a4-96f7-accca859a1ed tempest-ProjectReaderTests-1127203843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d0c8f3a1-c8cf-4f4b-a171-5bc2eb648463.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:01 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-7d49548c-3b4c-4556-91af-50c8304c65c2 tempest-ProjectMemberTests-1242181671 None] Delete snapshot completed successfully.
Jul 14 16:42:01 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7d49548c-3b4c-4556-91af-50c8304c65c2 tempest-ProjectMemberTests-1242181671 None] Lock "cinder-fce73f42-545a-4a71-94c5-a65d9c4901e9-delete_snapshot" released by "delete_snapshot" :: held 2.274s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:42:01 devstack sudo[105527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d0c8f3a1-c8cf-4f4b-a171-5bc2eb648463.info
Jul 14 16:42:01 devstack sudo[105527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:01 devstack sudo[105524]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b0b59301-d3fa-4f2f-bce5-30578a68ec85 tempest-VolumeDependencyTests-307173949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8d097c6b-b693-4d0c-b7e2-4fa2c74c8236" returned: 0 in 0.434s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b0b59301-d3fa-4f2f-bce5-30578a68ec85 tempest-VolumeDependencyTests-307173949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8d097c6b-b693-4d0c-b7e2-4fa2c74c8236 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:01 devstack sudo[105532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8d097c6b-b693-4d0c-b7e2-4fa2c74c8236
Jul 14 16:42:01 devstack sudo[105532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:01 devstack sudo[105527]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b2e1a755-0cc5-48a4-96f7-accca859a1ed tempest-ProjectReaderTests-1127203843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d0c8f3a1-c8cf-4f4b-a171-5bc2eb648463.info" returned: 0 in 0.309s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:01 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-b2e1a755-0cc5-48a4-96f7-accca859a1ed tempest-ProjectReaderTests-1127203843 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d0c8f3a1-c8cf-4f4b-a171-5bc2eb648463.info is being set with open permissions: ugo+rw
Jul 14 16:42:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b2e1a755-0cc5-48a4-96f7-accca859a1ed tempest-ProjectReaderTests-1127203843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d0c8f3a1-c8cf-4f4b-a171-5bc2eb648463.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:01 devstack sudo[105535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d0c8f3a1-c8cf-4f4b-a171-5bc2eb648463.info
Jul 14 16:42:01 devstack sudo[105535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:01 devstack sudo[105532]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b0b59301-d3fa-4f2f-bce5-30578a68ec85 tempest-VolumeDependencyTests-307173949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-8d097c6b-b693-4d0c-b7e2-4fa2c74c8236" returned: 0 in 0.278s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:01 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b0b59301-d3fa-4f2f-bce5-30578a68ec85 tempest-VolumeDependencyTests-307173949 None] Lock "cinder-quobyte-8d097c6b-b693-4d0c-b7e2-4fa2c74c8236" released by "delete_volume" :: held 0.772s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:42:01 devstack sudo[105535]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b2e1a755-0cc5-48a4-96f7-accca859a1ed tempest-ProjectReaderTests-1127203843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d0c8f3a1-c8cf-4f4b-a171-5bc2eb648463.info" returned: 0 in 0.267s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b2e1a755-0cc5-48a4-96f7-accca859a1ed tempest-ProjectReaderTests-1127203843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.356s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:42:01 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-b0b59301-d3fa-4f2f-bce5-30578a68ec85 tempest-VolumeDependencyTests-307173949 None] Created reservations ['060ea33a-ebec-40cd-8624-83cbe3544ab7', '8d830b19-0219-47e3-8d4b-23e6de3f3594', 'f45719d4-fe35-4fd0-a8c1-879d45cb6ed8', '724508ca-c6af-47ac-92ad-0380ebe90bfc'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:42:01 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-b2e1a755-0cc5-48a4-96f7-accca859a1ed tempest-ProjectReaderTests-1127203843 None] Create snapshot completed successfully
Jul 14 16:42:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b0b59301-d3fa-4f2f-bce5-30578a68ec85 tempest-VolumeDependencyTests-307173949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:42:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b0b59301-d3fa-4f2f-bce5-30578a68ec85 tempest-VolumeDependencyTests-307173949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:42:01 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-b0b59301-d3fa-4f2f-bce5-30578a68ec85 tempest-VolumeDependencyTests-307173949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:42:01 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-b0b59301-d3fa-4f2f-bce5-30578a68ec85 tempest-VolumeDependencyTests-307173949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:42:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b0b59301-d3fa-4f2f-bce5-30578a68ec85 tempest-VolumeDependencyTests-307173949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:42:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b0b59301-d3fa-4f2f-bce5-30578a68ec85 tempest-VolumeDependencyTests-307173949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:01 devstack sudo[105539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:42:01 devstack sudo[105539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:02 devstack sudo[105539]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b0b59301-d3fa-4f2f-bce5-30578a68ec85 tempest-VolumeDependencyTests-307173949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.260s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:02 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-b0b59301-d3fa-4f2f-bce5-30578a68ec85 tempest-VolumeDependencyTests-307173949 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:42:02 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-b0b59301-d3fa-4f2f-bce5-30578a68ec85 tempest-VolumeDependencyTests-307173949 None] Deleted volume successfully.
Jul 14 16:42:02 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b0b59301-d3fa-4f2f-bce5-30578a68ec85 tempest-VolumeDependencyTests-307173949 None] Lock "cinder-8d097c6b-b693-4d0c-b7e2-4fa2c74c8236-delete_volume" released by "delete_volume" :: held 1.312s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:42:02 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7591f982-088a-4169-951c-539fae858d11 tempest-ProjectMemberTests-1242181671 None] Acquiring lock "cinder-afd7ab5b-70b4-4887-a8aa-71e0c2b355ac-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:42:02 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7591f982-088a-4169-951c-539fae858d11 tempest-ProjectMemberTests-1242181671 None] Lock "cinder-afd7ab5b-70b4-4887-a8aa-71e0c2b355ac-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:42:02 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7591f982-088a-4169-951c-539fae858d11 tempest-ProjectMemberTests-1242181671 None] Acquiring lock "cinder-quobyte-afd7ab5b-70b4-4887-a8aa-71e0c2b355ac" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:42:02 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7591f982-088a-4169-951c-539fae858d11 tempest-ProjectMemberTests-1242181671 None] Lock "cinder-quobyte-afd7ab5b-70b4-4887-a8aa-71e0c2b355ac" acquired by "delete_volume" :: waited 0.016s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:42:02 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[a806d230-36c0-4e14-8ff1-d0590d21da22]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:42:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7591f982-088a-4169-951c-539fae858d11 tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-afd7ab5b-70b4-4887-a8aa-71e0c2b355ac {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:02 devstack sudo[105542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-afd7ab5b-70b4-4887-a8aa-71e0c2b355ac
Jul 14 16:42:02 devstack sudo[105542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:02 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-93978f73-b521-4a75-a14b-aa100d74fb55 tempest-ProjectReaderTests-1127203843 None] Acquiring lock "cinder-c3755f8e-07d3-4a2a-96f5-614229eb2242-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:42:02 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-93978f73-b521-4a75-a14b-aa100d74fb55 tempest-ProjectReaderTests-1127203843 None] Lock "cinder-c3755f8e-07d3-4a2a-96f5-614229eb2242-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:42:02 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-93978f73-b521-4a75-a14b-aa100d74fb55 tempest-ProjectReaderTests-1127203843 None] Acquiring lock "cinder-quobyte-d0c8f3a1-c8cf-4f4b-a171-5bc2eb648463" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:42:02 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-93978f73-b521-4a75-a14b-aa100d74fb55 tempest-ProjectReaderTests-1127203843 None] Lock "cinder-quobyte-d0c8f3a1-c8cf-4f4b-a171-5bc2eb648463" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:42:02 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-93978f73-b521-4a75-a14b-aa100d74fb55 tempest-ProjectReaderTests-1127203843 None] Acquiring lock "cinder-quobyte-c3755f8e-07d3-4a2a-96f5-614229eb2242" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:42:02 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-93978f73-b521-4a75-a14b-aa100d74fb55 tempest-ProjectReaderTests-1127203843 None] Lock "cinder-quobyte-c3755f8e-07d3-4a2a-96f5-614229eb2242" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:42:02 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-93978f73-b521-4a75-a14b-aa100d74fb55 tempest-ProjectReaderTests-1127203843 None] Deleting offline snapshot c3755f8e-07d3-4a2a-96f5-614229eb2242 of volume d0c8f3a1-c8cf-4f4b-a171-5bc2eb648463 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 16:42:02 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-93978f73-b521-4a75-a14b-aa100d74fb55 tempest-ProjectReaderTests-1127203843 None] snapshot_file for this snap is: volume-d0c8f3a1-c8cf-4f4b-a171-5bc2eb648463.c3755f8e-07d3-4a2a-96f5-614229eb2242 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 16:42:02 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[54cbd1b4-0f44-4952-a7d1-8e375a32313d]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:42:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-93978f73-b521-4a75-a14b-aa100d74fb55 tempest-ProjectReaderTests-1127203843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d0c8f3a1-c8cf-4f4b-a171-5bc2eb648463.c3755f8e-07d3-4a2a-96f5-614229eb2242 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:02 devstack sudo[105542]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7591f982-088a-4169-951c-539fae858d11 tempest-ProjectMemberTests-1242181671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-afd7ab5b-70b4-4887-a8aa-71e0c2b355ac" returned: 0 in 0.487s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7591f982-088a-4169-951c-539fae858d11 tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-afd7ab5b-70b4-4887-a8aa-71e0c2b355ac {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:02 devstack sudo[105548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-afd7ab5b-70b4-4887-a8aa-71e0c2b355ac
Jul 14 16:42:02 devstack sudo[105548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:02 devstack sudo[105547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d0c8f3a1-c8cf-4f4b-a171-5bc2eb648463.c3755f8e-07d3-4a2a-96f5-614229eb2242
Jul 14 16:42:02 devstack sudo[105547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:03 devstack sudo[105548]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7591f982-088a-4169-951c-539fae858d11 tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-afd7ab5b-70b4-4887-a8aa-71e0c2b355ac" returned: 0 in 0.328s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:03 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7591f982-088a-4169-951c-539fae858d11 tempest-ProjectMemberTests-1242181671 None] Lock "cinder-quobyte-afd7ab5b-70b4-4887-a8aa-71e0c2b355ac" released by "delete_volume" :: held 0.887s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:42:03 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-7591f982-088a-4169-951c-539fae858d11 tempest-ProjectMemberTests-1242181671 None] Created reservations ['0f367e66-8f16-4a57-84ef-ed175b4d57f8', '1f09f6d5-83ff-437a-bc66-65b0a867a551', '0e920d66-b6ba-4204-873c-3e15df7ab048', '057b48a9-b5a2-4bd9-bdf8-4c826b34b4dd'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:42:03 devstack sudo[105547]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-93978f73-b521-4a75-a14b-aa100d74fb55 tempest-ProjectReaderTests-1127203843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d0c8f3a1-c8cf-4f4b-a171-5bc2eb648463.c3755f8e-07d3-4a2a-96f5-614229eb2242" returned: 0 in 0.539s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-93978f73-b521-4a75-a14b-aa100d74fb55 tempest-ProjectReaderTests-1127203843 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0c8f3a1-c8cf-4f4b-a171-5bc2eb648463(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 16:42:03 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c144ad8-ae80-4f1e-9719-4092fa6b06f6]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:42:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-93978f73-b521-4a75-a14b-aa100d74fb55 tempest-ProjectReaderTests-1127203843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d0c8f3a1-c8cf-4f4b-a171-5bc2eb648463 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-7591f982-088a-4169-951c-539fae858d11 tempest-ProjectMemberTests-1242181671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:42:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-7591f982-088a-4169-951c-539fae858d11 tempest-ProjectMemberTests-1242181671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:42:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-7591f982-088a-4169-951c-539fae858d11 tempest-ProjectMemberTests-1242181671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:42:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-7591f982-088a-4169-951c-539fae858d11 tempest-ProjectMemberTests-1242181671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:42:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-7591f982-088a-4169-951c-539fae858d11 tempest-ProjectMemberTests-1242181671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:42:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7591f982-088a-4169-951c-539fae858d11 tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:03 devstack sudo[105559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:42:03 devstack sudo[105559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:03 devstack sudo[105558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d0c8f3a1-c8cf-4f4b-a171-5bc2eb648463
Jul 14 16:42:03 devstack sudo[105558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:03 devstack sudo[105559]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7591f982-088a-4169-951c-539fae858d11 tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.385s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:03 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-7591f982-088a-4169-951c-539fae858d11 tempest-ProjectMemberTests-1242181671 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:42:03 devstack sudo[105558]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:03 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-7591f982-088a-4169-951c-539fae858d11 tempest-ProjectMemberTests-1242181671 None] Deleted volume successfully.
Jul 14 16:42:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-93978f73-b521-4a75-a14b-aa100d74fb55 tempest-ProjectReaderTests-1127203843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d0c8f3a1-c8cf-4f4b-a171-5bc2eb648463" returned: 0 in 0.468s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-93978f73-b521-4a75-a14b-aa100d74fb55 tempest-ProjectReaderTests-1127203843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d0c8f3a1-c8cf-4f4b-a171-5bc2eb648463.c3755f8e-07d3-4a2a-96f5-614229eb2242 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:03 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7591f982-088a-4169-951c-539fae858d11 tempest-ProjectMemberTests-1242181671 None] Lock "cinder-afd7ab5b-70b4-4887-a8aa-71e0c2b355ac-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:42:03 devstack sudo[105566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d0c8f3a1-c8cf-4f4b-a171-5bc2eb648463.c3755f8e-07d3-4a2a-96f5-614229eb2242
Jul 14 16:42:03 devstack sudo[105566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:04 devstack sudo[105566]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-93978f73-b521-4a75-a14b-aa100d74fb55 tempest-ProjectReaderTests-1127203843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d0c8f3a1-c8cf-4f4b-a171-5bc2eb648463.c3755f8e-07d3-4a2a-96f5-614229eb2242" returned: 0 in 0.414s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-93978f73-b521-4a75-a14b-aa100d74fb55 tempest-ProjectReaderTests-1127203843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d0c8f3a1-c8cf-4f4b-a171-5bc2eb648463.c3755f8e-07d3-4a2a-96f5-614229eb2242 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:04 devstack sudo[105571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d0c8f3a1-c8cf-4f4b-a171-5bc2eb648463.c3755f8e-07d3-4a2a-96f5-614229eb2242
Jul 14 16:42:04 devstack sudo[105571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:04 devstack sudo[105571]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-93978f73-b521-4a75-a14b-aa100d74fb55 tempest-ProjectReaderTests-1127203843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d0c8f3a1-c8cf-4f4b-a171-5bc2eb648463.c3755f8e-07d3-4a2a-96f5-614229eb2242" returned: 0 in 0.301s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:04 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-93978f73-b521-4a75-a14b-aa100d74fb55 tempest-ProjectReaderTests-1127203843 None] Lock "cinder-quobyte-c3755f8e-07d3-4a2a-96f5-614229eb2242" released by "_delete_snapshot" :: held 1.886s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:42:04 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-93978f73-b521-4a75-a14b-aa100d74fb55 tempest-ProjectReaderTests-1127203843 None] Lock "cinder-quobyte-d0c8f3a1-c8cf-4f4b-a171-5bc2eb648463" released by "delete_snapshot" :: held 1.918s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:42:04 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-93978f73-b521-4a75-a14b-aa100d74fb55 tempest-ProjectReaderTests-1127203843 None] Created reservations ['dbe60893-6be6-4dc6-8bc4-c2530b6d26f3', '23e6de81-e053-4dae-816b-d0a38cb8754b', '444c42b3-c528-426f-abd6-984f8e98b5ea', '378a6d06-d89c-4b33-875b-0c496d81fca3'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:42:04 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-93978f73-b521-4a75-a14b-aa100d74fb55 tempest-ProjectReaderTests-1127203843 None] Delete snapshot completed successfully.
Jul 14 16:42:04 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-93978f73-b521-4a75-a14b-aa100d74fb55 tempest-ProjectReaderTests-1127203843 None] Lock "cinder-c3755f8e-07d3-4a2a-96f5-614229eb2242-delete_snapshot" released by "delete_snapshot" :: held 2.096s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:42:05 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7bf42bf4-61e1-4de4-8aba-49de82b6632e tempest-ProjectReaderTests-1127203843 None] Acquiring lock "cinder-d0c8f3a1-c8cf-4f4b-a171-5bc2eb648463-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:42:05 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7bf42bf4-61e1-4de4-8aba-49de82b6632e tempest-ProjectReaderTests-1127203843 None] Lock "cinder-d0c8f3a1-c8cf-4f4b-a171-5bc2eb648463-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:42:05 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7bf42bf4-61e1-4de4-8aba-49de82b6632e tempest-ProjectReaderTests-1127203843 None] Acquiring lock "cinder-quobyte-d0c8f3a1-c8cf-4f4b-a171-5bc2eb648463" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:42:05 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7bf42bf4-61e1-4de4-8aba-49de82b6632e tempest-ProjectReaderTests-1127203843 None] Lock "cinder-quobyte-d0c8f3a1-c8cf-4f4b-a171-5bc2eb648463" acquired by "delete_volume" :: waited 0.015s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:42:05 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25dcf63-8972-485e-9145-2023127c8765]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:42:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7bf42bf4-61e1-4de4-8aba-49de82b6632e tempest-ProjectReaderTests-1127203843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d0c8f3a1-c8cf-4f4b-a171-5bc2eb648463 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:05 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff6f56ec-e478-43ec-bca4-b11344ff16bb tempest-ProjectMemberTests-1242181671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:42:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ff6f56ec-e478-43ec-bca4-b11344ff16bb tempest-ProjectMemberTests-1242181671 None] Flow 'volume_create_manager' (19ea6739-9729-4e60-8d27-dc48ca073da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:42:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ff6f56ec-e478-43ec-bca4-b11344ff16bb tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abb3104d-d805-4f0c-b8a6-c32f9e021341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:42:05 devstack sudo[105574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d0c8f3a1-c8cf-4f4b-a171-5bc2eb648463
Jul 14 16:42:05 devstack sudo[105574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ff6f56ec-e478-43ec-bca4-b11344ff16bb tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abb3104d-d805-4f0c-b8a6-c32f9e021341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:42:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-363986031',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9357a08c-640d-46f8-aeb8-73ab6d8ba443,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dfc230bd6d54b87b4b187751f9a7039',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:42:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:42:05Z,use_quota=True,user_id='68f1fe3510e3473e91988f26916b8e51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:42:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ff6f56ec-e478-43ec-bca4-b11344ff16bb tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8432bbc8-99fb-4f0a-a551-a00c61362360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:42:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ff6f56ec-e478-43ec-bca4-b11344ff16bb tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8432bbc8-99fb-4f0a-a551-a00c61362360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:42:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ff6f56ec-e478-43ec-bca4-b11344ff16bb tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5253509b-5780-4476-9a09-876713e4a674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:42:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ff6f56ec-e478-43ec-bca4-b11344ff16bb tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5253509b-5780-4476-9a09-876713e4a674) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9357a08c-640d-46f8-aeb8-73ab6d8ba443', 'volume_name': 'volume-9357a08c-640d-46f8-aeb8-73ab6d8ba443', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:42:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ff6f56ec-e478-43ec-bca4-b11344ff16bb tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fba64e8d-c757-41d8-ae4c-8d06f39fb4b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:42:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ff6f56ec-e478-43ec-bca4-b11344ff16bb tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fba64e8d-c757-41d8-ae4c-8d06f39fb4b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:42:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ff6f56ec-e478-43ec-bca4-b11344ff16bb tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfc48115-aae4-4bb4-ae17-442daa75a185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:42:05 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-ff6f56ec-e478-43ec-bca4-b11344ff16bb tempest-ProjectMemberTests-1242181671 None] Volume 9357a08c-640d-46f8-aeb8-73ab6d8ba443: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9357a08c-640d-46f8-aeb8-73ab6d8ba443', 'volume_size': 1}
Jul 14 16:42:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ff6f56ec-e478-43ec-bca4-b11344ff16bb tempest-ProjectMemberTests-1242181671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:42:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ff6f56ec-e478-43ec-bca4-b11344ff16bb tempest-ProjectMemberTests-1242181671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:42:05 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ff6f56ec-e478-43ec-bca4-b11344ff16bb tempest-ProjectMemberTests-1242181671 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:42:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-363986031',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9357a08c-640d-46f8-aeb8-73ab6d8ba443,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dfc230bd6d54b87b4b187751f9a7039',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:42:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:42:05Z,use_quota=True,user_id='68f1fe3510e3473e91988f26916b8e51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:42:05 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-ff6f56ec-e478-43ec-bca4-b11344ff16bb tempest-ProjectMemberTests-1242181671 None] Creating volume 9357a08c-640d-46f8-aeb8-73ab6d8ba443 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:42:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ff6f56ec-e478-43ec-bca4-b11344ff16bb tempest-ProjectMemberTests-1242181671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:42:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ff6f56ec-e478-43ec-bca4-b11344ff16bb tempest-ProjectMemberTests-1242181671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:42:05 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ff6f56ec-e478-43ec-bca4-b11344ff16bb tempest-ProjectMemberTests-1242181671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:42:05 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ff6f56ec-e478-43ec-bca4-b11344ff16bb tempest-ProjectMemberTests-1242181671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:42:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ff6f56ec-e478-43ec-bca4-b11344ff16bb tempest-ProjectMemberTests-1242181671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:42:05 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ff6f56ec-e478-43ec-bca4-b11344ff16bb tempest-ProjectMemberTests-1242181671 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:42:05 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-ff6f56ec-e478-43ec-bca4-b11344ff16bb tempest-ProjectMemberTests-1242181671 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:42:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ff6f56ec-e478-43ec-bca4-b11344ff16bb tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9357a08c-640d-46f8-aeb8-73ab6d8ba443 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:05 devstack sudo[105576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9357a08c-640d-46f8-aeb8-73ab6d8ba443 1073741824
Jul 14 16:42:05 devstack sudo[105576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:05 devstack sudo[105574]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7bf42bf4-61e1-4de4-8aba-49de82b6632e tempest-ProjectReaderTests-1127203843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d0c8f3a1-c8cf-4f4b-a171-5bc2eb648463" returned: 0 in 0.479s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7bf42bf4-61e1-4de4-8aba-49de82b6632e tempest-ProjectReaderTests-1127203843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d0c8f3a1-c8cf-4f4b-a171-5bc2eb648463 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:05 devstack sudo[105583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d0c8f3a1-c8cf-4f4b-a171-5bc2eb648463
Jul 14 16:42:05 devstack sudo[105583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:05 devstack sudo[105583]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7bf42bf4-61e1-4de4-8aba-49de82b6632e tempest-ProjectReaderTests-1127203843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-d0c8f3a1-c8cf-4f4b-a171-5bc2eb648463" returned: 0 in 0.294s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:05 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7bf42bf4-61e1-4de4-8aba-49de82b6632e tempest-ProjectReaderTests-1127203843 None] Lock "cinder-quobyte-d0c8f3a1-c8cf-4f4b-a171-5bc2eb648463" released by "delete_volume" :: held 0.855s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:42:05 devstack sudo[105576]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ff6f56ec-e478-43ec-bca4-b11344ff16bb tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9357a08c-640d-46f8-aeb8-73ab6d8ba443 1073741824" returned: 0 in 0.601s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ff6f56ec-e478-43ec-bca4-b11344ff16bb tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9357a08c-640d-46f8-aeb8-73ab6d8ba443 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:06 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-7bf42bf4-61e1-4de4-8aba-49de82b6632e tempest-ProjectReaderTests-1127203843 None] Created reservations ['44466815-1e95-4713-b344-ead7e2a9758e', 'a4a098db-d37e-40a4-b481-43d9abeb9eaa', '60fb0658-1ab9-4dfb-b975-ce230586073b', '9ae5e146-38ec-4c9a-be22-efd028c5cdeb'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:42:06 devstack sudo[105589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9357a08c-640d-46f8-aeb8-73ab6d8ba443
Jul 14 16:42:06 devstack sudo[105589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-7bf42bf4-61e1-4de4-8aba-49de82b6632e tempest-ProjectReaderTests-1127203843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:42:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-7bf42bf4-61e1-4de4-8aba-49de82b6632e tempest-ProjectReaderTests-1127203843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:42:06 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-7bf42bf4-61e1-4de4-8aba-49de82b6632e tempest-ProjectReaderTests-1127203843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:42:06 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-7bf42bf4-61e1-4de4-8aba-49de82b6632e tempest-ProjectReaderTests-1127203843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:42:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-7bf42bf4-61e1-4de4-8aba-49de82b6632e tempest-ProjectReaderTests-1127203843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:42:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7bf42bf4-61e1-4de4-8aba-49de82b6632e tempest-ProjectReaderTests-1127203843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:06 devstack sudo[105591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:42:06 devstack sudo[105591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:06 devstack sudo[105589]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ff6f56ec-e478-43ec-bca4-b11344ff16bb tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9357a08c-640d-46f8-aeb8-73ab6d8ba443" returned: 0 in 0.301s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:06 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ff6f56ec-e478-43ec-bca4-b11344ff16bb tempest-ProjectMemberTests-1242181671 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:42:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ff6f56ec-e478-43ec-bca4-b11344ff16bb tempest-ProjectMemberTests-1242181671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:42:06 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ff6f56ec-e478-43ec-bca4-b11344ff16bb tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfc48115-aae4-4bb4-ae17-442daa75a185) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9357a08c-640d-46f8-aeb8-73ab6d8ba443', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:42:06 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ff6f56ec-e478-43ec-bca4-b11344ff16bb tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb512355-3398-45c7-91bb-e646f619f21e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:42:06 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-ff6f56ec-e478-43ec-bca4-b11344ff16bb tempest-ProjectMemberTests-1242181671 None] Volume volume-9357a08c-640d-46f8-aeb8-73ab6d8ba443 (9357a08c-640d-46f8-aeb8-73ab6d8ba443): created successfully
Jul 14 16:42:06 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ff6f56ec-e478-43ec-bca4-b11344ff16bb tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb512355-3398-45c7-91bb-e646f619f21e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:42:06 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ff6f56ec-e478-43ec-bca4-b11344ff16bb tempest-ProjectMemberTests-1242181671 None] Flow 'volume_create_manager' (19ea6739-9729-4e60-8d27-dc48ca073da6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:42:06 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-ff6f56ec-e478-43ec-bca4-b11344ff16bb tempest-ProjectMemberTests-1242181671 None] Created volume successfully.
Jul 14 16:42:06 devstack sudo[105591]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7bf42bf4-61e1-4de4-8aba-49de82b6632e tempest-ProjectReaderTests-1127203843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.325s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:06 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-7bf42bf4-61e1-4de4-8aba-49de82b6632e tempest-ProjectReaderTests-1127203843 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:42:06 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-7bf42bf4-61e1-4de4-8aba-49de82b6632e tempest-ProjectReaderTests-1127203843 None] Deleted volume successfully.
Jul 14 16:42:06 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7bf42bf4-61e1-4de4-8aba-49de82b6632e tempest-ProjectReaderTests-1127203843 None] Lock "cinder-d0c8f3a1-c8cf-4f4b-a171-5bc2eb648463-delete_volume" released by "delete_volume" :: held 1.457s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:42:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-45082f72-986b-473e-900e-f7b4a3e87c5c tempest-ProjectMemberTests-1242181671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:42:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-45082f72-986b-473e-900e-f7b4a3e87c5c tempest-ProjectMemberTests-1242181671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:42:07 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-45082f72-986b-473e-900e-f7b4a3e87c5c tempest-ProjectMemberTests-1242181671 None] Creating offline snapshot f314be5f-4f72-481f-8ce6-8d3ccdbcbd00 of volume 9357a08c-640d-46f8-aeb8-73ab6d8ba443 {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 16:42:07 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d0852ec-351b-459f-93a6-7ff8f909b9cc]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:42:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-45082f72-986b-473e-900e-f7b4a3e87c5c tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9357a08c-640d-46f8-aeb8-73ab6d8ba443 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:07 devstack sudo[105595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9357a08c-640d-46f8-aeb8-73ab6d8ba443
Jul 14 16:42:07 devstack sudo[105595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:08 devstack sudo[105595]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-45082f72-986b-473e-900e-f7b4a3e87c5c tempest-ProjectMemberTests-1242181671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9357a08c-640d-46f8-aeb8-73ab6d8ba443" returned: 0 in 0.486s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-45082f72-986b-473e-900e-f7b4a3e87c5c tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9357a08c-640d-46f8-aeb8-73ab6d8ba443,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9357a08c-640d-46f8-aeb8-73ab6d8ba443.f314be5f-4f72-481f-8ce6-8d3ccdbcbd00 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:08 devstack sudo[105600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9357a08c-640d-46f8-aeb8-73ab6d8ba443,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9357a08c-640d-46f8-aeb8-73ab6d8ba443.f314be5f-4f72-481f-8ce6-8d3ccdbcbd00 1G
Jul 14 16:42:08 devstack sudo[105600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:08 devstack sudo[105600]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-45082f72-986b-473e-900e-f7b4a3e87c5c tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9357a08c-640d-46f8-aeb8-73ab6d8ba443,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9357a08c-640d-46f8-aeb8-73ab6d8ba443.f314be5f-4f72-481f-8ce6-8d3ccdbcbd00 1G" returned: 0 in 0.656s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-45082f72-986b-473e-900e-f7b4a3e87c5c tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9357a08c-640d-46f8-aeb8-73ab6d8ba443 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9357a08c-640d-46f8-aeb8-73ab6d8ba443.f314be5f-4f72-481f-8ce6-8d3ccdbcbd00 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:08 devstack sudo[105640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9357a08c-640d-46f8-aeb8-73ab6d8ba443 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9357a08c-640d-46f8-aeb8-73ab6d8ba443.f314be5f-4f72-481f-8ce6-8d3ccdbcbd00
Jul 14 16:42:08 devstack sudo[105640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:09 devstack sudo[105640]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-45082f72-986b-473e-900e-f7b4a3e87c5c tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9357a08c-640d-46f8-aeb8-73ab6d8ba443 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9357a08c-640d-46f8-aeb8-73ab6d8ba443.f314be5f-4f72-481f-8ce6-8d3ccdbcbd00" returned: 0 in 0.598s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:09 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-45082f72-986b-473e-900e-f7b4a3e87c5c tempest-ProjectMemberTests-1242181671 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9357a08c-640d-46f8-aeb8-73ab6d8ba443.f314be5f-4f72-481f-8ce6-8d3ccdbcbd00 is being set with open permissions: ugo+rw
Jul 14 16:42:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-45082f72-986b-473e-900e-f7b4a3e87c5c tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9357a08c-640d-46f8-aeb8-73ab6d8ba443.f314be5f-4f72-481f-8ce6-8d3ccdbcbd00 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:09 devstack sudo[105647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9357a08c-640d-46f8-aeb8-73ab6d8ba443.f314be5f-4f72-481f-8ce6-8d3ccdbcbd00
Jul 14 16:42:09 devstack sudo[105647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:09 devstack sudo[105647]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-45082f72-986b-473e-900e-f7b4a3e87c5c tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9357a08c-640d-46f8-aeb8-73ab6d8ba443.f314be5f-4f72-481f-8ce6-8d3ccdbcbd00" returned: 0 in 0.418s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-45082f72-986b-473e-900e-f7b4a3e87c5c tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9357a08c-640d-46f8-aeb8-73ab6d8ba443.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:09 devstack sudo[105651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9357a08c-640d-46f8-aeb8-73ab6d8ba443.info
Jul 14 16:42:09 devstack sudo[105651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:10 devstack sudo[105651]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-45082f72-986b-473e-900e-f7b4a3e87c5c tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9357a08c-640d-46f8-aeb8-73ab6d8ba443.info" returned: 0 in 0.300s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:10 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-45082f72-986b-473e-900e-f7b4a3e87c5c tempest-ProjectMemberTests-1242181671 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9357a08c-640d-46f8-aeb8-73ab6d8ba443.info is being set with open permissions: ugo+rw
Jul 14 16:42:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-45082f72-986b-473e-900e-f7b4a3e87c5c tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9357a08c-640d-46f8-aeb8-73ab6d8ba443.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:10 devstack sudo[105654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9357a08c-640d-46f8-aeb8-73ab6d8ba443.info
Jul 14 16:42:10 devstack sudo[105654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:10 devstack sudo[105654]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-45082f72-986b-473e-900e-f7b4a3e87c5c tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9357a08c-640d-46f8-aeb8-73ab6d8ba443.info" returned: 0 in 0.278s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-45082f72-986b-473e-900e-f7b4a3e87c5c tempest-ProjectMemberTests-1242181671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.879s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:42:10 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-45082f72-986b-473e-900e-f7b4a3e87c5c tempest-ProjectMemberTests-1242181671 None] Create snapshot completed successfully
Jul 14 16:42:10 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f6a1a93b-37a0-4ef3-905f-9f5fe97136ae tempest-ProjectMemberTests-1242181671 None] Acquiring lock "cinder-f314be5f-4f72-481f-8ce6-8d3ccdbcbd00-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:42:10 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f6a1a93b-37a0-4ef3-905f-9f5fe97136ae tempest-ProjectMemberTests-1242181671 None] Lock "cinder-f314be5f-4f72-481f-8ce6-8d3ccdbcbd00-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:42:10 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f6a1a93b-37a0-4ef3-905f-9f5fe97136ae tempest-ProjectMemberTests-1242181671 None] Acquiring lock "cinder-quobyte-9357a08c-640d-46f8-aeb8-73ab6d8ba443" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:42:10 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f6a1a93b-37a0-4ef3-905f-9f5fe97136ae tempest-ProjectMemberTests-1242181671 None] Lock "cinder-quobyte-9357a08c-640d-46f8-aeb8-73ab6d8ba443" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:42:10 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f6a1a93b-37a0-4ef3-905f-9f5fe97136ae tempest-ProjectMemberTests-1242181671 None] Acquiring lock "cinder-quobyte-f314be5f-4f72-481f-8ce6-8d3ccdbcbd00" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:42:10 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f6a1a93b-37a0-4ef3-905f-9f5fe97136ae tempest-ProjectMemberTests-1242181671 None] Lock "cinder-quobyte-f314be5f-4f72-481f-8ce6-8d3ccdbcbd00" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:42:10 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-f6a1a93b-37a0-4ef3-905f-9f5fe97136ae tempest-ProjectMemberTests-1242181671 None] Deleting offline snapshot f314be5f-4f72-481f-8ce6-8d3ccdbcbd00 of volume 9357a08c-640d-46f8-aeb8-73ab6d8ba443 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 16:42:10 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-f6a1a93b-37a0-4ef3-905f-9f5fe97136ae tempest-ProjectMemberTests-1242181671 None] snapshot_file for this snap is: volume-9357a08c-640d-46f8-aeb8-73ab6d8ba443.f314be5f-4f72-481f-8ce6-8d3ccdbcbd00 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 16:42:10 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[61721d7c-2814-442d-a7c9-b876bbe85c34]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:42:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f6a1a93b-37a0-4ef3-905f-9f5fe97136ae tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9357a08c-640d-46f8-aeb8-73ab6d8ba443.f314be5f-4f72-481f-8ce6-8d3ccdbcbd00 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:10 devstack sudo[105657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9357a08c-640d-46f8-aeb8-73ab6d8ba443.f314be5f-4f72-481f-8ce6-8d3ccdbcbd00
Jul 14 16:42:10 devstack sudo[105657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:11 devstack sudo[105657]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f6a1a93b-37a0-4ef3-905f-9f5fe97136ae tempest-ProjectMemberTests-1242181671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9357a08c-640d-46f8-aeb8-73ab6d8ba443.f314be5f-4f72-481f-8ce6-8d3ccdbcbd00" returned: 0 in 0.465s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:11 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-f6a1a93b-37a0-4ef3-905f-9f5fe97136ae tempest-ProjectMemberTests-1242181671 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9357a08c-640d-46f8-aeb8-73ab6d8ba443(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 16:42:11 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[60186f67-3d5f-43ab-9462-62a33d9a9e05]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:42:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f6a1a93b-37a0-4ef3-905f-9f5fe97136ae tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9357a08c-640d-46f8-aeb8-73ab6d8ba443 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:11 devstack sudo[105663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9357a08c-640d-46f8-aeb8-73ab6d8ba443
Jul 14 16:42:11 devstack sudo[105663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:11 devstack sudo[105663]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f6a1a93b-37a0-4ef3-905f-9f5fe97136ae tempest-ProjectMemberTests-1242181671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9357a08c-640d-46f8-aeb8-73ab6d8ba443" returned: 0 in 0.522s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f6a1a93b-37a0-4ef3-905f-9f5fe97136ae tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9357a08c-640d-46f8-aeb8-73ab6d8ba443.f314be5f-4f72-481f-8ce6-8d3ccdbcbd00 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:11 devstack sudo[105668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9357a08c-640d-46f8-aeb8-73ab6d8ba443.f314be5f-4f72-481f-8ce6-8d3ccdbcbd00
Jul 14 16:42:11 devstack sudo[105668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:12 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8b0942c-dcd0-4f9a-9607-6fb05fef8c66 tempest-ProjectReaderTests-659013378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:42:12 devstack sudo[105668]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f8b0942c-dcd0-4f9a-9607-6fb05fef8c66 tempest-ProjectReaderTests-659013378 None] Flow 'volume_create_manager' (d5cec1ba-88ad-469c-b790-d3fac2e18f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:42:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f8b0942c-dcd0-4f9a-9607-6fb05fef8c66 tempest-ProjectReaderTests-659013378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (921b42c0-1f58-44a3-8953-651c8b24dec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:42:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f6a1a93b-37a0-4ef3-905f-9f5fe97136ae tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9357a08c-640d-46f8-aeb8-73ab6d8ba443.f314be5f-4f72-481f-8ce6-8d3ccdbcbd00" returned: 0 in 0.557s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f6a1a93b-37a0-4ef3-905f-9f5fe97136ae tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9357a08c-640d-46f8-aeb8-73ab6d8ba443.f314be5f-4f72-481f-8ce6-8d3ccdbcbd00 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f8b0942c-dcd0-4f9a-9607-6fb05fef8c66 tempest-ProjectReaderTests-659013378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (921b42c0-1f58-44a3-8953-651c8b24dec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:42:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-649324431',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a453ba05-9a60-48ef-ae65-e9e0c57d080b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='404ddc33118a4b72ab5249ade74355fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:42:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:42:12Z,use_quota=True,user_id='bffec6788c294ad9893eb319872897fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:42:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f8b0942c-dcd0-4f9a-9607-6fb05fef8c66 tempest-ProjectReaderTests-659013378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba25adaa-1e8f-4fb8-809c-311de6663322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:42:12 devstack sudo[105677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9357a08c-640d-46f8-aeb8-73ab6d8ba443.f314be5f-4f72-481f-8ce6-8d3ccdbcbd00
Jul 14 16:42:12 devstack sudo[105677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f8b0942c-dcd0-4f9a-9607-6fb05fef8c66 tempest-ProjectReaderTests-659013378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba25adaa-1e8f-4fb8-809c-311de6663322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:42:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f8b0942c-dcd0-4f9a-9607-6fb05fef8c66 tempest-ProjectReaderTests-659013378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8123fad-02ec-4224-aeee-d2f26c4bb91f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:42:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f8b0942c-dcd0-4f9a-9607-6fb05fef8c66 tempest-ProjectReaderTests-659013378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8123fad-02ec-4224-aeee-d2f26c4bb91f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a453ba05-9a60-48ef-ae65-e9e0c57d080b', 'volume_name': 'volume-a453ba05-9a60-48ef-ae65-e9e0c57d080b', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:42:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f8b0942c-dcd0-4f9a-9607-6fb05fef8c66 tempest-ProjectReaderTests-659013378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c02b194-9602-4ad5-b8c4-fb7f6c2d12e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:42:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f8b0942c-dcd0-4f9a-9607-6fb05fef8c66 tempest-ProjectReaderTests-659013378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c02b194-9602-4ad5-b8c4-fb7f6c2d12e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:42:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f8b0942c-dcd0-4f9a-9607-6fb05fef8c66 tempest-ProjectReaderTests-659013378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbe0385c-c040-4296-9c1b-2ecc3211a9a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:42:12 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-f8b0942c-dcd0-4f9a-9607-6fb05fef8c66 tempest-ProjectReaderTests-659013378 None] Volume a453ba05-9a60-48ef-ae65-e9e0c57d080b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a453ba05-9a60-48ef-ae65-e9e0c57d080b', 'volume_size': 1}
Jul 14 16:42:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f8b0942c-dcd0-4f9a-9607-6fb05fef8c66 tempest-ProjectReaderTests-659013378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:42:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f8b0942c-dcd0-4f9a-9607-6fb05fef8c66 tempest-ProjectReaderTests-659013378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:42:12 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f8b0942c-dcd0-4f9a-9607-6fb05fef8c66 tempest-ProjectReaderTests-659013378 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:42:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-649324431',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a453ba05-9a60-48ef-ae65-e9e0c57d080b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='404ddc33118a4b72ab5249ade74355fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:42:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:42:12Z,use_quota=True,user_id='bffec6788c294ad9893eb319872897fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:42:12 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-f8b0942c-dcd0-4f9a-9607-6fb05fef8c66 tempest-ProjectReaderTests-659013378 None] Creating volume a453ba05-9a60-48ef-ae65-e9e0c57d080b {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:42:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f8b0942c-dcd0-4f9a-9607-6fb05fef8c66 tempest-ProjectReaderTests-659013378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:42:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f8b0942c-dcd0-4f9a-9607-6fb05fef8c66 tempest-ProjectReaderTests-659013378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:42:12 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f8b0942c-dcd0-4f9a-9607-6fb05fef8c66 tempest-ProjectReaderTests-659013378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:42:12 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f8b0942c-dcd0-4f9a-9607-6fb05fef8c66 tempest-ProjectReaderTests-659013378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:42:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f8b0942c-dcd0-4f9a-9607-6fb05fef8c66 tempest-ProjectReaderTests-659013378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:42:12 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f8b0942c-dcd0-4f9a-9607-6fb05fef8c66 tempest-ProjectReaderTests-659013378 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:42:12 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-f8b0942c-dcd0-4f9a-9607-6fb05fef8c66 tempest-ProjectReaderTests-659013378 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:42:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f8b0942c-dcd0-4f9a-9607-6fb05fef8c66 tempest-ProjectReaderTests-659013378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a453ba05-9a60-48ef-ae65-e9e0c57d080b 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:12 devstack sudo[105679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a453ba05-9a60-48ef-ae65-e9e0c57d080b 1073741824
Jul 14 16:42:12 devstack sudo[105679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:12 devstack sudo[105677]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f6a1a93b-37a0-4ef3-905f-9f5fe97136ae tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9357a08c-640d-46f8-aeb8-73ab6d8ba443.f314be5f-4f72-481f-8ce6-8d3ccdbcbd00" returned: 0 in 0.330s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:12 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f6a1a93b-37a0-4ef3-905f-9f5fe97136ae tempest-ProjectMemberTests-1242181671 None] Lock "cinder-quobyte-f314be5f-4f72-481f-8ce6-8d3ccdbcbd00" released by "_delete_snapshot" :: held 2.021s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:42:12 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f6a1a93b-37a0-4ef3-905f-9f5fe97136ae tempest-ProjectMemberTests-1242181671 None] Lock "cinder-quobyte-9357a08c-640d-46f8-aeb8-73ab6d8ba443" released by "delete_snapshot" :: held 2.062s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:42:12 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-f6a1a93b-37a0-4ef3-905f-9f5fe97136ae tempest-ProjectMemberTests-1242181671 None] Created reservations ['3b36fc33-c648-4de8-93b2-48789037d660', '8231c428-c892-4828-b689-34b2b367ba4b', 'f1436e5c-82bf-4982-8246-3c06e9107ee2', 'fb02047c-24a3-4cbc-9ed5-33617ee6b44d'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:42:12 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-f6a1a93b-37a0-4ef3-905f-9f5fe97136ae tempest-ProjectMemberTests-1242181671 None] Delete snapshot completed successfully.
Jul 14 16:42:12 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f6a1a93b-37a0-4ef3-905f-9f5fe97136ae tempest-ProjectMemberTests-1242181671 None] Lock "cinder-f314be5f-4f72-481f-8ce6-8d3ccdbcbd00-delete_snapshot" released by "delete_snapshot" :: held 2.251s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:42:13 devstack sudo[105679]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f8b0942c-dcd0-4f9a-9607-6fb05fef8c66 tempest-ProjectReaderTests-659013378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a453ba05-9a60-48ef-ae65-e9e0c57d080b 1073741824" returned: 0 in 0.654s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f8b0942c-dcd0-4f9a-9607-6fb05fef8c66 tempest-ProjectReaderTests-659013378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a453ba05-9a60-48ef-ae65-e9e0c57d080b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:13 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-bed3a8cd-61a7-4e08-b3d7-84373646973d tempest-ProjectMemberTests-1242181671 None] Acquiring lock "cinder-9357a08c-640d-46f8-aeb8-73ab6d8ba443-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:42:13 devstack sudo[105688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a453ba05-9a60-48ef-ae65-e9e0c57d080b
Jul 14 16:42:13 devstack sudo[105688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:13 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-bed3a8cd-61a7-4e08-b3d7-84373646973d tempest-ProjectMemberTests-1242181671 None] Lock "cinder-9357a08c-640d-46f8-aeb8-73ab6d8ba443-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:42:13 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-bed3a8cd-61a7-4e08-b3d7-84373646973d tempest-ProjectMemberTests-1242181671 None] Acquiring lock "cinder-quobyte-9357a08c-640d-46f8-aeb8-73ab6d8ba443" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:42:13 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-bed3a8cd-61a7-4e08-b3d7-84373646973d tempest-ProjectMemberTests-1242181671 None] Lock "cinder-quobyte-9357a08c-640d-46f8-aeb8-73ab6d8ba443" acquired by "delete_volume" :: waited 0.016s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:42:13 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[8983319d-0790-4963-a14d-4145aa416608]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:42:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bed3a8cd-61a7-4e08-b3d7-84373646973d tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9357a08c-640d-46f8-aeb8-73ab6d8ba443 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:13 devstack sudo[105688]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f8b0942c-dcd0-4f9a-9607-6fb05fef8c66 tempest-ProjectReaderTests-659013378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a453ba05-9a60-48ef-ae65-e9e0c57d080b" returned: 0 in 0.304s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:13 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f8b0942c-dcd0-4f9a-9607-6fb05fef8c66 tempest-ProjectReaderTests-659013378 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:42:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f8b0942c-dcd0-4f9a-9607-6fb05fef8c66 tempest-ProjectReaderTests-659013378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:42:13 devstack sudo[105690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9357a08c-640d-46f8-aeb8-73ab6d8ba443
Jul 14 16:42:13 devstack sudo[105690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:13 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f8b0942c-dcd0-4f9a-9607-6fb05fef8c66 tempest-ProjectReaderTests-659013378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbe0385c-c040-4296-9c1b-2ecc3211a9a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a453ba05-9a60-48ef-ae65-e9e0c57d080b', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:42:13 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f8b0942c-dcd0-4f9a-9607-6fb05fef8c66 tempest-ProjectReaderTests-659013378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5d20857-da46-4fe5-a23e-b10b89709a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:42:13 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-f8b0942c-dcd0-4f9a-9607-6fb05fef8c66 tempest-ProjectReaderTests-659013378 None] Volume volume-a453ba05-9a60-48ef-ae65-e9e0c57d080b (a453ba05-9a60-48ef-ae65-e9e0c57d080b): created successfully
Jul 14 16:42:13 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f8b0942c-dcd0-4f9a-9607-6fb05fef8c66 tempest-ProjectReaderTests-659013378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5d20857-da46-4fe5-a23e-b10b89709a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:42:13 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f8b0942c-dcd0-4f9a-9607-6fb05fef8c66 tempest-ProjectReaderTests-659013378 None] Flow 'volume_create_manager' (d5cec1ba-88ad-469c-b790-d3fac2e18f8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:42:13 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-f8b0942c-dcd0-4f9a-9607-6fb05fef8c66 tempest-ProjectReaderTests-659013378 None] Created volume successfully.
Jul 14 16:42:13 devstack sudo[105690]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bed3a8cd-61a7-4e08-b3d7-84373646973d tempest-ProjectMemberTests-1242181671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9357a08c-640d-46f8-aeb8-73ab6d8ba443" returned: 0 in 0.408s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bed3a8cd-61a7-4e08-b3d7-84373646973d tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9357a08c-640d-46f8-aeb8-73ab6d8ba443 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:13 devstack sudo[105697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9357a08c-640d-46f8-aeb8-73ab6d8ba443
Jul 14 16:42:13 devstack sudo[105697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:13 devstack sudo[105697]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bed3a8cd-61a7-4e08-b3d7-84373646973d tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-9357a08c-640d-46f8-aeb8-73ab6d8ba443" returned: 0 in 0.240s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:13 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-bed3a8cd-61a7-4e08-b3d7-84373646973d tempest-ProjectMemberTests-1242181671 None] Lock "cinder-quobyte-9357a08c-640d-46f8-aeb8-73ab6d8ba443" released by "delete_volume" :: held 0.718s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:42:14 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-bed3a8cd-61a7-4e08-b3d7-84373646973d tempest-ProjectMemberTests-1242181671 None] Created reservations ['6067f596-fc4e-486a-ba99-41383c3e1543', '8d6a665d-577f-4a56-beb7-006f07e30cb3', 'bdb088d5-0a0e-41fe-917b-cb616aa9b5eb', '84a7c74e-4a8a-43dd-808e-9b8bb9776a56'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:42:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-bed3a8cd-61a7-4e08-b3d7-84373646973d tempest-ProjectMemberTests-1242181671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:42:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-bed3a8cd-61a7-4e08-b3d7-84373646973d tempest-ProjectMemberTests-1242181671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:42:14 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-bed3a8cd-61a7-4e08-b3d7-84373646973d tempest-ProjectMemberTests-1242181671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:42:14 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-bed3a8cd-61a7-4e08-b3d7-84373646973d tempest-ProjectMemberTests-1242181671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:42:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-bed3a8cd-61a7-4e08-b3d7-84373646973d tempest-ProjectMemberTests-1242181671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:42:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bed3a8cd-61a7-4e08-b3d7-84373646973d tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:14 devstack sudo[105700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:42:14 devstack sudo[105700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:14 devstack sudo[105700]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bed3a8cd-61a7-4e08-b3d7-84373646973d tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.287s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:14 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-bed3a8cd-61a7-4e08-b3d7-84373646973d tempest-ProjectMemberTests-1242181671 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:42:14 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-bed3a8cd-61a7-4e08-b3d7-84373646973d tempest-ProjectMemberTests-1242181671 None] Deleted volume successfully.
Jul 14 16:42:14 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-bed3a8cd-61a7-4e08-b3d7-84373646973d tempest-ProjectMemberTests-1242181671 None] Lock "cinder-9357a08c-640d-46f8-aeb8-73ab6d8ba443-delete_volume" released by "delete_volume" :: held 1.273s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:42:14 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-76591dc2-ef97-4894-b80b-9d9115890c04 tempest-ProjectReaderTests-659013378 None] Acquiring lock "cinder-a453ba05-9a60-48ef-ae65-e9e0c57d080b-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:42:14 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-76591dc2-ef97-4894-b80b-9d9115890c04 tempest-ProjectReaderTests-659013378 None] Lock "cinder-a453ba05-9a60-48ef-ae65-e9e0c57d080b-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:42:14 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bae66f0-9489-4a1c-9eb9-58cc0a97eff0 tempest-ProjectMemberTests-1242181671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:42:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5bae66f0-9489-4a1c-9eb9-58cc0a97eff0 tempest-ProjectMemberTests-1242181671 None] Flow 'volume_create_manager' (c4639013-4666-456f-936e-63eee4a6e543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:42:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5bae66f0-9489-4a1c-9eb9-58cc0a97eff0 tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57894546-2547-46cf-bfdc-61e88658562f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:42:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5bae66f0-9489-4a1c-9eb9-58cc0a97eff0 tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57894546-2547-46cf-bfdc-61e88658562f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:42:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1930886325',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3a04428-a6ca-4e26-a255-81a002a3142f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dfc230bd6d54b87b4b187751f9a7039',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:42:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:42:15Z,use_quota=True,user_id='68f1fe3510e3473e91988f26916b8e51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:42:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5bae66f0-9489-4a1c-9eb9-58cc0a97eff0 tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7c63fee-e3eb-4897-ae51-19a627d9d818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:42:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5bae66f0-9489-4a1c-9eb9-58cc0a97eff0 tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7c63fee-e3eb-4897-ae51-19a627d9d818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:42:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5bae66f0-9489-4a1c-9eb9-58cc0a97eff0 tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81a6fc1a-afa1-44ae-8ebc-d58a211b7499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:42:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5bae66f0-9489-4a1c-9eb9-58cc0a97eff0 tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81a6fc1a-afa1-44ae-8ebc-d58a211b7499) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3a04428-a6ca-4e26-a255-81a002a3142f', 'volume_name': 'volume-e3a04428-a6ca-4e26-a255-81a002a3142f', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:42:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5bae66f0-9489-4a1c-9eb9-58cc0a97eff0 tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8b8a673-6578-4020-9ec8-da97821c28e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:42:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5bae66f0-9489-4a1c-9eb9-58cc0a97eff0 tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8b8a673-6578-4020-9ec8-da97821c28e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:42:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5bae66f0-9489-4a1c-9eb9-58cc0a97eff0 tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1d064d9-2524-411b-a10d-19d04d899d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:42:15 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-5bae66f0-9489-4a1c-9eb9-58cc0a97eff0 tempest-ProjectMemberTests-1242181671 None] Volume e3a04428-a6ca-4e26-a255-81a002a3142f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3a04428-a6ca-4e26-a255-81a002a3142f', 'volume_size': 1}
Jul 14 16:42:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5bae66f0-9489-4a1c-9eb9-58cc0a97eff0 tempest-ProjectMemberTests-1242181671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:42:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5bae66f0-9489-4a1c-9eb9-58cc0a97eff0 tempest-ProjectMemberTests-1242181671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:42:15 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5bae66f0-9489-4a1c-9eb9-58cc0a97eff0 tempest-ProjectMemberTests-1242181671 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:42:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1930886325',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3a04428-a6ca-4e26-a255-81a002a3142f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dfc230bd6d54b87b4b187751f9a7039',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:42:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:42:15Z,use_quota=True,user_id='68f1fe3510e3473e91988f26916b8e51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:42:15 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-5bae66f0-9489-4a1c-9eb9-58cc0a97eff0 tempest-ProjectMemberTests-1242181671 None] Creating volume e3a04428-a6ca-4e26-a255-81a002a3142f {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:42:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5bae66f0-9489-4a1c-9eb9-58cc0a97eff0 tempest-ProjectMemberTests-1242181671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:42:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5bae66f0-9489-4a1c-9eb9-58cc0a97eff0 tempest-ProjectMemberTests-1242181671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:42:15 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5bae66f0-9489-4a1c-9eb9-58cc0a97eff0 tempest-ProjectMemberTests-1242181671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:42:15 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5bae66f0-9489-4a1c-9eb9-58cc0a97eff0 tempest-ProjectMemberTests-1242181671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:42:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5bae66f0-9489-4a1c-9eb9-58cc0a97eff0 tempest-ProjectMemberTests-1242181671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:42:15 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5bae66f0-9489-4a1c-9eb9-58cc0a97eff0 tempest-ProjectMemberTests-1242181671 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:42:15 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-5bae66f0-9489-4a1c-9eb9-58cc0a97eff0 tempest-ProjectMemberTests-1242181671 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:42:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5bae66f0-9489-4a1c-9eb9-58cc0a97eff0 tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e3a04428-a6ca-4e26-a255-81a002a3142f 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:15 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-76591dc2-ef97-4894-b80b-9d9115890c04 tempest-ProjectReaderTests-659013378 None] Acquiring lock "cinder-quobyte-a453ba05-9a60-48ef-ae65-e9e0c57d080b" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:42:15 devstack sudo[105703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e3a04428-a6ca-4e26-a255-81a002a3142f 1073741824
Jul 14 16:42:15 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-76591dc2-ef97-4894-b80b-9d9115890c04 tempest-ProjectReaderTests-659013378 None] Lock "cinder-quobyte-a453ba05-9a60-48ef-ae65-e9e0c57d080b" acquired by "delete_volume" :: waited 0.023s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:42:15 devstack sudo[105703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:15 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[315f2305-9fa4-4ca5-9977-7b284acec927]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:42:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-76591dc2-ef97-4894-b80b-9d9115890c04 tempest-ProjectReaderTests-659013378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a453ba05-9a60-48ef-ae65-e9e0c57d080b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:15 devstack sudo[105705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a453ba05-9a60-48ef-ae65-e9e0c57d080b
Jul 14 16:42:15 devstack sudo[105705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:15 devstack sudo[105703]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5bae66f0-9489-4a1c-9eb9-58cc0a97eff0 tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e3a04428-a6ca-4e26-a255-81a002a3142f 1073741824" returned: 0 in 0.557s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:15 devstack sudo[105705]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-76591dc2-ef97-4894-b80b-9d9115890c04 tempest-ProjectReaderTests-659013378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a453ba05-9a60-48ef-ae65-e9e0c57d080b" returned: 0 in 0.479s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-76591dc2-ef97-4894-b80b-9d9115890c04 tempest-ProjectReaderTests-659013378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a453ba05-9a60-48ef-ae65-e9e0c57d080b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:15 devstack sudo[105714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a453ba05-9a60-48ef-ae65-e9e0c57d080b
Jul 14 16:42:15 devstack sudo[105714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5bae66f0-9489-4a1c-9eb9-58cc0a97eff0 tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e3a04428-a6ca-4e26-a255-81a002a3142f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:15 devstack sudo[105716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e3a04428-a6ca-4e26-a255-81a002a3142f
Jul 14 16:42:15 devstack sudo[105716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:15 devstack sudo[105714]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-76591dc2-ef97-4894-b80b-9d9115890c04 tempest-ProjectReaderTests-659013378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a453ba05-9a60-48ef-ae65-e9e0c57d080b" returned: 0 in 0.284s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:15 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-76591dc2-ef97-4894-b80b-9d9115890c04 tempest-ProjectReaderTests-659013378 None] Lock "cinder-quobyte-a453ba05-9a60-48ef-ae65-e9e0c57d080b" released by "delete_volume" :: held 0.842s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:42:16 devstack sudo[105716]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5bae66f0-9489-4a1c-9eb9-58cc0a97eff0 tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e3a04428-a6ca-4e26-a255-81a002a3142f" returned: 0 in 0.301s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:16 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5bae66f0-9489-4a1c-9eb9-58cc0a97eff0 tempest-ProjectMemberTests-1242181671 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:42:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5bae66f0-9489-4a1c-9eb9-58cc0a97eff0 tempest-ProjectMemberTests-1242181671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:42:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5bae66f0-9489-4a1c-9eb9-58cc0a97eff0 tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1d064d9-2524-411b-a10d-19d04d899d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3a04428-a6ca-4e26-a255-81a002a3142f', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:42:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5bae66f0-9489-4a1c-9eb9-58cc0a97eff0 tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f51c427-3f64-4482-b1c6-5e2a946ec25a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:42:16 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-5bae66f0-9489-4a1c-9eb9-58cc0a97eff0 tempest-ProjectMemberTests-1242181671 None] Volume volume-e3a04428-a6ca-4e26-a255-81a002a3142f (e3a04428-a6ca-4e26-a255-81a002a3142f): created successfully
Jul 14 16:42:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5bae66f0-9489-4a1c-9eb9-58cc0a97eff0 tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f51c427-3f64-4482-b1c6-5e2a946ec25a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:42:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5bae66f0-9489-4a1c-9eb9-58cc0a97eff0 tempest-ProjectMemberTests-1242181671 None] Flow 'volume_create_manager' (c4639013-4666-456f-936e-63eee4a6e543) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:42:16 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-5bae66f0-9489-4a1c-9eb9-58cc0a97eff0 tempest-ProjectMemberTests-1242181671 None] Created volume successfully.
Jul 14 16:42:16 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-76591dc2-ef97-4894-b80b-9d9115890c04 tempest-ProjectReaderTests-659013378 None] Created reservations ['90e9f2e4-88d8-411c-8d4c-b81e108b3982', '729ade54-842b-497a-bc2f-d1a6843e0f81', 'b5d57c8e-3a0d-4f90-807a-375e2bcffa5d', '783e4ccd-7016-40ea-8cb9-0096fd7ce5e4'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:42:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-76591dc2-ef97-4894-b80b-9d9115890c04 tempest-ProjectReaderTests-659013378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:42:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-76591dc2-ef97-4894-b80b-9d9115890c04 tempest-ProjectReaderTests-659013378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:42:16 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-76591dc2-ef97-4894-b80b-9d9115890c04 tempest-ProjectReaderTests-659013378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:42:16 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-76591dc2-ef97-4894-b80b-9d9115890c04 tempest-ProjectReaderTests-659013378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:42:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-76591dc2-ef97-4894-b80b-9d9115890c04 tempest-ProjectReaderTests-659013378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:42:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-76591dc2-ef97-4894-b80b-9d9115890c04 tempest-ProjectReaderTests-659013378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:16 devstack sudo[105722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:42:16 devstack sudo[105722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:16 devstack sudo[105722]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-76591dc2-ef97-4894-b80b-9d9115890c04 tempest-ProjectReaderTests-659013378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.247s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:16 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-76591dc2-ef97-4894-b80b-9d9115890c04 tempest-ProjectReaderTests-659013378 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:42:16 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-76591dc2-ef97-4894-b80b-9d9115890c04 tempest-ProjectReaderTests-659013378 None] Deleted volume successfully.
Jul 14 16:42:16 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-76591dc2-ef97-4894-b80b-9d9115890c04 tempest-ProjectReaderTests-659013378 None] Lock "cinder-a453ba05-9a60-48ef-ae65-e9e0c57d080b-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:42:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-21e00aca-ebb4-47f0-8c25-1907120235f8 tempest-ProjectMemberTests-1242181671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:42:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-21e00aca-ebb4-47f0-8c25-1907120235f8 tempest-ProjectMemberTests-1242181671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:42:17 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-21e00aca-ebb4-47f0-8c25-1907120235f8 tempest-ProjectMemberTests-1242181671 None] Creating offline snapshot 2315da88-187e-43f2-91ae-5eecf4bf8ba2 of volume e3a04428-a6ca-4e26-a255-81a002a3142f {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 16:42:17 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e8d429b-a27b-4e1a-a9b7-a39d42f7ec8a]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:42:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-21e00aca-ebb4-47f0-8c25-1907120235f8 tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e3a04428-a6ca-4e26-a255-81a002a3142f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:17 devstack sudo[105725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e3a04428-a6ca-4e26-a255-81a002a3142f
Jul 14 16:42:17 devstack sudo[105725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:17 devstack sudo[105725]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-21e00aca-ebb4-47f0-8c25-1907120235f8 tempest-ProjectMemberTests-1242181671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e3a04428-a6ca-4e26-a255-81a002a3142f" returned: 0 in 0.512s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-21e00aca-ebb4-47f0-8c25-1907120235f8 tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e3a04428-a6ca-4e26-a255-81a002a3142f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e3a04428-a6ca-4e26-a255-81a002a3142f.2315da88-187e-43f2-91ae-5eecf4bf8ba2 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:17 devstack sudo[105730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e3a04428-a6ca-4e26-a255-81a002a3142f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e3a04428-a6ca-4e26-a255-81a002a3142f.2315da88-187e-43f2-91ae-5eecf4bf8ba2 1G
Jul 14 16:42:17 devstack sudo[105730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:18 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-3722e518-8ea0-4676-aeb6-209d65c5caba tempest-ProjectReaderTests-659013378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:42:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3722e518-8ea0-4676-aeb6-209d65c5caba tempest-ProjectReaderTests-659013378 None] Flow 'volume_create_manager' (98fdd6a0-8b20-4c68-9ea2-b676c66e8ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:42:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3722e518-8ea0-4676-aeb6-209d65c5caba tempest-ProjectReaderTests-659013378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d66e7291-0d67-4fb9-8fce-d0b20e114e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:42:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3722e518-8ea0-4676-aeb6-209d65c5caba tempest-ProjectReaderTests-659013378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d66e7291-0d67-4fb9-8fce-d0b20e114e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:42:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1630913616',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fee34f8-6989-4b09-8953-aa323c735c2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='404ddc33118a4b72ab5249ade74355fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:42:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:42:18Z,use_quota=True,user_id='bffec6788c294ad9893eb319872897fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:42:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3722e518-8ea0-4676-aeb6-209d65c5caba tempest-ProjectReaderTests-659013378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75071935-c9c1-45f8-9903-5619336a9eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:42:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3722e518-8ea0-4676-aeb6-209d65c5caba tempest-ProjectReaderTests-659013378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75071935-c9c1-45f8-9903-5619336a9eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:42:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3722e518-8ea0-4676-aeb6-209d65c5caba tempest-ProjectReaderTests-659013378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05a1d46e-1fe1-4326-9552-91c3118a3ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:42:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3722e518-8ea0-4676-aeb6-209d65c5caba tempest-ProjectReaderTests-659013378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05a1d46e-1fe1-4326-9552-91c3118a3ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fee34f8-6989-4b09-8953-aa323c735c2a', 'volume_name': 'volume-4fee34f8-6989-4b09-8953-aa323c735c2a', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:42:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3722e518-8ea0-4676-aeb6-209d65c5caba tempest-ProjectReaderTests-659013378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f48cca0-32eb-44e5-a921-51502456be03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:42:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3722e518-8ea0-4676-aeb6-209d65c5caba tempest-ProjectReaderTests-659013378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f48cca0-32eb-44e5-a921-51502456be03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:42:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3722e518-8ea0-4676-aeb6-209d65c5caba tempest-ProjectReaderTests-659013378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (830ea0a4-a13d-4647-8062-bc09811a0dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:42:18 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-3722e518-8ea0-4676-aeb6-209d65c5caba tempest-ProjectReaderTests-659013378 None] Volume 4fee34f8-6989-4b09-8953-aa323c735c2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fee34f8-6989-4b09-8953-aa323c735c2a', 'volume_size': 1}
Jul 14 16:42:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3722e518-8ea0-4676-aeb6-209d65c5caba tempest-ProjectReaderTests-659013378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:42:18 devstack sudo[105730]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-21e00aca-ebb4-47f0-8c25-1907120235f8 tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e3a04428-a6ca-4e26-a255-81a002a3142f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e3a04428-a6ca-4e26-a255-81a002a3142f.2315da88-187e-43f2-91ae-5eecf4bf8ba2 1G" returned: 0 in 0.477s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-21e00aca-ebb4-47f0-8c25-1907120235f8 tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3a04428-a6ca-4e26-a255-81a002a3142f -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e3a04428-a6ca-4e26-a255-81a002a3142f.2315da88-187e-43f2-91ae-5eecf4bf8ba2 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:18 devstack sudo[105737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3a04428-a6ca-4e26-a255-81a002a3142f -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e3a04428-a6ca-4e26-a255-81a002a3142f.2315da88-187e-43f2-91ae-5eecf4bf8ba2
Jul 14 16:42:18 devstack sudo[105737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:18 devstack sudo[105737]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-21e00aca-ebb4-47f0-8c25-1907120235f8 tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3a04428-a6ca-4e26-a255-81a002a3142f -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e3a04428-a6ca-4e26-a255-81a002a3142f.2315da88-187e-43f2-91ae-5eecf4bf8ba2" returned: 0 in 0.364s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:18 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-21e00aca-ebb4-47f0-8c25-1907120235f8 tempest-ProjectMemberTests-1242181671 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e3a04428-a6ca-4e26-a255-81a002a3142f.2315da88-187e-43f2-91ae-5eecf4bf8ba2 is being set with open permissions: ugo+rw
Jul 14 16:42:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-21e00aca-ebb4-47f0-8c25-1907120235f8 tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e3a04428-a6ca-4e26-a255-81a002a3142f.2315da88-187e-43f2-91ae-5eecf4bf8ba2 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:18 devstack sudo[105743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e3a04428-a6ca-4e26-a255-81a002a3142f.2315da88-187e-43f2-91ae-5eecf4bf8ba2
Jul 14 16:42:18 devstack sudo[105743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:19 devstack sudo[105743]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-21e00aca-ebb4-47f0-8c25-1907120235f8 tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e3a04428-a6ca-4e26-a255-81a002a3142f.2315da88-187e-43f2-91ae-5eecf4bf8ba2" returned: 0 in 0.287s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-21e00aca-ebb4-47f0-8c25-1907120235f8 tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e3a04428-a6ca-4e26-a255-81a002a3142f.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:19 devstack sudo[105746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e3a04428-a6ca-4e26-a255-81a002a3142f.info
Jul 14 16:42:19 devstack sudo[105746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:19 devstack sudo[105746]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-21e00aca-ebb4-47f0-8c25-1907120235f8 tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e3a04428-a6ca-4e26-a255-81a002a3142f.info" returned: 0 in 0.289s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:19 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-21e00aca-ebb4-47f0-8c25-1907120235f8 tempest-ProjectMemberTests-1242181671 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e3a04428-a6ca-4e26-a255-81a002a3142f.info is being set with open permissions: ugo+rw
Jul 14 16:42:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-21e00aca-ebb4-47f0-8c25-1907120235f8 tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e3a04428-a6ca-4e26-a255-81a002a3142f.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:19 devstack sudo[105749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e3a04428-a6ca-4e26-a255-81a002a3142f.info
Jul 14 16:42:19 devstack sudo[105749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:19 devstack sudo[105749]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-21e00aca-ebb4-47f0-8c25-1907120235f8 tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e3a04428-a6ca-4e26-a255-81a002a3142f.info" returned: 0 in 0.257s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-21e00aca-ebb4-47f0-8c25-1907120235f8 tempest-ProjectMemberTests-1242181671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.296s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:42:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3722e518-8ea0-4676-aeb6-209d65c5caba tempest-ProjectReaderTests-659013378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.542s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:42:19 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-3722e518-8ea0-4676-aeb6-209d65c5caba tempest-ProjectReaderTests-659013378 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:42:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1630913616',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fee34f8-6989-4b09-8953-aa323c735c2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='404ddc33118a4b72ab5249ade74355fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:42:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:42:18Z,use_quota=True,user_id='bffec6788c294ad9893eb319872897fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:42:19 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-3722e518-8ea0-4676-aeb6-209d65c5caba tempest-ProjectReaderTests-659013378 None] Creating volume 4fee34f8-6989-4b09-8953-aa323c735c2a {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:42:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3722e518-8ea0-4676-aeb6-209d65c5caba tempest-ProjectReaderTests-659013378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:42:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3722e518-8ea0-4676-aeb6-209d65c5caba tempest-ProjectReaderTests-659013378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:42:19 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-3722e518-8ea0-4676-aeb6-209d65c5caba tempest-ProjectReaderTests-659013378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:42:19 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-3722e518-8ea0-4676-aeb6-209d65c5caba tempest-ProjectReaderTests-659013378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:42:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3722e518-8ea0-4676-aeb6-209d65c5caba tempest-ProjectReaderTests-659013378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:42:19 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-3722e518-8ea0-4676-aeb6-209d65c5caba tempest-ProjectReaderTests-659013378 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:42:19 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-3722e518-8ea0-4676-aeb6-209d65c5caba tempest-ProjectReaderTests-659013378 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:42:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3722e518-8ea0-4676-aeb6-209d65c5caba tempest-ProjectReaderTests-659013378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4fee34f8-6989-4b09-8953-aa323c735c2a 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:19 devstack sudo[105753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4fee34f8-6989-4b09-8953-aa323c735c2a 1073741824
Jul 14 16:42:19 devstack sudo[105753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:19 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-21e00aca-ebb4-47f0-8c25-1907120235f8 tempest-ProjectMemberTests-1242181671 None] Create snapshot completed successfully
Jul 14 16:42:20 devstack sudo[105753]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3722e518-8ea0-4676-aeb6-209d65c5caba tempest-ProjectReaderTests-659013378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4fee34f8-6989-4b09-8953-aa323c735c2a 1073741824" returned: 0 in 0.468s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3722e518-8ea0-4676-aeb6-209d65c5caba tempest-ProjectReaderTests-659013378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4fee34f8-6989-4b09-8953-aa323c735c2a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:20 devstack sudo[105759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4fee34f8-6989-4b09-8953-aa323c735c2a
Jul 14 16:42:20 devstack sudo[105759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:20 devstack sudo[105759]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3722e518-8ea0-4676-aeb6-209d65c5caba tempest-ProjectReaderTests-659013378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4fee34f8-6989-4b09-8953-aa323c735c2a" returned: 0 in 0.272s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:20 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-3722e518-8ea0-4676-aeb6-209d65c5caba tempest-ProjectReaderTests-659013378 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:42:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3722e518-8ea0-4676-aeb6-209d65c5caba tempest-ProjectReaderTests-659013378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:42:20 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3722e518-8ea0-4676-aeb6-209d65c5caba tempest-ProjectReaderTests-659013378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (830ea0a4-a13d-4647-8062-bc09811a0dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fee34f8-6989-4b09-8953-aa323c735c2a', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:42:20 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3722e518-8ea0-4676-aeb6-209d65c5caba tempest-ProjectReaderTests-659013378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34639da4-0d8c-4ce4-9a80-2ab0ce22e753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:42:20 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-3722e518-8ea0-4676-aeb6-209d65c5caba tempest-ProjectReaderTests-659013378 None] Volume volume-4fee34f8-6989-4b09-8953-aa323c735c2a (4fee34f8-6989-4b09-8953-aa323c735c2a): created successfully
Jul 14 16:42:20 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3722e518-8ea0-4676-aeb6-209d65c5caba tempest-ProjectReaderTests-659013378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34639da4-0d8c-4ce4-9a80-2ab0ce22e753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:42:20 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3722e518-8ea0-4676-aeb6-209d65c5caba tempest-ProjectReaderTests-659013378 None] Flow 'volume_create_manager' (98fdd6a0-8b20-4c68-9ea2-b676c66e8ce6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:42:20 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-3722e518-8ea0-4676-aeb6-209d65c5caba tempest-ProjectReaderTests-659013378 None] Created volume successfully.
Jul 14 16:42:20 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-bb373caf-b383-45b9-a794-35297167d183 tempest-ProjectMemberTests-1242181671 None] Acquiring lock "cinder-2315da88-187e-43f2-91ae-5eecf4bf8ba2-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:42:20 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-bb373caf-b383-45b9-a794-35297167d183 tempest-ProjectMemberTests-1242181671 None] Lock "cinder-2315da88-187e-43f2-91ae-5eecf4bf8ba2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:42:20 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-bb373caf-b383-45b9-a794-35297167d183 tempest-ProjectMemberTests-1242181671 None] Acquiring lock "cinder-quobyte-e3a04428-a6ca-4e26-a255-81a002a3142f" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:42:20 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-bb373caf-b383-45b9-a794-35297167d183 tempest-ProjectMemberTests-1242181671 None] Lock "cinder-quobyte-e3a04428-a6ca-4e26-a255-81a002a3142f" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:42:20 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-bb373caf-b383-45b9-a794-35297167d183 tempest-ProjectMemberTests-1242181671 None] Acquiring lock "cinder-quobyte-2315da88-187e-43f2-91ae-5eecf4bf8ba2" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:42:20 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-bb373caf-b383-45b9-a794-35297167d183 tempest-ProjectMemberTests-1242181671 None] Lock "cinder-quobyte-2315da88-187e-43f2-91ae-5eecf4bf8ba2" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:42:20 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-bb373caf-b383-45b9-a794-35297167d183 tempest-ProjectMemberTests-1242181671 None] Deleting offline snapshot 2315da88-187e-43f2-91ae-5eecf4bf8ba2 of volume e3a04428-a6ca-4e26-a255-81a002a3142f {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 16:42:20 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-bb373caf-b383-45b9-a794-35297167d183 tempest-ProjectMemberTests-1242181671 None] snapshot_file for this snap is: volume-e3a04428-a6ca-4e26-a255-81a002a3142f.2315da88-187e-43f2-91ae-5eecf4bf8ba2 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 16:42:20 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae5012e-6a85-465b-869c-3b7a1305b6d3]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:42:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bb373caf-b383-45b9-a794-35297167d183 tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e3a04428-a6ca-4e26-a255-81a002a3142f.2315da88-187e-43f2-91ae-5eecf4bf8ba2 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:20 devstack sudo[105762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e3a04428-a6ca-4e26-a255-81a002a3142f.2315da88-187e-43f2-91ae-5eecf4bf8ba2
Jul 14 16:42:20 devstack sudo[105762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:21 devstack sudo[105762]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bb373caf-b383-45b9-a794-35297167d183 tempest-ProjectMemberTests-1242181671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e3a04428-a6ca-4e26-a255-81a002a3142f.2315da88-187e-43f2-91ae-5eecf4bf8ba2" returned: 0 in 0.420s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:21 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-bb373caf-b383-45b9-a794-35297167d183 tempest-ProjectMemberTests-1242181671 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e3a04428-a6ca-4e26-a255-81a002a3142f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 16:42:21 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a8d679-9413-4393-b082-c4d80c190009]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:42:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bb373caf-b383-45b9-a794-35297167d183 tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e3a04428-a6ca-4e26-a255-81a002a3142f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:21 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-88f38145-f319-46a3-b78a-af65e4db44d6 tempest-ProjectReaderTests-659013378 None] Acquiring lock "cinder-4fee34f8-6989-4b09-8953-aa323c735c2a-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:42:21 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-88f38145-f319-46a3-b78a-af65e4db44d6 tempest-ProjectReaderTests-659013378 None] Lock "cinder-4fee34f8-6989-4b09-8953-aa323c735c2a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:42:21 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-88f38145-f319-46a3-b78a-af65e4db44d6 tempest-ProjectReaderTests-659013378 None] Acquiring lock "cinder-quobyte-4fee34f8-6989-4b09-8953-aa323c735c2a" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:42:21 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-88f38145-f319-46a3-b78a-af65e4db44d6 tempest-ProjectReaderTests-659013378 None] Lock "cinder-quobyte-4fee34f8-6989-4b09-8953-aa323c735c2a" acquired by "delete_volume" :: waited 0.014s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:42:21 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5501681-1e08-4d24-bbcb-085759b63e37]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:42:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-88f38145-f319-46a3-b78a-af65e4db44d6 tempest-ProjectReaderTests-659013378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4fee34f8-6989-4b09-8953-aa323c735c2a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:21 devstack sudo[105768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e3a04428-a6ca-4e26-a255-81a002a3142f
Jul 14 16:42:21 devstack sudo[105768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:21 devstack sudo[105770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4fee34f8-6989-4b09-8953-aa323c735c2a
Jul 14 16:42:21 devstack sudo[105770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:21 devstack sudo[105768]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bb373caf-b383-45b9-a794-35297167d183 tempest-ProjectMemberTests-1242181671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e3a04428-a6ca-4e26-a255-81a002a3142f" returned: 0 in 0.453s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bb373caf-b383-45b9-a794-35297167d183 tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e3a04428-a6ca-4e26-a255-81a002a3142f.2315da88-187e-43f2-91ae-5eecf4bf8ba2 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:21 devstack sudo[105777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e3a04428-a6ca-4e26-a255-81a002a3142f.2315da88-187e-43f2-91ae-5eecf4bf8ba2
Jul 14 16:42:21 devstack sudo[105777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:21 devstack sudo[105770]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-88f38145-f319-46a3-b78a-af65e4db44d6 tempest-ProjectReaderTests-659013378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4fee34f8-6989-4b09-8953-aa323c735c2a" returned: 0 in 0.417s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-88f38145-f319-46a3-b78a-af65e4db44d6 tempest-ProjectReaderTests-659013378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4fee34f8-6989-4b09-8953-aa323c735c2a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:21 devstack sudo[105780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4fee34f8-6989-4b09-8953-aa323c735c2a
Jul 14 16:42:21 devstack sudo[105780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:21 devstack sudo[105777]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bb373caf-b383-45b9-a794-35297167d183 tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e3a04428-a6ca-4e26-a255-81a002a3142f.2315da88-187e-43f2-91ae-5eecf4bf8ba2" returned: 0 in 0.415s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bb373caf-b383-45b9-a794-35297167d183 tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e3a04428-a6ca-4e26-a255-81a002a3142f.2315da88-187e-43f2-91ae-5eecf4bf8ba2 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:21 devstack sudo[105780]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-88f38145-f319-46a3-b78a-af65e4db44d6 tempest-ProjectReaderTests-659013378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-4fee34f8-6989-4b09-8953-aa323c735c2a" returned: 0 in 0.333s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:22 devstack sudo[105787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e3a04428-a6ca-4e26-a255-81a002a3142f.2315da88-187e-43f2-91ae-5eecf4bf8ba2
Jul 14 16:42:22 devstack sudo[105787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-88f38145-f319-46a3-b78a-af65e4db44d6 tempest-ProjectReaderTests-659013378 None] Lock "cinder-quobyte-4fee34f8-6989-4b09-8953-aa323c735c2a" released by "delete_volume" :: held 0.807s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:42:22 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-88f38145-f319-46a3-b78a-af65e4db44d6 tempest-ProjectReaderTests-659013378 None] Created reservations ['4354dd8f-57e3-4086-8f9a-96edbda14c08', '67ccddfb-4da8-46af-91c4-497cc2fdde9f', '9bb2f427-9e64-4894-8cd2-4289d93e1c55', 'cb1443ea-cfb2-4359-9a4e-f4b538fc64cf'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:42:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-88f38145-f319-46a3-b78a-af65e4db44d6 tempest-ProjectReaderTests-659013378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:42:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-88f38145-f319-46a3-b78a-af65e4db44d6 tempest-ProjectReaderTests-659013378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:42:22 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-88f38145-f319-46a3-b78a-af65e4db44d6 tempest-ProjectReaderTests-659013378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:42:22 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-88f38145-f319-46a3-b78a-af65e4db44d6 tempest-ProjectReaderTests-659013378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:42:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-88f38145-f319-46a3-b78a-af65e4db44d6 tempest-ProjectReaderTests-659013378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:42:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-88f38145-f319-46a3-b78a-af65e4db44d6 tempest-ProjectReaderTests-659013378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:22 devstack sudo[105789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:42:22 devstack sudo[105789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:22 devstack sudo[105787]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bb373caf-b383-45b9-a794-35297167d183 tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e3a04428-a6ca-4e26-a255-81a002a3142f.2315da88-187e-43f2-91ae-5eecf4bf8ba2" returned: 0 in 0.290s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-bb373caf-b383-45b9-a794-35297167d183 tempest-ProjectMemberTests-1242181671 None] Lock "cinder-quobyte-2315da88-187e-43f2-91ae-5eecf4bf8ba2" released by "_delete_snapshot" :: held 1.712s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:42:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-bb373caf-b383-45b9-a794-35297167d183 tempest-ProjectMemberTests-1242181671 None] Lock "cinder-quobyte-e3a04428-a6ca-4e26-a255-81a002a3142f" released by "delete_snapshot" :: held 1.739s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:42:22 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-bb373caf-b383-45b9-a794-35297167d183 tempest-ProjectMemberTests-1242181671 None] Created reservations ['adca8d01-4d8c-4504-aff8-3dffe4797f6c', '2dcbd8e0-8fa5-4632-a1aa-61bdff3f2597', 'b6902916-af39-4d07-9040-196b2725e9e5', 'b74309bb-c57e-4ff4-a0d6-695e70953b8b'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:42:22 devstack sudo[105789]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-88f38145-f319-46a3-b78a-af65e4db44d6 tempest-ProjectReaderTests-659013378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.288s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:22 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-88f38145-f319-46a3-b78a-af65e4db44d6 tempest-ProjectReaderTests-659013378 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:42:22 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-88f38145-f319-46a3-b78a-af65e4db44d6 tempest-ProjectReaderTests-659013378 None] Deleted volume successfully.
Jul 14 16:42:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-88f38145-f319-46a3-b78a-af65e4db44d6 tempest-ProjectReaderTests-659013378 None] Lock "cinder-4fee34f8-6989-4b09-8953-aa323c735c2a-delete_volume" released by "delete_volume" :: held 1.324s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:42:22 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-bb373caf-b383-45b9-a794-35297167d183 tempest-ProjectMemberTests-1242181671 None] Delete snapshot completed successfully.
Jul 14 16:42:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-bb373caf-b383-45b9-a794-35297167d183 tempest-ProjectMemberTests-1242181671 None] Lock "cinder-2315da88-187e-43f2-91ae-5eecf4bf8ba2-delete_snapshot" released by "delete_snapshot" :: held 1.956s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:42:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2c76773f-500b-4388-8cfa-3734dff0fddf tempest-ProjectMemberTests-1242181671 None] Acquiring lock "cinder-e3a04428-a6ca-4e26-a255-81a002a3142f-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:42:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2c76773f-500b-4388-8cfa-3734dff0fddf tempest-ProjectMemberTests-1242181671 None] Lock "cinder-e3a04428-a6ca-4e26-a255-81a002a3142f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:42:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2c76773f-500b-4388-8cfa-3734dff0fddf tempest-ProjectMemberTests-1242181671 None] Acquiring lock "cinder-quobyte-e3a04428-a6ca-4e26-a255-81a002a3142f" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:42:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2c76773f-500b-4388-8cfa-3734dff0fddf tempest-ProjectMemberTests-1242181671 None] Lock "cinder-quobyte-e3a04428-a6ca-4e26-a255-81a002a3142f" acquired by "delete_volume" :: waited 0.022s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:42:22 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[720d18c0-ca37-4554-9419-bab072f79df3]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:42:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2c76773f-500b-4388-8cfa-3734dff0fddf tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e3a04428-a6ca-4e26-a255-81a002a3142f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:22 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1228bef-34c1-4569-836c-7128560bec63 tempest-ProjectReaderTests-659013378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:42:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d1228bef-34c1-4569-836c-7128560bec63 tempest-ProjectReaderTests-659013378 None] Flow 'volume_create_manager' (9738de33-d4d8-4c8d-b728-e000aa8b4140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:42:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d1228bef-34c1-4569-836c-7128560bec63 tempest-ProjectReaderTests-659013378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7e2b198-321e-46c4-9a5f-5369d515d7e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:42:23 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d1228bef-34c1-4569-836c-7128560bec63 tempest-ProjectReaderTests-659013378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7e2b198-321e-46c4-9a5f-5369d515d7e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:42:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1506616712',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=556b8f5f-a040-4c5e-941a-e3495f2fc65a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='404ddc33118a4b72ab5249ade74355fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:42:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:42:23Z,use_quota=True,user_id='bffec6788c294ad9893eb319872897fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:42:23 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d1228bef-34c1-4569-836c-7128560bec63 tempest-ProjectReaderTests-659013378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b688361-baec-4694-b5dd-23bce8c8f52e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:42:23 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d1228bef-34c1-4569-836c-7128560bec63 tempest-ProjectReaderTests-659013378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b688361-baec-4694-b5dd-23bce8c8f52e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:42:23 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d1228bef-34c1-4569-836c-7128560bec63 tempest-ProjectReaderTests-659013378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1e1a1ba-f586-469a-afcc-205798575eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:42:23 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d1228bef-34c1-4569-836c-7128560bec63 tempest-ProjectReaderTests-659013378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1e1a1ba-f586-469a-afcc-205798575eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '556b8f5f-a040-4c5e-941a-e3495f2fc65a', 'volume_name': 'volume-556b8f5f-a040-4c5e-941a-e3495f2fc65a', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:42:23 devstack sudo[105793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e3a04428-a6ca-4e26-a255-81a002a3142f
Jul 14 16:42:23 devstack sudo[105793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:23 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d1228bef-34c1-4569-836c-7128560bec63 tempest-ProjectReaderTests-659013378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c6a34f8-c2c2-49cf-a4d4-e7e53b830e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:42:23 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d1228bef-34c1-4569-836c-7128560bec63 tempest-ProjectReaderTests-659013378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c6a34f8-c2c2-49cf-a4d4-e7e53b830e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:42:23 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d1228bef-34c1-4569-836c-7128560bec63 tempest-ProjectReaderTests-659013378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e4c60f2-a641-4e7a-805d-bb113cd2926b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:42:23 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-d1228bef-34c1-4569-836c-7128560bec63 tempest-ProjectReaderTests-659013378 None] Volume 556b8f5f-a040-4c5e-941a-e3495f2fc65a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-556b8f5f-a040-4c5e-941a-e3495f2fc65a', 'volume_size': 1}
Jul 14 16:42:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d1228bef-34c1-4569-836c-7128560bec63 tempest-ProjectReaderTests-659013378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:42:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d1228bef-34c1-4569-836c-7128560bec63 tempest-ProjectReaderTests-659013378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:42:23 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d1228bef-34c1-4569-836c-7128560bec63 tempest-ProjectReaderTests-659013378 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:42:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1506616712',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=556b8f5f-a040-4c5e-941a-e3495f2fc65a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='404ddc33118a4b72ab5249ade74355fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:42:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:42:23Z,use_quota=True,user_id='bffec6788c294ad9893eb319872897fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:42:23 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-d1228bef-34c1-4569-836c-7128560bec63 tempest-ProjectReaderTests-659013378 None] Creating volume 556b8f5f-a040-4c5e-941a-e3495f2fc65a {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:42:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d1228bef-34c1-4569-836c-7128560bec63 tempest-ProjectReaderTests-659013378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:42:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d1228bef-34c1-4569-836c-7128560bec63 tempest-ProjectReaderTests-659013378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:42:23 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d1228bef-34c1-4569-836c-7128560bec63 tempest-ProjectReaderTests-659013378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:42:23 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d1228bef-34c1-4569-836c-7128560bec63 tempest-ProjectReaderTests-659013378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:42:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d1228bef-34c1-4569-836c-7128560bec63 tempest-ProjectReaderTests-659013378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:42:23 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d1228bef-34c1-4569-836c-7128560bec63 tempest-ProjectReaderTests-659013378 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:42:23 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-d1228bef-34c1-4569-836c-7128560bec63 tempest-ProjectReaderTests-659013378 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:42:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d1228bef-34c1-4569-836c-7128560bec63 tempest-ProjectReaderTests-659013378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-556b8f5f-a040-4c5e-941a-e3495f2fc65a 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:23 devstack sudo[105795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-556b8f5f-a040-4c5e-941a-e3495f2fc65a 1073741824
Jul 14 16:42:23 devstack sudo[105795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:23 devstack sudo[105793]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2c76773f-500b-4388-8cfa-3734dff0fddf tempest-ProjectMemberTests-1242181671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e3a04428-a6ca-4e26-a255-81a002a3142f" returned: 0 in 0.408s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2c76773f-500b-4388-8cfa-3734dff0fddf tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e3a04428-a6ca-4e26-a255-81a002a3142f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:23 devstack sudo[105802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e3a04428-a6ca-4e26-a255-81a002a3142f
Jul 14 16:42:23 devstack sudo[105802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:23 devstack sudo[105795]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d1228bef-34c1-4569-836c-7128560bec63 tempest-ProjectReaderTests-659013378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-556b8f5f-a040-4c5e-941a-e3495f2fc65a 1073741824" returned: 0 in 0.526s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:23 devstack sudo[105802]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2c76773f-500b-4388-8cfa-3734dff0fddf tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e3a04428-a6ca-4e26-a255-81a002a3142f" returned: 0 in 0.308s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d1228bef-34c1-4569-836c-7128560bec63 tempest-ProjectReaderTests-659013378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-556b8f5f-a040-4c5e-941a-e3495f2fc65a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:23 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2c76773f-500b-4388-8cfa-3734dff0fddf tempest-ProjectMemberTests-1242181671 None] Lock "cinder-quobyte-e3a04428-a6ca-4e26-a255-81a002a3142f" released by "delete_volume" :: held 0.818s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:42:23 devstack sudo[105807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-556b8f5f-a040-4c5e-941a-e3495f2fc65a
Jul 14 16:42:23 devstack sudo[105807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:23 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-2c76773f-500b-4388-8cfa-3734dff0fddf tempest-ProjectMemberTests-1242181671 None] Created reservations ['1e8f6e96-05c5-4cc4-a5f1-79e733f6eef3', '833fb140-c978-4f4f-8c3a-b726b52be7f8', '7e34a0d8-f6e6-4bdc-be7e-fabe43b7d0a8', '461568e3-c66d-408a-9775-6e774d09c6e0'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:42:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2c76773f-500b-4388-8cfa-3734dff0fddf tempest-ProjectMemberTests-1242181671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:42:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2c76773f-500b-4388-8cfa-3734dff0fddf tempest-ProjectMemberTests-1242181671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:42:23 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2c76773f-500b-4388-8cfa-3734dff0fddf tempest-ProjectMemberTests-1242181671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:42:23 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2c76773f-500b-4388-8cfa-3734dff0fddf tempest-ProjectMemberTests-1242181671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:42:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2c76773f-500b-4388-8cfa-3734dff0fddf tempest-ProjectMemberTests-1242181671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:42:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2c76773f-500b-4388-8cfa-3734dff0fddf tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:23 devstack sudo[105809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:42:23 devstack sudo[105809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:23 devstack sudo[105807]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d1228bef-34c1-4569-836c-7128560bec63 tempest-ProjectReaderTests-659013378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-556b8f5f-a040-4c5e-941a-e3495f2fc65a" returned: 0 in 0.314s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:23 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d1228bef-34c1-4569-836c-7128560bec63 tempest-ProjectReaderTests-659013378 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:42:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d1228bef-34c1-4569-836c-7128560bec63 tempest-ProjectReaderTests-659013378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:42:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d1228bef-34c1-4569-836c-7128560bec63 tempest-ProjectReaderTests-659013378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e4c60f2-a641-4e7a-805d-bb113cd2926b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-556b8f5f-a040-4c5e-941a-e3495f2fc65a', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:42:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d1228bef-34c1-4569-836c-7128560bec63 tempest-ProjectReaderTests-659013378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e120f379-8af2-4653-8916-57bbeef5f743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:42:24 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-d1228bef-34c1-4569-836c-7128560bec63 tempest-ProjectReaderTests-659013378 None] Volume volume-556b8f5f-a040-4c5e-941a-e3495f2fc65a (556b8f5f-a040-4c5e-941a-e3495f2fc65a): created successfully
Jul 14 16:42:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d1228bef-34c1-4569-836c-7128560bec63 tempest-ProjectReaderTests-659013378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e120f379-8af2-4653-8916-57bbeef5f743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:42:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d1228bef-34c1-4569-836c-7128560bec63 tempest-ProjectReaderTests-659013378 None] Flow 'volume_create_manager' (9738de33-d4d8-4c8d-b728-e000aa8b4140) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:42:24 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-d1228bef-34c1-4569-836c-7128560bec63 tempest-ProjectReaderTests-659013378 None] Created volume successfully.
Jul 14 16:42:24 devstack sudo[105809]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2c76773f-500b-4388-8cfa-3734dff0fddf tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.315s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:24 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-2c76773f-500b-4388-8cfa-3734dff0fddf tempest-ProjectMemberTests-1242181671 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:42:24 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-2c76773f-500b-4388-8cfa-3734dff0fddf tempest-ProjectMemberTests-1242181671 None] Deleted volume successfully.
Jul 14 16:42:24 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2c76773f-500b-4388-8cfa-3734dff0fddf tempest-ProjectMemberTests-1242181671 None] Lock "cinder-e3a04428-a6ca-4e26-a255-81a002a3142f-delete_volume" released by "delete_volume" :: held 1.402s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:42:24 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae227bcf-5ddb-47e5-b56d-e96eb52e75f0 tempest-ProjectMemberTests-1242181671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:42:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ae227bcf-5ddb-47e5-b56d-e96eb52e75f0 tempest-ProjectMemberTests-1242181671 None] Flow 'volume_create_manager' (449610a8-7d34-4ad8-89e9-06a2b02004cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:42:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ae227bcf-5ddb-47e5-b56d-e96eb52e75f0 tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a49a129e-d8c3-429a-aee9-cd71001bb8b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:42:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ae227bcf-5ddb-47e5-b56d-e96eb52e75f0 tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a49a129e-d8c3-429a-aee9-cd71001bb8b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:42:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1683202876',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62948f79-ac10-4e1c-bc31-4ef3cd66de52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dfc230bd6d54b87b4b187751f9a7039',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:42:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:42:24Z,use_quota=True,user_id='68f1fe3510e3473e91988f26916b8e51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:42:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ae227bcf-5ddb-47e5-b56d-e96eb52e75f0 tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbfee9b9-2400-4524-a7b5-75a35d6cc2d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:42:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ae227bcf-5ddb-47e5-b56d-e96eb52e75f0 tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbfee9b9-2400-4524-a7b5-75a35d6cc2d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:42:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ae227bcf-5ddb-47e5-b56d-e96eb52e75f0 tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccc233bd-8e98-4ca5-a0ae-2beae0954cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:42:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ae227bcf-5ddb-47e5-b56d-e96eb52e75f0 tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccc233bd-8e98-4ca5-a0ae-2beae0954cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62948f79-ac10-4e1c-bc31-4ef3cd66de52', 'volume_name': 'volume-62948f79-ac10-4e1c-bc31-4ef3cd66de52', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:42:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ae227bcf-5ddb-47e5-b56d-e96eb52e75f0 tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (783ddfc8-a9ec-4ace-bb23-d93f55e3fbcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:42:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ae227bcf-5ddb-47e5-b56d-e96eb52e75f0 tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (783ddfc8-a9ec-4ace-bb23-d93f55e3fbcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:42:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ae227bcf-5ddb-47e5-b56d-e96eb52e75f0 tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9c0bcc9-8207-477a-b46c-aa8df887cbe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:42:24 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-ae227bcf-5ddb-47e5-b56d-e96eb52e75f0 tempest-ProjectMemberTests-1242181671 None] Volume 62948f79-ac10-4e1c-bc31-4ef3cd66de52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62948f79-ac10-4e1c-bc31-4ef3cd66de52', 'volume_size': 1}
Jul 14 16:42:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ae227bcf-5ddb-47e5-b56d-e96eb52e75f0 tempest-ProjectMemberTests-1242181671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:42:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ae227bcf-5ddb-47e5-b56d-e96eb52e75f0 tempest-ProjectMemberTests-1242181671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:42:24 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ae227bcf-5ddb-47e5-b56d-e96eb52e75f0 tempest-ProjectMemberTests-1242181671 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:42:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1683202876',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62948f79-ac10-4e1c-bc31-4ef3cd66de52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dfc230bd6d54b87b4b187751f9a7039',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:42:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:42:24Z,use_quota=True,user_id='68f1fe3510e3473e91988f26916b8e51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:42:24 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-ae227bcf-5ddb-47e5-b56d-e96eb52e75f0 tempest-ProjectMemberTests-1242181671 None] Creating volume 62948f79-ac10-4e1c-bc31-4ef3cd66de52 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:42:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ae227bcf-5ddb-47e5-b56d-e96eb52e75f0 tempest-ProjectMemberTests-1242181671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:42:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ae227bcf-5ddb-47e5-b56d-e96eb52e75f0 tempest-ProjectMemberTests-1242181671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:42:24 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ae227bcf-5ddb-47e5-b56d-e96eb52e75f0 tempest-ProjectMemberTests-1242181671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:42:24 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ae227bcf-5ddb-47e5-b56d-e96eb52e75f0 tempest-ProjectMemberTests-1242181671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:42:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ae227bcf-5ddb-47e5-b56d-e96eb52e75f0 tempest-ProjectMemberTests-1242181671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:42:24 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ae227bcf-5ddb-47e5-b56d-e96eb52e75f0 tempest-ProjectMemberTests-1242181671 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:42:24 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-ae227bcf-5ddb-47e5-b56d-e96eb52e75f0 tempest-ProjectMemberTests-1242181671 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:42:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ae227bcf-5ddb-47e5-b56d-e96eb52e75f0 tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-62948f79-ac10-4e1c-bc31-4ef3cd66de52 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:24 devstack sudo[105813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-62948f79-ac10-4e1c-bc31-4ef3cd66de52 1073741824
Jul 14 16:42:24 devstack sudo[105813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:25 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a06c8c75-1e96-40c8-8f8f-875e384d4506 tempest-ProjectReaderTests-659013378 None] Acquiring lock "cinder-556b8f5f-a040-4c5e-941a-e3495f2fc65a-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:42:25 devstack sudo[105813]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ae227bcf-5ddb-47e5-b56d-e96eb52e75f0 tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-62948f79-ac10-4e1c-bc31-4ef3cd66de52 1073741824" returned: 0 in 0.471s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:25 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a06c8c75-1e96-40c8-8f8f-875e384d4506 tempest-ProjectReaderTests-659013378 None] Lock "cinder-556b8f5f-a040-4c5e-941a-e3495f2fc65a-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:42:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ae227bcf-5ddb-47e5-b56d-e96eb52e75f0 tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-62948f79-ac10-4e1c-bc31-4ef3cd66de52 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:25 devstack sudo[105819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-62948f79-ac10-4e1c-bc31-4ef3cd66de52
Jul 14 16:42:25 devstack sudo[105819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:25 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a06c8c75-1e96-40c8-8f8f-875e384d4506 tempest-ProjectReaderTests-659013378 None] Acquiring lock "cinder-quobyte-556b8f5f-a040-4c5e-941a-e3495f2fc65a" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:42:25 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a06c8c75-1e96-40c8-8f8f-875e384d4506 tempest-ProjectReaderTests-659013378 None] Lock "cinder-quobyte-556b8f5f-a040-4c5e-941a-e3495f2fc65a" acquired by "delete_volume" :: waited 0.023s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:42:25 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a1faa7-8b15-4f1e-90c2-6cf08fafc66e]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:42:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a06c8c75-1e96-40c8-8f8f-875e384d4506 tempest-ProjectReaderTests-659013378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-556b8f5f-a040-4c5e-941a-e3495f2fc65a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:25 devstack sudo[105821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-556b8f5f-a040-4c5e-941a-e3495f2fc65a
Jul 14 16:42:25 devstack sudo[105821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:25 devstack sudo[105819]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ae227bcf-5ddb-47e5-b56d-e96eb52e75f0 tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-62948f79-ac10-4e1c-bc31-4ef3cd66de52" returned: 0 in 0.305s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:25 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ae227bcf-5ddb-47e5-b56d-e96eb52e75f0 tempest-ProjectMemberTests-1242181671 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:42:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ae227bcf-5ddb-47e5-b56d-e96eb52e75f0 tempest-ProjectMemberTests-1242181671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:42:25 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ae227bcf-5ddb-47e5-b56d-e96eb52e75f0 tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9c0bcc9-8207-477a-b46c-aa8df887cbe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62948f79-ac10-4e1c-bc31-4ef3cd66de52', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:42:25 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ae227bcf-5ddb-47e5-b56d-e96eb52e75f0 tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66da8ed8-f3dd-43e7-92bd-89fa0048de28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:42:25 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-ae227bcf-5ddb-47e5-b56d-e96eb52e75f0 tempest-ProjectMemberTests-1242181671 None] Volume volume-62948f79-ac10-4e1c-bc31-4ef3cd66de52 (62948f79-ac10-4e1c-bc31-4ef3cd66de52): created successfully
Jul 14 16:42:25 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ae227bcf-5ddb-47e5-b56d-e96eb52e75f0 tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66da8ed8-f3dd-43e7-92bd-89fa0048de28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:42:25 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ae227bcf-5ddb-47e5-b56d-e96eb52e75f0 tempest-ProjectMemberTests-1242181671 None] Flow 'volume_create_manager' (449610a8-7d34-4ad8-89e9-06a2b02004cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:42:25 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-ae227bcf-5ddb-47e5-b56d-e96eb52e75f0 tempest-ProjectMemberTests-1242181671 None] Created volume successfully.
Jul 14 16:42:25 devstack sudo[105821]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a06c8c75-1e96-40c8-8f8f-875e384d4506 tempest-ProjectReaderTests-659013378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-556b8f5f-a040-4c5e-941a-e3495f2fc65a" returned: 0 in 0.401s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a06c8c75-1e96-40c8-8f8f-875e384d4506 tempest-ProjectReaderTests-659013378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-556b8f5f-a040-4c5e-941a-e3495f2fc65a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:25 devstack sudo[105827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-556b8f5f-a040-4c5e-941a-e3495f2fc65a
Jul 14 16:42:25 devstack sudo[105827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:25 devstack sudo[105827]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a06c8c75-1e96-40c8-8f8f-875e384d4506 tempest-ProjectReaderTests-659013378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-556b8f5f-a040-4c5e-941a-e3495f2fc65a" returned: 0 in 0.275s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:25 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a06c8c75-1e96-40c8-8f8f-875e384d4506 tempest-ProjectReaderTests-659013378 None] Lock "cinder-quobyte-556b8f5f-a040-4c5e-941a-e3495f2fc65a" released by "delete_volume" :: held 0.726s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:42:25 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-a06c8c75-1e96-40c8-8f8f-875e384d4506 tempest-ProjectReaderTests-659013378 None] Created reservations ['46e24210-3ae5-4b13-94b7-6ac473d2ed91', 'cdd48b6b-a799-4775-840a-17a85bc589c7', 'cecf0c75-4c19-4002-8262-63dc7e1b7365', '2f7518c1-2c08-4646-8cea-132116de9873'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:42:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a06c8c75-1e96-40c8-8f8f-875e384d4506 tempest-ProjectReaderTests-659013378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:42:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a06c8c75-1e96-40c8-8f8f-875e384d4506 tempest-ProjectReaderTests-659013378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:42:26 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a06c8c75-1e96-40c8-8f8f-875e384d4506 tempest-ProjectReaderTests-659013378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:42:26 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a06c8c75-1e96-40c8-8f8f-875e384d4506 tempest-ProjectReaderTests-659013378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:42:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a06c8c75-1e96-40c8-8f8f-875e384d4506 tempest-ProjectReaderTests-659013378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:42:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a06c8c75-1e96-40c8-8f8f-875e384d4506 tempest-ProjectReaderTests-659013378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:26 devstack sudo[105830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:42:26 devstack sudo[105830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:26 devstack sudo[105830]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a06c8c75-1e96-40c8-8f8f-875e384d4506 tempest-ProjectReaderTests-659013378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.270s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:26 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-a06c8c75-1e96-40c8-8f8f-875e384d4506 tempest-ProjectReaderTests-659013378 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:42:26 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-a06c8c75-1e96-40c8-8f8f-875e384d4506 tempest-ProjectReaderTests-659013378 None] Deleted volume successfully.
Jul 14 16:42:26 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a06c8c75-1e96-40c8-8f8f-875e384d4506 tempest-ProjectReaderTests-659013378 None] Lock "cinder-556b8f5f-a040-4c5e-941a-e3495f2fc65a-delete_volume" released by "delete_volume" :: held 1.272s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:42:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9019da24-f33f-4988-ae8b-1e5110902e0d tempest-ProjectMemberTests-1242181671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:42:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9019da24-f33f-4988-ae8b-1e5110902e0d tempest-ProjectMemberTests-1242181671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:42:26 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-b95a6dbf-0b9d-49e0-b3c4-6a138c280836 tempest-ProjectReaderTests-659013378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:42:26 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b95a6dbf-0b9d-49e0-b3c4-6a138c280836 tempest-ProjectReaderTests-659013378 None] Flow 'volume_create_manager' (e6a63d05-2b98-47be-8b27-0c08ccf2a266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:42:26 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b95a6dbf-0b9d-49e0-b3c4-6a138c280836 tempest-ProjectReaderTests-659013378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ced7556-d299-4b87-980d-0cb02d8ffa4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:42:26 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b95a6dbf-0b9d-49e0-b3c4-6a138c280836 tempest-ProjectReaderTests-659013378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ced7556-d299-4b87-980d-0cb02d8ffa4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:42:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-91813954',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03d58ba8-b2dc-460a-9f84-d0dea30dff7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='404ddc33118a4b72ab5249ade74355fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:42:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:42:27Z,use_quota=True,user_id='bffec6788c294ad9893eb319872897fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:42:26 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b95a6dbf-0b9d-49e0-b3c4-6a138c280836 tempest-ProjectReaderTests-659013378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39f1355d-8740-41ea-9fd7-e563d56d070a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:42:26 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b95a6dbf-0b9d-49e0-b3c4-6a138c280836 tempest-ProjectReaderTests-659013378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39f1355d-8740-41ea-9fd7-e563d56d070a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:42:26 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b95a6dbf-0b9d-49e0-b3c4-6a138c280836 tempest-ProjectReaderTests-659013378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (960a8fd6-9d79-41b1-a63e-8cf4274d1a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:42:26 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b95a6dbf-0b9d-49e0-b3c4-6a138c280836 tempest-ProjectReaderTests-659013378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (960a8fd6-9d79-41b1-a63e-8cf4274d1a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03d58ba8-b2dc-460a-9f84-d0dea30dff7b', 'volume_name': 'volume-03d58ba8-b2dc-460a-9f84-d0dea30dff7b', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:42:26 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b95a6dbf-0b9d-49e0-b3c4-6a138c280836 tempest-ProjectReaderTests-659013378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b72334eb-25c3-47db-9c92-23a108dbef1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:42:26 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b95a6dbf-0b9d-49e0-b3c4-6a138c280836 tempest-ProjectReaderTests-659013378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b72334eb-25c3-47db-9c92-23a108dbef1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:42:26 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b95a6dbf-0b9d-49e0-b3c4-6a138c280836 tempest-ProjectReaderTests-659013378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a792337a-e52f-4097-9d5e-6a61856de815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:42:26 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-b95a6dbf-0b9d-49e0-b3c4-6a138c280836 tempest-ProjectReaderTests-659013378 None] Volume 03d58ba8-b2dc-460a-9f84-d0dea30dff7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03d58ba8-b2dc-460a-9f84-d0dea30dff7b', 'volume_size': 1}
Jul 14 16:42:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b95a6dbf-0b9d-49e0-b3c4-6a138c280836 tempest-ProjectReaderTests-659013378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:42:26 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-9019da24-f33f-4988-ae8b-1e5110902e0d tempest-ProjectMemberTests-1242181671 None] Creating offline snapshot e0a27175-3f07-43bb-97cf-60b2288e290a of volume 62948f79-ac10-4e1c-bc31-4ef3cd66de52 {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 16:42:26 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7567b6b-3f8e-4666-99ca-559fd9247468]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:42:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9019da24-f33f-4988-ae8b-1e5110902e0d tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-62948f79-ac10-4e1c-bc31-4ef3cd66de52 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:27 devstack sudo[105833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-62948f79-ac10-4e1c-bc31-4ef3cd66de52
Jul 14 16:42:27 devstack sudo[105833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:27 devstack sudo[105833]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9019da24-f33f-4988-ae8b-1e5110902e0d tempest-ProjectMemberTests-1242181671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-62948f79-ac10-4e1c-bc31-4ef3cd66de52" returned: 0 in 0.394s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9019da24-f33f-4988-ae8b-1e5110902e0d tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-62948f79-ac10-4e1c-bc31-4ef3cd66de52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-62948f79-ac10-4e1c-bc31-4ef3cd66de52.e0a27175-3f07-43bb-97cf-60b2288e290a 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:27 devstack sudo[105838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-62948f79-ac10-4e1c-bc31-4ef3cd66de52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-62948f79-ac10-4e1c-bc31-4ef3cd66de52.e0a27175-3f07-43bb-97cf-60b2288e290a 1G
Jul 14 16:42:27 devstack sudo[105838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:27 devstack sudo[105838]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9019da24-f33f-4988-ae8b-1e5110902e0d tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-62948f79-ac10-4e1c-bc31-4ef3cd66de52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-62948f79-ac10-4e1c-bc31-4ef3cd66de52.e0a27175-3f07-43bb-97cf-60b2288e290a 1G" returned: 0 in 0.458s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9019da24-f33f-4988-ae8b-1e5110902e0d tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62948f79-ac10-4e1c-bc31-4ef3cd66de52 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-62948f79-ac10-4e1c-bc31-4ef3cd66de52.e0a27175-3f07-43bb-97cf-60b2288e290a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:27 devstack sudo[105845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62948f79-ac10-4e1c-bc31-4ef3cd66de52 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-62948f79-ac10-4e1c-bc31-4ef3cd66de52.e0a27175-3f07-43bb-97cf-60b2288e290a
Jul 14 16:42:27 devstack sudo[105845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:28 devstack sudo[105845]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9019da24-f33f-4988-ae8b-1e5110902e0d tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62948f79-ac10-4e1c-bc31-4ef3cd66de52 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-62948f79-ac10-4e1c-bc31-4ef3cd66de52.e0a27175-3f07-43bb-97cf-60b2288e290a" returned: 0 in 0.320s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:28 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-9019da24-f33f-4988-ae8b-1e5110902e0d tempest-ProjectMemberTests-1242181671 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-62948f79-ac10-4e1c-bc31-4ef3cd66de52.e0a27175-3f07-43bb-97cf-60b2288e290a is being set with open permissions: ugo+rw
Jul 14 16:42:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9019da24-f33f-4988-ae8b-1e5110902e0d tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-62948f79-ac10-4e1c-bc31-4ef3cd66de52.e0a27175-3f07-43bb-97cf-60b2288e290a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:28 devstack sudo[105850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-62948f79-ac10-4e1c-bc31-4ef3cd66de52.e0a27175-3f07-43bb-97cf-60b2288e290a
Jul 14 16:42:28 devstack sudo[105850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:28 devstack sudo[105850]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9019da24-f33f-4988-ae8b-1e5110902e0d tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-62948f79-ac10-4e1c-bc31-4ef3cd66de52.e0a27175-3f07-43bb-97cf-60b2288e290a" returned: 0 in 0.259s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9019da24-f33f-4988-ae8b-1e5110902e0d tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-62948f79-ac10-4e1c-bc31-4ef3cd66de52.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:28 devstack sudo[105853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-62948f79-ac10-4e1c-bc31-4ef3cd66de52.info
Jul 14 16:42:28 devstack sudo[105853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:28 devstack sudo[105853]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9019da24-f33f-4988-ae8b-1e5110902e0d tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-62948f79-ac10-4e1c-bc31-4ef3cd66de52.info" returned: 0 in 0.264s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:28 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-9019da24-f33f-4988-ae8b-1e5110902e0d tempest-ProjectMemberTests-1242181671 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-62948f79-ac10-4e1c-bc31-4ef3cd66de52.info is being set with open permissions: ugo+rw
Jul 14 16:42:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9019da24-f33f-4988-ae8b-1e5110902e0d tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-62948f79-ac10-4e1c-bc31-4ef3cd66de52.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:28 devstack sudo[105856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-62948f79-ac10-4e1c-bc31-4ef3cd66de52.info
Jul 14 16:42:28 devstack sudo[105856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:28 devstack sudo[105856]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9019da24-f33f-4988-ae8b-1e5110902e0d tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-62948f79-ac10-4e1c-bc31-4ef3cd66de52.info" returned: 0 in 0.281s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9019da24-f33f-4988-ae8b-1e5110902e0d tempest-ProjectMemberTests-1242181671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.145s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:42:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b95a6dbf-0b9d-49e0-b3c4-6a138c280836 tempest-ProjectReaderTests-659013378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.061s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:42:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-b95a6dbf-0b9d-49e0-b3c4-6a138c280836 tempest-ProjectReaderTests-659013378 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:42:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-91813954',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03d58ba8-b2dc-460a-9f84-d0dea30dff7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='404ddc33118a4b72ab5249ade74355fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:42:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:42:27Z,use_quota=True,user_id='bffec6788c294ad9893eb319872897fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:42:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-b95a6dbf-0b9d-49e0-b3c4-6a138c280836 tempest-ProjectReaderTests-659013378 None] Creating volume 03d58ba8-b2dc-460a-9f84-d0dea30dff7b {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:42:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b95a6dbf-0b9d-49e0-b3c4-6a138c280836 tempest-ProjectReaderTests-659013378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:42:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b95a6dbf-0b9d-49e0-b3c4-6a138c280836 tempest-ProjectReaderTests-659013378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:42:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-b95a6dbf-0b9d-49e0-b3c4-6a138c280836 tempest-ProjectReaderTests-659013378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:42:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-b95a6dbf-0b9d-49e0-b3c4-6a138c280836 tempest-ProjectReaderTests-659013378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:42:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b95a6dbf-0b9d-49e0-b3c4-6a138c280836 tempest-ProjectReaderTests-659013378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:42:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-b95a6dbf-0b9d-49e0-b3c4-6a138c280836 tempest-ProjectReaderTests-659013378 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:42:29 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-b95a6dbf-0b9d-49e0-b3c4-6a138c280836 tempest-ProjectReaderTests-659013378 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:42:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b95a6dbf-0b9d-49e0-b3c4-6a138c280836 tempest-ProjectReaderTests-659013378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-03d58ba8-b2dc-460a-9f84-d0dea30dff7b 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:29 devstack sudo[105859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-03d58ba8-b2dc-460a-9f84-d0dea30dff7b 1073741824
Jul 14 16:42:29 devstack sudo[105859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:29 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-9019da24-f33f-4988-ae8b-1e5110902e0d tempest-ProjectMemberTests-1242181671 None] Create snapshot completed successfully
Jul 14 16:42:29 devstack sudo[105859]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b95a6dbf-0b9d-49e0-b3c4-6a138c280836 tempest-ProjectReaderTests-659013378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-03d58ba8-b2dc-460a-9f84-d0dea30dff7b 1073741824" returned: 0 in 0.496s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b95a6dbf-0b9d-49e0-b3c4-6a138c280836 tempest-ProjectReaderTests-659013378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-03d58ba8-b2dc-460a-9f84-d0dea30dff7b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:29 devstack sudo[105865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-03d58ba8-b2dc-460a-9f84-d0dea30dff7b
Jul 14 16:42:29 devstack sudo[105865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:29 devstack sudo[105865]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b95a6dbf-0b9d-49e0-b3c4-6a138c280836 tempest-ProjectReaderTests-659013378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-03d58ba8-b2dc-460a-9f84-d0dea30dff7b" returned: 0 in 0.267s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-b95a6dbf-0b9d-49e0-b3c4-6a138c280836 tempest-ProjectReaderTests-659013378 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:42:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b95a6dbf-0b9d-49e0-b3c4-6a138c280836 tempest-ProjectReaderTests-659013378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:42:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b95a6dbf-0b9d-49e0-b3c4-6a138c280836 tempest-ProjectReaderTests-659013378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a792337a-e52f-4097-9d5e-6a61856de815) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03d58ba8-b2dc-460a-9f84-d0dea30dff7b', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:42:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b95a6dbf-0b9d-49e0-b3c4-6a138c280836 tempest-ProjectReaderTests-659013378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85cd62df-f0a3-478d-b1e1-b7b64ec7aca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:42:29 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-b95a6dbf-0b9d-49e0-b3c4-6a138c280836 tempest-ProjectReaderTests-659013378 None] Volume volume-03d58ba8-b2dc-460a-9f84-d0dea30dff7b (03d58ba8-b2dc-460a-9f84-d0dea30dff7b): created successfully
Jul 14 16:42:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b95a6dbf-0b9d-49e0-b3c4-6a138c280836 tempest-ProjectReaderTests-659013378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85cd62df-f0a3-478d-b1e1-b7b64ec7aca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:42:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b95a6dbf-0b9d-49e0-b3c4-6a138c280836 tempest-ProjectReaderTests-659013378 None] Flow 'volume_create_manager' (e6a63d05-2b98-47be-8b27-0c08ccf2a266) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:42:29 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-b95a6dbf-0b9d-49e0-b3c4-6a138c280836 tempest-ProjectReaderTests-659013378 None] Created volume successfully.
Jul 14 16:42:29 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-5b0d4b69-d955-4bc3-896c-f1838f653eb8 tempest-ProjectMemberTests-1242181671 None] Acquiring lock "cinder-e0a27175-3f07-43bb-97cf-60b2288e290a-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:42:29 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-5b0d4b69-d955-4bc3-896c-f1838f653eb8 tempest-ProjectMemberTests-1242181671 None] Lock "cinder-e0a27175-3f07-43bb-97cf-60b2288e290a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:42:29 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-5b0d4b69-d955-4bc3-896c-f1838f653eb8 tempest-ProjectMemberTests-1242181671 None] Acquiring lock "cinder-quobyte-62948f79-ac10-4e1c-bc31-4ef3cd66de52" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:42:29 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-5b0d4b69-d955-4bc3-896c-f1838f653eb8 tempest-ProjectMemberTests-1242181671 None] Lock "cinder-quobyte-62948f79-ac10-4e1c-bc31-4ef3cd66de52" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:42:30 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-5b0d4b69-d955-4bc3-896c-f1838f653eb8 tempest-ProjectMemberTests-1242181671 None] Acquiring lock "cinder-quobyte-e0a27175-3f07-43bb-97cf-60b2288e290a" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:42:30 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-5b0d4b69-d955-4bc3-896c-f1838f653eb8 tempest-ProjectMemberTests-1242181671 None] Lock "cinder-quobyte-e0a27175-3f07-43bb-97cf-60b2288e290a" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:42:30 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-5b0d4b69-d955-4bc3-896c-f1838f653eb8 tempest-ProjectMemberTests-1242181671 None] Deleting offline snapshot e0a27175-3f07-43bb-97cf-60b2288e290a of volume 62948f79-ac10-4e1c-bc31-4ef3cd66de52 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 16:42:30 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-5b0d4b69-d955-4bc3-896c-f1838f653eb8 tempest-ProjectMemberTests-1242181671 None] snapshot_file for this snap is: volume-62948f79-ac10-4e1c-bc31-4ef3cd66de52.e0a27175-3f07-43bb-97cf-60b2288e290a {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 16:42:30 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f39c20a-3771-4b16-b19c-84184e25e974]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:42:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5b0d4b69-d955-4bc3-896c-f1838f653eb8 tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-62948f79-ac10-4e1c-bc31-4ef3cd66de52.e0a27175-3f07-43bb-97cf-60b2288e290a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:30 devstack sudo[105869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-62948f79-ac10-4e1c-bc31-4ef3cd66de52.e0a27175-3f07-43bb-97cf-60b2288e290a
Jul 14 16:42:30 devstack sudo[105869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:30 devstack sudo[105869]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5b0d4b69-d955-4bc3-896c-f1838f653eb8 tempest-ProjectMemberTests-1242181671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-62948f79-ac10-4e1c-bc31-4ef3cd66de52.e0a27175-3f07-43bb-97cf-60b2288e290a" returned: 0 in 0.435s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:30 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-5b0d4b69-d955-4bc3-896c-f1838f653eb8 tempest-ProjectMemberTests-1242181671 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62948f79-ac10-4e1c-bc31-4ef3cd66de52(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 16:42:30 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f10173c-6814-42f4-89d9-c1abb26f9660]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:42:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5b0d4b69-d955-4bc3-896c-f1838f653eb8 tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-62948f79-ac10-4e1c-bc31-4ef3cd66de52 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:30 devstack sudo[105875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-62948f79-ac10-4e1c-bc31-4ef3cd66de52
Jul 14 16:42:30 devstack sudo[105875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:30 devstack sudo[105875]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5b0d4b69-d955-4bc3-896c-f1838f653eb8 tempest-ProjectMemberTests-1242181671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-62948f79-ac10-4e1c-bc31-4ef3cd66de52" returned: 0 in 0.406s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5b0d4b69-d955-4bc3-896c-f1838f653eb8 tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-62948f79-ac10-4e1c-bc31-4ef3cd66de52.e0a27175-3f07-43bb-97cf-60b2288e290a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:30 devstack sudo[105880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-62948f79-ac10-4e1c-bc31-4ef3cd66de52.e0a27175-3f07-43bb-97cf-60b2288e290a
Jul 14 16:42:30 devstack sudo[105880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:31 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-03b01250-28d8-43ef-9908-2280dd15372b tempest-ProjectReaderTests-659013378 None] Acquiring lock "cinder-03d58ba8-b2dc-460a-9f84-d0dea30dff7b-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:42:31 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-03b01250-28d8-43ef-9908-2280dd15372b tempest-ProjectReaderTests-659013378 None] Lock "cinder-03d58ba8-b2dc-460a-9f84-d0dea30dff7b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:42:31 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-03b01250-28d8-43ef-9908-2280dd15372b tempest-ProjectReaderTests-659013378 None] Acquiring lock "cinder-quobyte-03d58ba8-b2dc-460a-9f84-d0dea30dff7b" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:42:31 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-03b01250-28d8-43ef-9908-2280dd15372b tempest-ProjectReaderTests-659013378 None] Lock "cinder-quobyte-03d58ba8-b2dc-460a-9f84-d0dea30dff7b" acquired by "delete_volume" :: waited 0.021s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:42:31 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[858ab85b-be01-4b14-bf2e-de7f41541a8e]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:42:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-03b01250-28d8-43ef-9908-2280dd15372b tempest-ProjectReaderTests-659013378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-03d58ba8-b2dc-460a-9f84-d0dea30dff7b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:31 devstack sudo[105884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-03d58ba8-b2dc-460a-9f84-d0dea30dff7b
Jul 14 16:42:31 devstack sudo[105884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:31 devstack sudo[105880]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5b0d4b69-d955-4bc3-896c-f1838f653eb8 tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-62948f79-ac10-4e1c-bc31-4ef3cd66de52.e0a27175-3f07-43bb-97cf-60b2288e290a" returned: 0 in 0.426s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5b0d4b69-d955-4bc3-896c-f1838f653eb8 tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-62948f79-ac10-4e1c-bc31-4ef3cd66de52.e0a27175-3f07-43bb-97cf-60b2288e290a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:31 devstack sudo[105887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-62948f79-ac10-4e1c-bc31-4ef3cd66de52.e0a27175-3f07-43bb-97cf-60b2288e290a
Jul 14 16:42:31 devstack sudo[105887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:31 devstack sudo[105884]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-03b01250-28d8-43ef-9908-2280dd15372b tempest-ProjectReaderTests-659013378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-03d58ba8-b2dc-460a-9f84-d0dea30dff7b" returned: 0 in 0.399s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-03b01250-28d8-43ef-9908-2280dd15372b tempest-ProjectReaderTests-659013378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-03d58ba8-b2dc-460a-9f84-d0dea30dff7b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:31 devstack sudo[105887]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:31 devstack sudo[105893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-03d58ba8-b2dc-460a-9f84-d0dea30dff7b
Jul 14 16:42:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5b0d4b69-d955-4bc3-896c-f1838f653eb8 tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-62948f79-ac10-4e1c-bc31-4ef3cd66de52.e0a27175-3f07-43bb-97cf-60b2288e290a" returned: 0 in 0.289s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:31 devstack sudo[105893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:31 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-5b0d4b69-d955-4bc3-896c-f1838f653eb8 tempest-ProjectMemberTests-1242181671 None] Lock "cinder-quobyte-e0a27175-3f07-43bb-97cf-60b2288e290a" released by "_delete_snapshot" :: held 1.682s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:42:31 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-5b0d4b69-d955-4bc3-896c-f1838f653eb8 tempest-ProjectMemberTests-1242181671 None] Lock "cinder-quobyte-62948f79-ac10-4e1c-bc31-4ef3cd66de52" released by "delete_snapshot" :: held 1.715s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:42:31 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-5b0d4b69-d955-4bc3-896c-f1838f653eb8 tempest-ProjectMemberTests-1242181671 None] Created reservations ['5966154e-663c-497a-94dc-fc9aa08dce2e', 'fe8b7e19-f78c-4e8e-a067-de628a61fade', '0685fa10-0d1a-47ae-a417-94ca63e0d463', '7be015c1-9145-4117-ae7f-f6a069481308'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:42:31 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-5b0d4b69-d955-4bc3-896c-f1838f653eb8 tempest-ProjectMemberTests-1242181671 None] Delete snapshot completed successfully.
Jul 14 16:42:31 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-5b0d4b69-d955-4bc3-896c-f1838f653eb8 tempest-ProjectMemberTests-1242181671 None] Lock "cinder-e0a27175-3f07-43bb-97cf-60b2288e290a-delete_snapshot" released by "delete_snapshot" :: held 1.886s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:42:31 devstack sudo[105893]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-03b01250-28d8-43ef-9908-2280dd15372b tempest-ProjectReaderTests-659013378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-03d58ba8-b2dc-460a-9f84-d0dea30dff7b" returned: 0 in 0.278s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:31 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-03b01250-28d8-43ef-9908-2280dd15372b tempest-ProjectReaderTests-659013378 None] Lock "cinder-quobyte-03d58ba8-b2dc-460a-9f84-d0dea30dff7b" released by "delete_volume" :: held 0.734s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:42:31 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-03b01250-28d8-43ef-9908-2280dd15372b tempest-ProjectReaderTests-659013378 None] Created reservations ['4a47e242-3d48-4cf5-a683-fea15d1c478e', '94e541ff-015c-45cd-9db9-e2b3a20cd39d', 'fea3618a-dddb-4336-9137-aee483d2f134', 'f73dc664-c6ce-4ef9-b16b-01b6032f9466'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:42:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-03b01250-28d8-43ef-9908-2280dd15372b tempest-ProjectReaderTests-659013378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:42:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-03b01250-28d8-43ef-9908-2280dd15372b tempest-ProjectReaderTests-659013378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:42:32 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-03b01250-28d8-43ef-9908-2280dd15372b tempest-ProjectReaderTests-659013378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:42:32 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-03b01250-28d8-43ef-9908-2280dd15372b tempest-ProjectReaderTests-659013378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:42:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-03b01250-28d8-43ef-9908-2280dd15372b tempest-ProjectReaderTests-659013378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:42:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-03b01250-28d8-43ef-9908-2280dd15372b tempest-ProjectReaderTests-659013378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:32 devstack sudo[105896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:42:32 devstack sudo[105896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:32 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-36cd8118-0649-4827-9a17-64f56a76e9fa tempest-ProjectMemberTests-1242181671 None] Acquiring lock "cinder-62948f79-ac10-4e1c-bc31-4ef3cd66de52-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:42:32 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-36cd8118-0649-4827-9a17-64f56a76e9fa tempest-ProjectMemberTests-1242181671 None] Lock "cinder-62948f79-ac10-4e1c-bc31-4ef3cd66de52-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:42:32 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-36cd8118-0649-4827-9a17-64f56a76e9fa tempest-ProjectMemberTests-1242181671 None] Acquiring lock "cinder-quobyte-62948f79-ac10-4e1c-bc31-4ef3cd66de52" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:42:32 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-36cd8118-0649-4827-9a17-64f56a76e9fa tempest-ProjectMemberTests-1242181671 None] Lock "cinder-quobyte-62948f79-ac10-4e1c-bc31-4ef3cd66de52" acquired by "delete_volume" :: waited 0.016s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:42:32 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab7e3edf-d15f-4aa8-bebe-030bfc2d230e]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:42:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-36cd8118-0649-4827-9a17-64f56a76e9fa tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-62948f79-ac10-4e1c-bc31-4ef3cd66de52 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:32 devstack sudo[105896]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-03b01250-28d8-43ef-9908-2280dd15372b tempest-ProjectReaderTests-659013378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.379s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:32 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-03b01250-28d8-43ef-9908-2280dd15372b tempest-ProjectReaderTests-659013378 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:42:32 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-03b01250-28d8-43ef-9908-2280dd15372b tempest-ProjectReaderTests-659013378 None] Deleted volume successfully.
Jul 14 16:42:32 devstack sudo[105898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-62948f79-ac10-4e1c-bc31-4ef3cd66de52
Jul 14 16:42:32 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-03b01250-28d8-43ef-9908-2280dd15372b tempest-ProjectReaderTests-659013378 None] Lock "cinder-03d58ba8-b2dc-460a-9f84-d0dea30dff7b-delete_volume" released by "delete_volume" :: held 1.373s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:42:32 devstack sudo[105898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:32 devstack sudo[105898]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-36cd8118-0649-4827-9a17-64f56a76e9fa tempest-ProjectMemberTests-1242181671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-62948f79-ac10-4e1c-bc31-4ef3cd66de52" returned: 0 in 0.441s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-36cd8118-0649-4827-9a17-64f56a76e9fa tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-62948f79-ac10-4e1c-bc31-4ef3cd66de52 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:32 devstack sudo[105904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-62948f79-ac10-4e1c-bc31-4ef3cd66de52
Jul 14 16:42:32 devstack sudo[105904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:33 devstack sudo[105904]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-36cd8118-0649-4827-9a17-64f56a76e9fa tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-62948f79-ac10-4e1c-bc31-4ef3cd66de52" returned: 0 in 0.287s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:33 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-36cd8118-0649-4827-9a17-64f56a76e9fa tempest-ProjectMemberTests-1242181671 None] Lock "cinder-quobyte-62948f79-ac10-4e1c-bc31-4ef3cd66de52" released by "delete_volume" :: held 0.808s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:42:33 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-36cd8118-0649-4827-9a17-64f56a76e9fa tempest-ProjectMemberTests-1242181671 None] Created reservations ['c5d2c750-5972-477d-8703-4c9c8cb3a013', '9dbd9e29-2c11-493a-bf0c-20934403c6ea', '982b76da-85cc-44a6-825c-b74a14ac9000', 'b660160f-b307-4117-92e4-cf102c89785f'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:42:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-36cd8118-0649-4827-9a17-64f56a76e9fa tempest-ProjectMemberTests-1242181671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:42:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-36cd8118-0649-4827-9a17-64f56a76e9fa tempest-ProjectMemberTests-1242181671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:42:33 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-36cd8118-0649-4827-9a17-64f56a76e9fa tempest-ProjectMemberTests-1242181671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:42:33 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-36cd8118-0649-4827-9a17-64f56a76e9fa tempest-ProjectMemberTests-1242181671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:42:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-36cd8118-0649-4827-9a17-64f56a76e9fa tempest-ProjectMemberTests-1242181671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:42:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-36cd8118-0649-4827-9a17-64f56a76e9fa tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:33 devstack sudo[105907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:42:33 devstack sudo[105907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:33 devstack sudo[105907]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-36cd8118-0649-4827-9a17-64f56a76e9fa tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.343s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:33 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-36cd8118-0649-4827-9a17-64f56a76e9fa tempest-ProjectMemberTests-1242181671 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:42:33 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-36cd8118-0649-4827-9a17-64f56a76e9fa tempest-ProjectMemberTests-1242181671 None] Deleted volume successfully.
Jul 14 16:42:33 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-36cd8118-0649-4827-9a17-64f56a76e9fa tempest-ProjectMemberTests-1242181671 None] Lock "cinder-62948f79-ac10-4e1c-bc31-4ef3cd66de52-delete_volume" released by "delete_volume" :: held 1.453s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:42:34 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6fd0670-4741-487f-9d09-83f348f813fe tempest-ProjectMemberTests-1242181671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:42:34 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f6fd0670-4741-487f-9d09-83f348f813fe tempest-ProjectMemberTests-1242181671 None] Flow 'volume_create_manager' (3c9465ff-1ea1-4ede-895a-3e1c791dc499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:42:34 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f6fd0670-4741-487f-9d09-83f348f813fe tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf70193c-cfa9-408a-ba7f-c069d1e8ad32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:42:34 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f6fd0670-4741-487f-9d09-83f348f813fe tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf70193c-cfa9-408a-ba7f-c069d1e8ad32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:42:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1860774890',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43b2eb8a-1671-49c6-9481-8e00edbdb410,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dfc230bd6d54b87b4b187751f9a7039',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:42:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:42:34Z,use_quota=True,user_id='68f1fe3510e3473e91988f26916b8e51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:42:34 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f6fd0670-4741-487f-9d09-83f348f813fe tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59d90698-1b15-4d2b-8fc9-ac93de94f91a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:42:34 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f6fd0670-4741-487f-9d09-83f348f813fe tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59d90698-1b15-4d2b-8fc9-ac93de94f91a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:42:34 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f6fd0670-4741-487f-9d09-83f348f813fe tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4200908-59f2-4dbf-bf34-d408d1f1e1c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:42:34 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f6fd0670-4741-487f-9d09-83f348f813fe tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4200908-59f2-4dbf-bf34-d408d1f1e1c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43b2eb8a-1671-49c6-9481-8e00edbdb410', 'volume_name': 'volume-43b2eb8a-1671-49c6-9481-8e00edbdb410', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:42:34 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f6fd0670-4741-487f-9d09-83f348f813fe tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f069fb32-31f3-450a-9fdd-9394aa0e2923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:42:34 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f6fd0670-4741-487f-9d09-83f348f813fe tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f069fb32-31f3-450a-9fdd-9394aa0e2923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:42:34 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f6fd0670-4741-487f-9d09-83f348f813fe tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c1b6883-2a59-4972-862b-04bf9a591bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:42:34 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-f6fd0670-4741-487f-9d09-83f348f813fe tempest-ProjectMemberTests-1242181671 None] Volume 43b2eb8a-1671-49c6-9481-8e00edbdb410: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43b2eb8a-1671-49c6-9481-8e00edbdb410', 'volume_size': 1}
Jul 14 16:42:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f6fd0670-4741-487f-9d09-83f348f813fe tempest-ProjectMemberTests-1242181671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:42:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f6fd0670-4741-487f-9d09-83f348f813fe tempest-ProjectMemberTests-1242181671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:42:34 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f6fd0670-4741-487f-9d09-83f348f813fe tempest-ProjectMemberTests-1242181671 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:42:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1860774890',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43b2eb8a-1671-49c6-9481-8e00edbdb410,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dfc230bd6d54b87b4b187751f9a7039',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:42:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:42:34Z,use_quota=True,user_id='68f1fe3510e3473e91988f26916b8e51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:42:34 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-f6fd0670-4741-487f-9d09-83f348f813fe tempest-ProjectMemberTests-1242181671 None] Creating volume 43b2eb8a-1671-49c6-9481-8e00edbdb410 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:42:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f6fd0670-4741-487f-9d09-83f348f813fe tempest-ProjectMemberTests-1242181671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:42:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f6fd0670-4741-487f-9d09-83f348f813fe tempest-ProjectMemberTests-1242181671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:42:34 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f6fd0670-4741-487f-9d09-83f348f813fe tempest-ProjectMemberTests-1242181671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:42:34 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f6fd0670-4741-487f-9d09-83f348f813fe tempest-ProjectMemberTests-1242181671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:42:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f6fd0670-4741-487f-9d09-83f348f813fe tempest-ProjectMemberTests-1242181671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:42:34 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f6fd0670-4741-487f-9d09-83f348f813fe tempest-ProjectMemberTests-1242181671 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:42:34 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-f6fd0670-4741-487f-9d09-83f348f813fe tempest-ProjectMemberTests-1242181671 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:42:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f6fd0670-4741-487f-9d09-83f348f813fe tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-43b2eb8a-1671-49c6-9481-8e00edbdb410 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:34 devstack sudo[105911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-43b2eb8a-1671-49c6-9481-8e00edbdb410 1073741824
Jul 14 16:42:34 devstack sudo[105911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:34 devstack sudo[105911]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f6fd0670-4741-487f-9d09-83f348f813fe tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-43b2eb8a-1671-49c6-9481-8e00edbdb410 1073741824" returned: 0 in 0.487s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f6fd0670-4741-487f-9d09-83f348f813fe tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-43b2eb8a-1671-49c6-9481-8e00edbdb410 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:34 devstack sudo[105917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-43b2eb8a-1671-49c6-9481-8e00edbdb410
Jul 14 16:42:34 devstack sudo[105917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:34 devstack sudo[105917]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f6fd0670-4741-487f-9d09-83f348f813fe tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-43b2eb8a-1671-49c6-9481-8e00edbdb410" returned: 0 in 0.284s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:34 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f6fd0670-4741-487f-9d09-83f348f813fe tempest-ProjectMemberTests-1242181671 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:42:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f6fd0670-4741-487f-9d09-83f348f813fe tempest-ProjectMemberTests-1242181671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:42:34 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f6fd0670-4741-487f-9d09-83f348f813fe tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c1b6883-2a59-4972-862b-04bf9a591bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43b2eb8a-1671-49c6-9481-8e00edbdb410', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:42:34 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f6fd0670-4741-487f-9d09-83f348f813fe tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45423a1a-c810-4633-9fc8-4823202acc1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:42:34 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-f6fd0670-4741-487f-9d09-83f348f813fe tempest-ProjectMemberTests-1242181671 None] Volume volume-43b2eb8a-1671-49c6-9481-8e00edbdb410 (43b2eb8a-1671-49c6-9481-8e00edbdb410): created successfully
Jul 14 16:42:34 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f6fd0670-4741-487f-9d09-83f348f813fe tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45423a1a-c810-4633-9fc8-4823202acc1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:42:34 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f6fd0670-4741-487f-9d09-83f348f813fe tempest-ProjectMemberTests-1242181671 None] Flow 'volume_create_manager' (3c9465ff-1ea1-4ede-895a-3e1c791dc499) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:42:35 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-f6fd0670-4741-487f-9d09-83f348f813fe tempest-ProjectMemberTests-1242181671 None] Created volume successfully.
Jul 14 16:42:35 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 16:42:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:42:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:42:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:42:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:42:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:42:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:35 devstack sudo[105920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:42:35 devstack sudo[105920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:35 devstack sudo[105920]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.266s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:35 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:42:35 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Running periodic task VolumeManager._thread_info {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 16:42:35 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] thread count: 29 {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 14 16:42:35 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] thread info: [<_MainThread(MainThread, started 128606490927232)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128606415432960)>, <Thread(Thread-3 (stat_writer), started daemon 128606378859328)>, <Thread(Rabbit-heartbeat, started daemon 128606379646144)>, <Thread(Thread-5 (_runner), started daemon 128606377685824)>, <Thread(Thread-7 (_runner), started daemon 128606377701888)>, <Thread(fd_logger, started daemon 128606377091392)>, <Thread(privsep_reader, started daemon 128606375782080)>, <Thread(tpool_thread_0, started daemon 128606365607616)>, <Thread(tpool_thread_1, started daemon 128606357214912)>, <Thread(tpool_thread_2, started daemon 128606348822208)>, <Thread(tpool_thread_3, started daemon 128606340413120)>, <Thread(tpool_thread_4, started daemon 128606332004032)>, <Thread(tpool_thread_5, started daemon 128606323594944)>, <Thread(tpool_thread_6, started daemon 128606315185856)>, <Thread(tpool_thread_7, started daemon 128606306776768)>, <Thread(tpool_thread_8, started daemon 128606298367680)>, <Thread(tpool_thread_9, started daemon 128606289958592)>, <Thread(tpool_thread_10, started daemon 128606281549504)>, <Thread(tpool_thread_11, started daemon 128606273140416)>, <Thread(tpool_thread_12, started daemon 128606264731328)>, <Thread(tpool_thread_13, started daemon 128606256322240)>, <Thread(tpool_thread_14, started daemon 128606247913152)>, <Thread(tpool_thread_15, started daemon 128606239504064)>, <Thread(tpool_thread_16, started daemon 128606231094976)>, <Thread(tpool_thread_17, started daemon 128606222685888)>, <Thread(tpool_thread_18, started daemon 128606214276800)>, <Thread(tpool_thread_19, started daemon 128606205867712)>, <Thread(Rabbit-heartbeat, started daemon 128606368169344)>] {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 14 16:42:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-26a28953-a27e-450a-8edb-4069e99fb420 tempest-ProjectMemberTests-1242181671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:42:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-26a28953-a27e-450a-8edb-4069e99fb420 tempest-ProjectMemberTests-1242181671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:42:36 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-26a28953-a27e-450a-8edb-4069e99fb420 tempest-ProjectMemberTests-1242181671 None] Creating offline snapshot f7cb3eb6-a2c4-488c-94ef-642c5fee9d60 of volume 43b2eb8a-1671-49c6-9481-8e00edbdb410 {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 16:42:36 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[75fe9a80-912c-400f-ac07-6d987056df85]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:42:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-26a28953-a27e-450a-8edb-4069e99fb420 tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-43b2eb8a-1671-49c6-9481-8e00edbdb410 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:36 devstack sudo[105923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-43b2eb8a-1671-49c6-9481-8e00edbdb410
Jul 14 16:42:36 devstack sudo[105923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:36 devstack sudo[105923]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-26a28953-a27e-450a-8edb-4069e99fb420 tempest-ProjectMemberTests-1242181671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-43b2eb8a-1671-49c6-9481-8e00edbdb410" returned: 0 in 0.386s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-26a28953-a27e-450a-8edb-4069e99fb420 tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-43b2eb8a-1671-49c6-9481-8e00edbdb410,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-43b2eb8a-1671-49c6-9481-8e00edbdb410.f7cb3eb6-a2c4-488c-94ef-642c5fee9d60 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:36 devstack sudo[105930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-43b2eb8a-1671-49c6-9481-8e00edbdb410,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-43b2eb8a-1671-49c6-9481-8e00edbdb410.f7cb3eb6-a2c4-488c-94ef-642c5fee9d60 1G
Jul 14 16:42:36 devstack sudo[105930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:37 devstack sudo[105930]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-26a28953-a27e-450a-8edb-4069e99fb420 tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-43b2eb8a-1671-49c6-9481-8e00edbdb410,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-43b2eb8a-1671-49c6-9481-8e00edbdb410.f7cb3eb6-a2c4-488c-94ef-642c5fee9d60 1G" returned: 0 in 0.445s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-26a28953-a27e-450a-8edb-4069e99fb420 tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43b2eb8a-1671-49c6-9481-8e00edbdb410 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-43b2eb8a-1671-49c6-9481-8e00edbdb410.f7cb3eb6-a2c4-488c-94ef-642c5fee9d60 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:37 devstack sudo[105936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43b2eb8a-1671-49c6-9481-8e00edbdb410 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-43b2eb8a-1671-49c6-9481-8e00edbdb410.f7cb3eb6-a2c4-488c-94ef-642c5fee9d60
Jul 14 16:42:37 devstack sudo[105936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:37 devstack sudo[105936]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-26a28953-a27e-450a-8edb-4069e99fb420 tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43b2eb8a-1671-49c6-9481-8e00edbdb410 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-43b2eb8a-1671-49c6-9481-8e00edbdb410.f7cb3eb6-a2c4-488c-94ef-642c5fee9d60" returned: 0 in 0.344s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:37 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-26a28953-a27e-450a-8edb-4069e99fb420 tempest-ProjectMemberTests-1242181671 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-43b2eb8a-1671-49c6-9481-8e00edbdb410.f7cb3eb6-a2c4-488c-94ef-642c5fee9d60 is being set with open permissions: ugo+rw
Jul 14 16:42:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-26a28953-a27e-450a-8edb-4069e99fb420 tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-43b2eb8a-1671-49c6-9481-8e00edbdb410.f7cb3eb6-a2c4-488c-94ef-642c5fee9d60 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:37 devstack sudo[105941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-43b2eb8a-1671-49c6-9481-8e00edbdb410.f7cb3eb6-a2c4-488c-94ef-642c5fee9d60
Jul 14 16:42:37 devstack sudo[105941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:37 devstack sudo[105941]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-26a28953-a27e-450a-8edb-4069e99fb420 tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-43b2eb8a-1671-49c6-9481-8e00edbdb410.f7cb3eb6-a2c4-488c-94ef-642c5fee9d60" returned: 0 in 0.292s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-26a28953-a27e-450a-8edb-4069e99fb420 tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-43b2eb8a-1671-49c6-9481-8e00edbdb410.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:37 devstack sudo[105944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-43b2eb8a-1671-49c6-9481-8e00edbdb410.info
Jul 14 16:42:37 devstack sudo[105944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:38 devstack sudo[105944]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-26a28953-a27e-450a-8edb-4069e99fb420 tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-43b2eb8a-1671-49c6-9481-8e00edbdb410.info" returned: 0 in 0.296s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:38 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-26a28953-a27e-450a-8edb-4069e99fb420 tempest-ProjectMemberTests-1242181671 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-43b2eb8a-1671-49c6-9481-8e00edbdb410.info is being set with open permissions: ugo+rw
Jul 14 16:42:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-26a28953-a27e-450a-8edb-4069e99fb420 tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-43b2eb8a-1671-49c6-9481-8e00edbdb410.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:38 devstack sudo[105947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-43b2eb8a-1671-49c6-9481-8e00edbdb410.info
Jul 14 16:42:38 devstack sudo[105947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:38 devstack sudo[105947]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-26a28953-a27e-450a-8edb-4069e99fb420 tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-43b2eb8a-1671-49c6-9481-8e00edbdb410.info" returned: 0 in 0.262s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-26a28953-a27e-450a-8edb-4069e99fb420 tempest-ProjectMemberTests-1242181671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.122s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:42:38 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-26a28953-a27e-450a-8edb-4069e99fb420 tempest-ProjectMemberTests-1242181671 None] Create snapshot completed successfully
Jul 14 16:42:39 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-10a05922-516e-426a-be03-ab2d46b188c4 tempest-ProjectMemberTests-1242181671 None] Acquiring lock "cinder-f7cb3eb6-a2c4-488c-94ef-642c5fee9d60-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:42:39 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-10a05922-516e-426a-be03-ab2d46b188c4 tempest-ProjectMemberTests-1242181671 None] Lock "cinder-f7cb3eb6-a2c4-488c-94ef-642c5fee9d60-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:42:39 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-10a05922-516e-426a-be03-ab2d46b188c4 tempest-ProjectMemberTests-1242181671 None] Acquiring lock "cinder-quobyte-43b2eb8a-1671-49c6-9481-8e00edbdb410" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:42:39 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-10a05922-516e-426a-be03-ab2d46b188c4 tempest-ProjectMemberTests-1242181671 None] Lock "cinder-quobyte-43b2eb8a-1671-49c6-9481-8e00edbdb410" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:42:39 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-10a05922-516e-426a-be03-ab2d46b188c4 tempest-ProjectMemberTests-1242181671 None] Acquiring lock "cinder-quobyte-f7cb3eb6-a2c4-488c-94ef-642c5fee9d60" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:42:39 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-10a05922-516e-426a-be03-ab2d46b188c4 tempest-ProjectMemberTests-1242181671 None] Lock "cinder-quobyte-f7cb3eb6-a2c4-488c-94ef-642c5fee9d60" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:42:39 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-10a05922-516e-426a-be03-ab2d46b188c4 tempest-ProjectMemberTests-1242181671 None] Deleting offline snapshot f7cb3eb6-a2c4-488c-94ef-642c5fee9d60 of volume 43b2eb8a-1671-49c6-9481-8e00edbdb410 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 16:42:39 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-10a05922-516e-426a-be03-ab2d46b188c4 tempest-ProjectMemberTests-1242181671 None] snapshot_file for this snap is: volume-43b2eb8a-1671-49c6-9481-8e00edbdb410.f7cb3eb6-a2c4-488c-94ef-642c5fee9d60 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 16:42:39 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe177d1a-52f2-40e5-88df-73be98908179]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:42:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-10a05922-516e-426a-be03-ab2d46b188c4 tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-43b2eb8a-1671-49c6-9481-8e00edbdb410.f7cb3eb6-a2c4-488c-94ef-642c5fee9d60 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:39 devstack sudo[105951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-43b2eb8a-1671-49c6-9481-8e00edbdb410.f7cb3eb6-a2c4-488c-94ef-642c5fee9d60
Jul 14 16:42:39 devstack sudo[105951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:39 devstack sudo[105951]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-10a05922-516e-426a-be03-ab2d46b188c4 tempest-ProjectMemberTests-1242181671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-43b2eb8a-1671-49c6-9481-8e00edbdb410.f7cb3eb6-a2c4-488c-94ef-642c5fee9d60" returned: 0 in 0.385s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:39 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-10a05922-516e-426a-be03-ab2d46b188c4 tempest-ProjectMemberTests-1242181671 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43b2eb8a-1671-49c6-9481-8e00edbdb410(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 16:42:40 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[903b69f6-61cd-4431-ae1b-b2ad6d093aa0]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:42:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-10a05922-516e-426a-be03-ab2d46b188c4 tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-43b2eb8a-1671-49c6-9481-8e00edbdb410 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:40 devstack sudo[105956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-43b2eb8a-1671-49c6-9481-8e00edbdb410
Jul 14 16:42:40 devstack sudo[105956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:40 devstack sudo[105956]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-10a05922-516e-426a-be03-ab2d46b188c4 tempest-ProjectMemberTests-1242181671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-43b2eb8a-1671-49c6-9481-8e00edbdb410" returned: 0 in 0.372s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-10a05922-516e-426a-be03-ab2d46b188c4 tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-43b2eb8a-1671-49c6-9481-8e00edbdb410.f7cb3eb6-a2c4-488c-94ef-642c5fee9d60 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:40 devstack sudo[105962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-43b2eb8a-1671-49c6-9481-8e00edbdb410.f7cb3eb6-a2c4-488c-94ef-642c5fee9d60
Jul 14 16:42:40 devstack sudo[105962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:40 devstack sudo[105962]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-10a05922-516e-426a-be03-ab2d46b188c4 tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-43b2eb8a-1671-49c6-9481-8e00edbdb410.f7cb3eb6-a2c4-488c-94ef-642c5fee9d60" returned: 0 in 0.435s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-10a05922-516e-426a-be03-ab2d46b188c4 tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-43b2eb8a-1671-49c6-9481-8e00edbdb410.f7cb3eb6-a2c4-488c-94ef-642c5fee9d60 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:40 devstack sudo[105969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-43b2eb8a-1671-49c6-9481-8e00edbdb410.f7cb3eb6-a2c4-488c-94ef-642c5fee9d60
Jul 14 16:42:40 devstack sudo[105969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:41 devstack sudo[105969]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-10a05922-516e-426a-be03-ab2d46b188c4 tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-43b2eb8a-1671-49c6-9481-8e00edbdb410.f7cb3eb6-a2c4-488c-94ef-642c5fee9d60" returned: 0 in 0.302s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:41 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-10a05922-516e-426a-be03-ab2d46b188c4 tempest-ProjectMemberTests-1242181671 None] Lock "cinder-quobyte-f7cb3eb6-a2c4-488c-94ef-642c5fee9d60" released by "_delete_snapshot" :: held 1.615s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:42:41 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-10a05922-516e-426a-be03-ab2d46b188c4 tempest-ProjectMemberTests-1242181671 None] Lock "cinder-quobyte-43b2eb8a-1671-49c6-9481-8e00edbdb410" released by "delete_snapshot" :: held 1.642s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:42:41 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-10a05922-516e-426a-be03-ab2d46b188c4 tempest-ProjectMemberTests-1242181671 None] Created reservations ['e4cdef60-3934-4042-906a-2f427b1e0f80', 'f3b677fd-7285-44d0-8c4c-77c113ead9fa', '67e3e93d-1450-452a-9a86-e433c554fbbf', '8b89add2-d4fb-4585-b2b4-8238e0271d7a'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:42:41 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-10a05922-516e-426a-be03-ab2d46b188c4 tempest-ProjectMemberTests-1242181671 None] Delete snapshot completed successfully.
Jul 14 16:42:41 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-10a05922-516e-426a-be03-ab2d46b188c4 tempest-ProjectMemberTests-1242181671 None] Lock "cinder-f7cb3eb6-a2c4-488c-94ef-642c5fee9d60-delete_snapshot" released by "delete_snapshot" :: held 1.792s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:42:41 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-98a4e0c1-10f0-4a57-bbb9-431f2b141a8a tempest-ProjectMemberTests-1242181671 None] Acquiring lock "cinder-43b2eb8a-1671-49c6-9481-8e00edbdb410-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:42:41 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-98a4e0c1-10f0-4a57-bbb9-431f2b141a8a tempest-ProjectMemberTests-1242181671 None] Lock "cinder-43b2eb8a-1671-49c6-9481-8e00edbdb410-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:42:41 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-98a4e0c1-10f0-4a57-bbb9-431f2b141a8a tempest-ProjectMemberTests-1242181671 None] Acquiring lock "cinder-quobyte-43b2eb8a-1671-49c6-9481-8e00edbdb410" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:42:41 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-98a4e0c1-10f0-4a57-bbb9-431f2b141a8a tempest-ProjectMemberTests-1242181671 None] Lock "cinder-quobyte-43b2eb8a-1671-49c6-9481-8e00edbdb410" acquired by "delete_volume" :: waited 0.015s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:42:41 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f3419d-781c-4119-9785-fd3f241fba97]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:42:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-98a4e0c1-10f0-4a57-bbb9-431f2b141a8a tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-43b2eb8a-1671-49c6-9481-8e00edbdb410 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:41 devstack sudo[105972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-43b2eb8a-1671-49c6-9481-8e00edbdb410
Jul 14 16:42:41 devstack sudo[105972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:42 devstack sudo[105972]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-98a4e0c1-10f0-4a57-bbb9-431f2b141a8a tempest-ProjectMemberTests-1242181671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-43b2eb8a-1671-49c6-9481-8e00edbdb410" returned: 0 in 0.490s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-98a4e0c1-10f0-4a57-bbb9-431f2b141a8a tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-43b2eb8a-1671-49c6-9481-8e00edbdb410 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:42 devstack sudo[105978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-43b2eb8a-1671-49c6-9481-8e00edbdb410
Jul 14 16:42:42 devstack sudo[105978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:42 devstack sudo[105978]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-98a4e0c1-10f0-4a57-bbb9-431f2b141a8a tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-43b2eb8a-1671-49c6-9481-8e00edbdb410" returned: 0 in 0.263s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:42 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-98a4e0c1-10f0-4a57-bbb9-431f2b141a8a tempest-ProjectMemberTests-1242181671 None] Lock "cinder-quobyte-43b2eb8a-1671-49c6-9481-8e00edbdb410" released by "delete_volume" :: held 0.842s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:42:42 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-98a4e0c1-10f0-4a57-bbb9-431f2b141a8a tempest-ProjectMemberTests-1242181671 None] Created reservations ['c41af0f5-5f0b-42ea-80a7-8e6319b793d1', 'a3f5ccbf-8876-4d74-8718-2f480ad50765', 'f8db01a3-56ed-4c17-ac7b-611f985a4fd0', '5acccf14-75f9-4f0b-aa4e-29516f57bf75'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:42:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-98a4e0c1-10f0-4a57-bbb9-431f2b141a8a tempest-ProjectMemberTests-1242181671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:42:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-98a4e0c1-10f0-4a57-bbb9-431f2b141a8a tempest-ProjectMemberTests-1242181671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:42:42 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-98a4e0c1-10f0-4a57-bbb9-431f2b141a8a tempest-ProjectMemberTests-1242181671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:42:42 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-98a4e0c1-10f0-4a57-bbb9-431f2b141a8a tempest-ProjectMemberTests-1242181671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:42:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-98a4e0c1-10f0-4a57-bbb9-431f2b141a8a tempest-ProjectMemberTests-1242181671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:42:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-98a4e0c1-10f0-4a57-bbb9-431f2b141a8a tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:42 devstack sudo[105981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:42:42 devstack sudo[105981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:42 devstack sudo[105981]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-98a4e0c1-10f0-4a57-bbb9-431f2b141a8a tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.250s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:42 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-98a4e0c1-10f0-4a57-bbb9-431f2b141a8a tempest-ProjectMemberTests-1242181671 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:42:42 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-98a4e0c1-10f0-4a57-bbb9-431f2b141a8a tempest-ProjectMemberTests-1242181671 None] Deleted volume successfully.
Jul 14 16:42:43 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-98a4e0c1-10f0-4a57-bbb9-431f2b141a8a tempest-ProjectMemberTests-1242181671 None] Lock "cinder-43b2eb8a-1671-49c6-9481-8e00edbdb410-delete_volume" released by "delete_volume" :: held 1.337s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:42:43 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-74815d4c-4503-4302-8796-b08366ee2909 tempest-ProjectMemberTests-1242181671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:42:43 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-74815d4c-4503-4302-8796-b08366ee2909 tempest-ProjectMemberTests-1242181671 None] Flow 'volume_create_manager' (92864908-8356-4938-8548-7707030da0a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:42:43 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-74815d4c-4503-4302-8796-b08366ee2909 tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62d41da1-0e24-4c0f-b997-71d3e100f0a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:42:43 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-74815d4c-4503-4302-8796-b08366ee2909 tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62d41da1-0e24-4c0f-b997-71d3e100f0a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:42:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1371381376',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcd73bbc-1032-4f50-a162-0b510a769cd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dfc230bd6d54b87b4b187751f9a7039',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:42:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:42:43Z,use_quota=True,user_id='68f1fe3510e3473e91988f26916b8e51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:42:43 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-74815d4c-4503-4302-8796-b08366ee2909 tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03b34dc8-36bd-42d7-aeeb-7e01ad5c00ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:42:43 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-74815d4c-4503-4302-8796-b08366ee2909 tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03b34dc8-36bd-42d7-aeeb-7e01ad5c00ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:42:43 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-74815d4c-4503-4302-8796-b08366ee2909 tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f77d3688-5ae7-430c-a053-171e5cba9fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:42:43 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-74815d4c-4503-4302-8796-b08366ee2909 tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f77d3688-5ae7-430c-a053-171e5cba9fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcd73bbc-1032-4f50-a162-0b510a769cd8', 'volume_name': 'volume-fcd73bbc-1032-4f50-a162-0b510a769cd8', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:42:43 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-74815d4c-4503-4302-8796-b08366ee2909 tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7788711-c4f6-490a-964c-6c8919c95084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:42:43 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-74815d4c-4503-4302-8796-b08366ee2909 tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7788711-c4f6-490a-964c-6c8919c95084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:42:43 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-74815d4c-4503-4302-8796-b08366ee2909 tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9f5f5f7-d2fe-4631-9c20-4efe2e17eb4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:42:43 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-74815d4c-4503-4302-8796-b08366ee2909 tempest-ProjectMemberTests-1242181671 None] Volume fcd73bbc-1032-4f50-a162-0b510a769cd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcd73bbc-1032-4f50-a162-0b510a769cd8', 'volume_size': 1}
Jul 14 16:42:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-74815d4c-4503-4302-8796-b08366ee2909 tempest-ProjectMemberTests-1242181671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:42:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-74815d4c-4503-4302-8796-b08366ee2909 tempest-ProjectMemberTests-1242181671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:42:43 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-74815d4c-4503-4302-8796-b08366ee2909 tempest-ProjectMemberTests-1242181671 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:42:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1371381376',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcd73bbc-1032-4f50-a162-0b510a769cd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dfc230bd6d54b87b4b187751f9a7039',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:42:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:42:43Z,use_quota=True,user_id='68f1fe3510e3473e91988f26916b8e51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:42:43 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-74815d4c-4503-4302-8796-b08366ee2909 tempest-ProjectMemberTests-1242181671 None] Creating volume fcd73bbc-1032-4f50-a162-0b510a769cd8 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:42:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-74815d4c-4503-4302-8796-b08366ee2909 tempest-ProjectMemberTests-1242181671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:42:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-74815d4c-4503-4302-8796-b08366ee2909 tempest-ProjectMemberTests-1242181671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:42:43 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-74815d4c-4503-4302-8796-b08366ee2909 tempest-ProjectMemberTests-1242181671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:42:43 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-74815d4c-4503-4302-8796-b08366ee2909 tempest-ProjectMemberTests-1242181671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:42:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-74815d4c-4503-4302-8796-b08366ee2909 tempest-ProjectMemberTests-1242181671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:42:43 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-74815d4c-4503-4302-8796-b08366ee2909 tempest-ProjectMemberTests-1242181671 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:42:43 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-74815d4c-4503-4302-8796-b08366ee2909 tempest-ProjectMemberTests-1242181671 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:42:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-74815d4c-4503-4302-8796-b08366ee2909 tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fcd73bbc-1032-4f50-a162-0b510a769cd8 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:43 devstack sudo[105984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fcd73bbc-1032-4f50-a162-0b510a769cd8 1073741824
Jul 14 16:42:43 devstack sudo[105984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:43 devstack sudo[105984]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-74815d4c-4503-4302-8796-b08366ee2909 tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fcd73bbc-1032-4f50-a162-0b510a769cd8 1073741824" returned: 0 in 0.492s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-74815d4c-4503-4302-8796-b08366ee2909 tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fcd73bbc-1032-4f50-a162-0b510a769cd8 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:44 devstack sudo[105990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fcd73bbc-1032-4f50-a162-0b510a769cd8
Jul 14 16:42:44 devstack sudo[105990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:44 devstack sudo[105990]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-74815d4c-4503-4302-8796-b08366ee2909 tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fcd73bbc-1032-4f50-a162-0b510a769cd8" returned: 0 in 0.289s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:44 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-74815d4c-4503-4302-8796-b08366ee2909 tempest-ProjectMemberTests-1242181671 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:42:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-74815d4c-4503-4302-8796-b08366ee2909 tempest-ProjectMemberTests-1242181671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:42:44 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-74815d4c-4503-4302-8796-b08366ee2909 tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9f5f5f7-d2fe-4631-9c20-4efe2e17eb4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcd73bbc-1032-4f50-a162-0b510a769cd8', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:42:44 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-74815d4c-4503-4302-8796-b08366ee2909 tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa1cd275-f5cf-4975-b9bf-029e4a74e3d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:42:44 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-74815d4c-4503-4302-8796-b08366ee2909 tempest-ProjectMemberTests-1242181671 None] Volume volume-fcd73bbc-1032-4f50-a162-0b510a769cd8 (fcd73bbc-1032-4f50-a162-0b510a769cd8): created successfully
Jul 14 16:42:44 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-74815d4c-4503-4302-8796-b08366ee2909 tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa1cd275-f5cf-4975-b9bf-029e4a74e3d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:42:44 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-74815d4c-4503-4302-8796-b08366ee2909 tempest-ProjectMemberTests-1242181671 None] Flow 'volume_create_manager' (92864908-8356-4938-8548-7707030da0a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:42:44 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-74815d4c-4503-4302-8796-b08366ee2909 tempest-ProjectMemberTests-1242181671 None] Created volume successfully.
Jul 14 16:42:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c0d9415f-543c-413b-bcde-40193173c152 tempest-ProjectMemberTests-1242181671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:42:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c0d9415f-543c-413b-bcde-40193173c152 tempest-ProjectMemberTests-1242181671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:42:45 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-c0d9415f-543c-413b-bcde-40193173c152 tempest-ProjectMemberTests-1242181671 None] Creating offline snapshot 63b97cdc-919f-49eb-a213-c085258b1bac of volume fcd73bbc-1032-4f50-a162-0b510a769cd8 {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 16:42:45 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f76cfc7-6979-4255-bb8d-4e240fd2f48b]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:42:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c0d9415f-543c-413b-bcde-40193173c152 tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fcd73bbc-1032-4f50-a162-0b510a769cd8 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:45 devstack sudo[105993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fcd73bbc-1032-4f50-a162-0b510a769cd8
Jul 14 16:42:45 devstack sudo[105993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:46 devstack sudo[105993]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c0d9415f-543c-413b-bcde-40193173c152 tempest-ProjectMemberTests-1242181671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fcd73bbc-1032-4f50-a162-0b510a769cd8" returned: 0 in 0.391s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c0d9415f-543c-413b-bcde-40193173c152 tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fcd73bbc-1032-4f50-a162-0b510a769cd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fcd73bbc-1032-4f50-a162-0b510a769cd8.63b97cdc-919f-49eb-a213-c085258b1bac 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:46 devstack sudo[105998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fcd73bbc-1032-4f50-a162-0b510a769cd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fcd73bbc-1032-4f50-a162-0b510a769cd8.63b97cdc-919f-49eb-a213-c085258b1bac 1G
Jul 14 16:42:46 devstack sudo[105998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:46 devstack sudo[105998]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c0d9415f-543c-413b-bcde-40193173c152 tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fcd73bbc-1032-4f50-a162-0b510a769cd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fcd73bbc-1032-4f50-a162-0b510a769cd8.63b97cdc-919f-49eb-a213-c085258b1bac 1G" returned: 0 in 0.445s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c0d9415f-543c-413b-bcde-40193173c152 tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fcd73bbc-1032-4f50-a162-0b510a769cd8 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fcd73bbc-1032-4f50-a162-0b510a769cd8.63b97cdc-919f-49eb-a213-c085258b1bac {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:46 devstack sudo[106004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fcd73bbc-1032-4f50-a162-0b510a769cd8 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fcd73bbc-1032-4f50-a162-0b510a769cd8.63b97cdc-919f-49eb-a213-c085258b1bac
Jul 14 16:42:46 devstack sudo[106004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:46 devstack sudo[106004]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c0d9415f-543c-413b-bcde-40193173c152 tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fcd73bbc-1032-4f50-a162-0b510a769cd8 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fcd73bbc-1032-4f50-a162-0b510a769cd8.63b97cdc-919f-49eb-a213-c085258b1bac" returned: 0 in 0.303s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:46 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-c0d9415f-543c-413b-bcde-40193173c152 tempest-ProjectMemberTests-1242181671 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fcd73bbc-1032-4f50-a162-0b510a769cd8.63b97cdc-919f-49eb-a213-c085258b1bac is being set with open permissions: ugo+rw
Jul 14 16:42:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c0d9415f-543c-413b-bcde-40193173c152 tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fcd73bbc-1032-4f50-a162-0b510a769cd8.63b97cdc-919f-49eb-a213-c085258b1bac {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:46 devstack sudo[106010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fcd73bbc-1032-4f50-a162-0b510a769cd8.63b97cdc-919f-49eb-a213-c085258b1bac
Jul 14 16:42:46 devstack sudo[106010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:47 devstack sudo[106010]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c0d9415f-543c-413b-bcde-40193173c152 tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fcd73bbc-1032-4f50-a162-0b510a769cd8.63b97cdc-919f-49eb-a213-c085258b1bac" returned: 0 in 0.257s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c0d9415f-543c-413b-bcde-40193173c152 tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fcd73bbc-1032-4f50-a162-0b510a769cd8.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:47 devstack sudo[106013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fcd73bbc-1032-4f50-a162-0b510a769cd8.info
Jul 14 16:42:47 devstack sudo[106013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:47 devstack sudo[106013]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c0d9415f-543c-413b-bcde-40193173c152 tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fcd73bbc-1032-4f50-a162-0b510a769cd8.info" returned: 0 in 0.300s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:47 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-c0d9415f-543c-413b-bcde-40193173c152 tempest-ProjectMemberTests-1242181671 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fcd73bbc-1032-4f50-a162-0b510a769cd8.info is being set with open permissions: ugo+rw
Jul 14 16:42:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c0d9415f-543c-413b-bcde-40193173c152 tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fcd73bbc-1032-4f50-a162-0b510a769cd8.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:47 devstack sudo[106016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fcd73bbc-1032-4f50-a162-0b510a769cd8.info
Jul 14 16:42:47 devstack sudo[106016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:47 devstack sudo[106016]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c0d9415f-543c-413b-bcde-40193173c152 tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fcd73bbc-1032-4f50-a162-0b510a769cd8.info" returned: 0 in 0.289s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c0d9415f-543c-413b-bcde-40193173c152 tempest-ProjectMemberTests-1242181671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.101s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:42:47 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-c0d9415f-543c-413b-bcde-40193173c152 tempest-ProjectMemberTests-1242181671 None] Create snapshot completed successfully
Jul 14 16:42:48 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a7e90841-430b-40a1-a0e2-478a111c97ed tempest-ProjectMemberTests-1242181671 None] Acquiring lock "cinder-63b97cdc-919f-49eb-a213-c085258b1bac-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:42:48 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a7e90841-430b-40a1-a0e2-478a111c97ed tempest-ProjectMemberTests-1242181671 None] Lock "cinder-63b97cdc-919f-49eb-a213-c085258b1bac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:42:48 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a7e90841-430b-40a1-a0e2-478a111c97ed tempest-ProjectMemberTests-1242181671 None] Acquiring lock "cinder-quobyte-fcd73bbc-1032-4f50-a162-0b510a769cd8" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:42:48 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a7e90841-430b-40a1-a0e2-478a111c97ed tempest-ProjectMemberTests-1242181671 None] Lock "cinder-quobyte-fcd73bbc-1032-4f50-a162-0b510a769cd8" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:42:48 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a7e90841-430b-40a1-a0e2-478a111c97ed tempest-ProjectMemberTests-1242181671 None] Acquiring lock "cinder-quobyte-63b97cdc-919f-49eb-a213-c085258b1bac" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:42:48 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a7e90841-430b-40a1-a0e2-478a111c97ed tempest-ProjectMemberTests-1242181671 None] Lock "cinder-quobyte-63b97cdc-919f-49eb-a213-c085258b1bac" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:42:48 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-a7e90841-430b-40a1-a0e2-478a111c97ed tempest-ProjectMemberTests-1242181671 None] Deleting offline snapshot 63b97cdc-919f-49eb-a213-c085258b1bac of volume fcd73bbc-1032-4f50-a162-0b510a769cd8 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 16:42:48 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-a7e90841-430b-40a1-a0e2-478a111c97ed tempest-ProjectMemberTests-1242181671 None] snapshot_file for this snap is: volume-fcd73bbc-1032-4f50-a162-0b510a769cd8.63b97cdc-919f-49eb-a213-c085258b1bac {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 16:42:48 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc0fe05-9dd4-4e91-9583-659d591f25a3]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:42:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a7e90841-430b-40a1-a0e2-478a111c97ed tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fcd73bbc-1032-4f50-a162-0b510a769cd8.63b97cdc-919f-49eb-a213-c085258b1bac {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:49 devstack sudo[106019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fcd73bbc-1032-4f50-a162-0b510a769cd8.63b97cdc-919f-49eb-a213-c085258b1bac
Jul 14 16:42:49 devstack sudo[106019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:49 devstack sudo[106019]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a7e90841-430b-40a1-a0e2-478a111c97ed tempest-ProjectMemberTests-1242181671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fcd73bbc-1032-4f50-a162-0b510a769cd8.63b97cdc-919f-49eb-a213-c085258b1bac" returned: 0 in 0.404s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:49 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-a7e90841-430b-40a1-a0e2-478a111c97ed tempest-ProjectMemberTests-1242181671 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fcd73bbc-1032-4f50-a162-0b510a769cd8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 16:42:49 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aceee3d-7211-45d2-86d6-b56c5ad5ba9d]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:42:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a7e90841-430b-40a1-a0e2-478a111c97ed tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fcd73bbc-1032-4f50-a162-0b510a769cd8 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:49 devstack sudo[106024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fcd73bbc-1032-4f50-a162-0b510a769cd8
Jul 14 16:42:49 devstack sudo[106024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:49 devstack sudo[106024]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a7e90841-430b-40a1-a0e2-478a111c97ed tempest-ProjectMemberTests-1242181671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fcd73bbc-1032-4f50-a162-0b510a769cd8" returned: 0 in 0.402s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a7e90841-430b-40a1-a0e2-478a111c97ed tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fcd73bbc-1032-4f50-a162-0b510a769cd8.63b97cdc-919f-49eb-a213-c085258b1bac {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:49 devstack sudo[106030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fcd73bbc-1032-4f50-a162-0b510a769cd8.63b97cdc-919f-49eb-a213-c085258b1bac
Jul 14 16:42:49 devstack sudo[106030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:50 devstack sudo[106030]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a7e90841-430b-40a1-a0e2-478a111c97ed tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fcd73bbc-1032-4f50-a162-0b510a769cd8.63b97cdc-919f-49eb-a213-c085258b1bac" returned: 0 in 0.379s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a7e90841-430b-40a1-a0e2-478a111c97ed tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fcd73bbc-1032-4f50-a162-0b510a769cd8.63b97cdc-919f-49eb-a213-c085258b1bac {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:50 devstack sudo[106035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fcd73bbc-1032-4f50-a162-0b510a769cd8.63b97cdc-919f-49eb-a213-c085258b1bac
Jul 14 16:42:50 devstack sudo[106035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:50 devstack sudo[106035]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a7e90841-430b-40a1-a0e2-478a111c97ed tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fcd73bbc-1032-4f50-a162-0b510a769cd8.63b97cdc-919f-49eb-a213-c085258b1bac" returned: 0 in 0.261s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:50 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a7e90841-430b-40a1-a0e2-478a111c97ed tempest-ProjectMemberTests-1242181671 None] Lock "cinder-quobyte-63b97cdc-919f-49eb-a213-c085258b1bac" released by "_delete_snapshot" :: held 1.545s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:42:50 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a7e90841-430b-40a1-a0e2-478a111c97ed tempest-ProjectMemberTests-1242181671 None] Lock "cinder-quobyte-fcd73bbc-1032-4f50-a162-0b510a769cd8" released by "delete_snapshot" :: held 1.570s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:42:50 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:SELECT=132,cinder:INSERT=52,cinder:UPDATE=213,cinder:DELETE=19 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 16:42:50 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-a7e90841-430b-40a1-a0e2-478a111c97ed tempest-ProjectMemberTests-1242181671 None] Created reservations ['33ec26b6-d425-495a-990b-1226e4ccb302', '20e1da0a-da12-4241-a5f4-244668a1fd57', 'c1d3c42b-702d-42cf-8e98-31072437b088', 'f079e97e-2136-4c4f-bcd7-ce1e92730fd1'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:42:50 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-a7e90841-430b-40a1-a0e2-478a111c97ed tempest-ProjectMemberTests-1242181671 None] Delete snapshot completed successfully.
Jul 14 16:42:50 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a7e90841-430b-40a1-a0e2-478a111c97ed tempest-ProjectMemberTests-1242181671 None] Lock "cinder-63b97cdc-919f-49eb-a213-c085258b1bac-delete_snapshot" released by "delete_snapshot" :: held 1.744s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:42:50 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4faebcfc-f8e0-4f42-83e4-50eb8aed3687 tempest-ProjectMemberTests-1242181671 None] Acquiring lock "cinder-fcd73bbc-1032-4f50-a162-0b510a769cd8-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:42:50 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4faebcfc-f8e0-4f42-83e4-50eb8aed3687 tempest-ProjectMemberTests-1242181671 None] Lock "cinder-fcd73bbc-1032-4f50-a162-0b510a769cd8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:42:51 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4faebcfc-f8e0-4f42-83e4-50eb8aed3687 tempest-ProjectMemberTests-1242181671 None] Acquiring lock "cinder-quobyte-fcd73bbc-1032-4f50-a162-0b510a769cd8" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:42:51 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4faebcfc-f8e0-4f42-83e4-50eb8aed3687 tempest-ProjectMemberTests-1242181671 None] Lock "cinder-quobyte-fcd73bbc-1032-4f50-a162-0b510a769cd8" acquired by "delete_volume" :: waited 0.019s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:42:51 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c735415-0fd0-464d-9ab3-d67fce735ed0]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:42:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4faebcfc-f8e0-4f42-83e4-50eb8aed3687 tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fcd73bbc-1032-4f50-a162-0b510a769cd8 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:51 devstack sudo[106039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fcd73bbc-1032-4f50-a162-0b510a769cd8
Jul 14 16:42:51 devstack sudo[106039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:51 devstack sudo[106039]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4faebcfc-f8e0-4f42-83e4-50eb8aed3687 tempest-ProjectMemberTests-1242181671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fcd73bbc-1032-4f50-a162-0b510a769cd8" returned: 0 in 0.418s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4faebcfc-f8e0-4f42-83e4-50eb8aed3687 tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fcd73bbc-1032-4f50-a162-0b510a769cd8 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:51 devstack sudo[106044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fcd73bbc-1032-4f50-a162-0b510a769cd8
Jul 14 16:42:51 devstack sudo[106044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:51 devstack sudo[106044]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4faebcfc-f8e0-4f42-83e4-50eb8aed3687 tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-fcd73bbc-1032-4f50-a162-0b510a769cd8" returned: 0 in 0.269s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:51 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4faebcfc-f8e0-4f42-83e4-50eb8aed3687 tempest-ProjectMemberTests-1242181671 None] Lock "cinder-quobyte-fcd73bbc-1032-4f50-a162-0b510a769cd8" released by "delete_volume" :: held 0.766s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:42:51 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-4faebcfc-f8e0-4f42-83e4-50eb8aed3687 tempest-ProjectMemberTests-1242181671 None] Created reservations ['b91c18c0-5d7e-4ad5-bdeb-8ee1fc7e71aa', '0e1eb3c1-6c43-4aac-a265-7717b5881af8', '307519fe-215b-4038-9922-5faa78e23e18', '4fef2a1e-0ec4-4c82-ba22-a44c327a7cda'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:42:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-4faebcfc-f8e0-4f42-83e4-50eb8aed3687 tempest-ProjectMemberTests-1242181671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:42:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-4faebcfc-f8e0-4f42-83e4-50eb8aed3687 tempest-ProjectMemberTests-1242181671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:42:51 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-4faebcfc-f8e0-4f42-83e4-50eb8aed3687 tempest-ProjectMemberTests-1242181671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:42:51 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-4faebcfc-f8e0-4f42-83e4-50eb8aed3687 tempest-ProjectMemberTests-1242181671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:42:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-4faebcfc-f8e0-4f42-83e4-50eb8aed3687 tempest-ProjectMemberTests-1242181671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:42:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4faebcfc-f8e0-4f42-83e4-50eb8aed3687 tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:51 devstack sudo[106047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:42:51 devstack sudo[106047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:52 devstack sudo[106047]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4faebcfc-f8e0-4f42-83e4-50eb8aed3687 tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.255s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:52 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-4faebcfc-f8e0-4f42-83e4-50eb8aed3687 tempest-ProjectMemberTests-1242181671 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:42:52 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-4faebcfc-f8e0-4f42-83e4-50eb8aed3687 tempest-ProjectMemberTests-1242181671 None] Deleted volume successfully.
Jul 14 16:42:52 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4faebcfc-f8e0-4f42-83e4-50eb8aed3687 tempest-ProjectMemberTests-1242181671 None] Lock "cinder-fcd73bbc-1032-4f50-a162-0b510a769cd8-delete_volume" released by "delete_volume" :: held 1.240s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:42:52 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f3a81fc-8977-4777-8bbf-9f65957b7a4b tempest-ProjectMemberTests-1242181671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:42:52 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3f3a81fc-8977-4777-8bbf-9f65957b7a4b tempest-ProjectMemberTests-1242181671 None] Flow 'volume_create_manager' (aa3ae29b-9a46-49e9-bc87-6bd417a1b603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:42:52 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3f3a81fc-8977-4777-8bbf-9f65957b7a4b tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (058d774f-1103-4f43-8743-447b2f17a457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:42:52 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3f3a81fc-8977-4777-8bbf-9f65957b7a4b tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (058d774f-1103-4f43-8743-447b2f17a457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:42:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-71961342',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=141e948f-3502-414a-b69a-48c3c559fbfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dfc230bd6d54b87b4b187751f9a7039',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:42:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:42:53Z,use_quota=True,user_id='68f1fe3510e3473e91988f26916b8e51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:42:52 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3f3a81fc-8977-4777-8bbf-9f65957b7a4b tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32910f30-766a-4fa9-a6bf-e4196fec0d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:42:52 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3f3a81fc-8977-4777-8bbf-9f65957b7a4b tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32910f30-766a-4fa9-a6bf-e4196fec0d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:42:52 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3f3a81fc-8977-4777-8bbf-9f65957b7a4b tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ce2cb27-eecd-4631-b3f7-ae8ac1aa4fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:42:52 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3f3a81fc-8977-4777-8bbf-9f65957b7a4b tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ce2cb27-eecd-4631-b3f7-ae8ac1aa4fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '141e948f-3502-414a-b69a-48c3c559fbfc', 'volume_name': 'volume-141e948f-3502-414a-b69a-48c3c559fbfc', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:42:52 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3f3a81fc-8977-4777-8bbf-9f65957b7a4b tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d9b9211-9afa-4190-bbe0-71ab96911f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:42:52 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3f3a81fc-8977-4777-8bbf-9f65957b7a4b tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d9b9211-9afa-4190-bbe0-71ab96911f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:42:52 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3f3a81fc-8977-4777-8bbf-9f65957b7a4b tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4b8e25d-f5f5-483b-8f23-2da594acbbc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:42:52 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-3f3a81fc-8977-4777-8bbf-9f65957b7a4b tempest-ProjectMemberTests-1242181671 None] Volume 141e948f-3502-414a-b69a-48c3c559fbfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-141e948f-3502-414a-b69a-48c3c559fbfc', 'volume_size': 1}
Jul 14 16:42:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3f3a81fc-8977-4777-8bbf-9f65957b7a4b tempest-ProjectMemberTests-1242181671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:42:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3f3a81fc-8977-4777-8bbf-9f65957b7a4b tempest-ProjectMemberTests-1242181671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:42:52 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-3f3a81fc-8977-4777-8bbf-9f65957b7a4b tempest-ProjectMemberTests-1242181671 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:42:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-71961342',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=141e948f-3502-414a-b69a-48c3c559fbfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dfc230bd6d54b87b4b187751f9a7039',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:42:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:42:53Z,use_quota=True,user_id='68f1fe3510e3473e91988f26916b8e51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:42:52 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-3f3a81fc-8977-4777-8bbf-9f65957b7a4b tempest-ProjectMemberTests-1242181671 None] Creating volume 141e948f-3502-414a-b69a-48c3c559fbfc {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:42:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3f3a81fc-8977-4777-8bbf-9f65957b7a4b tempest-ProjectMemberTests-1242181671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:42:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3f3a81fc-8977-4777-8bbf-9f65957b7a4b tempest-ProjectMemberTests-1242181671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:42:52 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-3f3a81fc-8977-4777-8bbf-9f65957b7a4b tempest-ProjectMemberTests-1242181671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:42:52 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-3f3a81fc-8977-4777-8bbf-9f65957b7a4b tempest-ProjectMemberTests-1242181671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:42:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3f3a81fc-8977-4777-8bbf-9f65957b7a4b tempest-ProjectMemberTests-1242181671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:42:52 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-3f3a81fc-8977-4777-8bbf-9f65957b7a4b tempest-ProjectMemberTests-1242181671 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:42:52 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-3f3a81fc-8977-4777-8bbf-9f65957b7a4b tempest-ProjectMemberTests-1242181671 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:42:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3f3a81fc-8977-4777-8bbf-9f65957b7a4b tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-141e948f-3502-414a-b69a-48c3c559fbfc 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:52 devstack sudo[106050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-141e948f-3502-414a-b69a-48c3c559fbfc 1073741824
Jul 14 16:42:52 devstack sudo[106050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:53 devstack sudo[106050]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3f3a81fc-8977-4777-8bbf-9f65957b7a4b tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-141e948f-3502-414a-b69a-48c3c559fbfc 1073741824" returned: 0 in 0.542s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3f3a81fc-8977-4777-8bbf-9f65957b7a4b tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-141e948f-3502-414a-b69a-48c3c559fbfc {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:53 devstack sudo[106056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-141e948f-3502-414a-b69a-48c3c559fbfc
Jul 14 16:42:53 devstack sudo[106056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:53 devstack sudo[106056]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3f3a81fc-8977-4777-8bbf-9f65957b7a4b tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-141e948f-3502-414a-b69a-48c3c559fbfc" returned: 0 in 0.281s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:53 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-3f3a81fc-8977-4777-8bbf-9f65957b7a4b tempest-ProjectMemberTests-1242181671 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:42:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3f3a81fc-8977-4777-8bbf-9f65957b7a4b tempest-ProjectMemberTests-1242181671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:42:53 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3f3a81fc-8977-4777-8bbf-9f65957b7a4b tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4b8e25d-f5f5-483b-8f23-2da594acbbc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-141e948f-3502-414a-b69a-48c3c559fbfc', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:42:53 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3f3a81fc-8977-4777-8bbf-9f65957b7a4b tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83cd115f-601b-4935-9f93-e9a9b05b02ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:42:53 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-3f3a81fc-8977-4777-8bbf-9f65957b7a4b tempest-ProjectMemberTests-1242181671 None] Volume volume-141e948f-3502-414a-b69a-48c3c559fbfc (141e948f-3502-414a-b69a-48c3c559fbfc): created successfully
Jul 14 16:42:53 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3f3a81fc-8977-4777-8bbf-9f65957b7a4b tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83cd115f-601b-4935-9f93-e9a9b05b02ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:42:53 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3f3a81fc-8977-4777-8bbf-9f65957b7a4b tempest-ProjectMemberTests-1242181671 None] Flow 'volume_create_manager' (aa3ae29b-9a46-49e9-bc87-6bd417a1b603) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:42:53 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-3f3a81fc-8977-4777-8bbf-9f65957b7a4b tempest-ProjectMemberTests-1242181671 None] Created volume successfully.
Jul 14 16:42:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6acff4c2-e91a-4fb7-85a7-934cf12eae1b tempest-ProjectMemberTests-1242181671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:42:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6acff4c2-e91a-4fb7-85a7-934cf12eae1b tempest-ProjectMemberTests-1242181671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:42:54 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-6acff4c2-e91a-4fb7-85a7-934cf12eae1b tempest-ProjectMemberTests-1242181671 None] Creating offline snapshot 929515d4-d6d8-4346-88c5-4873f2c404f7 of volume 141e948f-3502-414a-b69a-48c3c559fbfc {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 16:42:55 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0994549-79fb-481d-b1ec-0b7c5ea9447f]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:42:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6acff4c2-e91a-4fb7-85a7-934cf12eae1b tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-141e948f-3502-414a-b69a-48c3c559fbfc {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:55 devstack sudo[106059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-141e948f-3502-414a-b69a-48c3c559fbfc
Jul 14 16:42:55 devstack sudo[106059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:55 devstack sudo[106059]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6acff4c2-e91a-4fb7-85a7-934cf12eae1b tempest-ProjectMemberTests-1242181671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-141e948f-3502-414a-b69a-48c3c559fbfc" returned: 0 in 0.396s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6acff4c2-e91a-4fb7-85a7-934cf12eae1b tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-141e948f-3502-414a-b69a-48c3c559fbfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-141e948f-3502-414a-b69a-48c3c559fbfc.929515d4-d6d8-4346-88c5-4873f2c404f7 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:55 devstack sudo[106064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-141e948f-3502-414a-b69a-48c3c559fbfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-141e948f-3502-414a-b69a-48c3c559fbfc.929515d4-d6d8-4346-88c5-4873f2c404f7 1G
Jul 14 16:42:55 devstack sudo[106064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:55 devstack sudo[106064]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6acff4c2-e91a-4fb7-85a7-934cf12eae1b tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-141e948f-3502-414a-b69a-48c3c559fbfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-141e948f-3502-414a-b69a-48c3c559fbfc.929515d4-d6d8-4346-88c5-4873f2c404f7 1G" returned: 0 in 0.478s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6acff4c2-e91a-4fb7-85a7-934cf12eae1b tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-141e948f-3502-414a-b69a-48c3c559fbfc -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-141e948f-3502-414a-b69a-48c3c559fbfc.929515d4-d6d8-4346-88c5-4873f2c404f7 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:55 devstack sudo[106070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-141e948f-3502-414a-b69a-48c3c559fbfc -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-141e948f-3502-414a-b69a-48c3c559fbfc.929515d4-d6d8-4346-88c5-4873f2c404f7
Jul 14 16:42:55 devstack sudo[106070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:56 devstack sudo[106070]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6acff4c2-e91a-4fb7-85a7-934cf12eae1b tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-141e948f-3502-414a-b69a-48c3c559fbfc -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-141e948f-3502-414a-b69a-48c3c559fbfc.929515d4-d6d8-4346-88c5-4873f2c404f7" returned: 0 in 0.332s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:56 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-6acff4c2-e91a-4fb7-85a7-934cf12eae1b tempest-ProjectMemberTests-1242181671 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-141e948f-3502-414a-b69a-48c3c559fbfc.929515d4-d6d8-4346-88c5-4873f2c404f7 is being set with open permissions: ugo+rw
Jul 14 16:42:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6acff4c2-e91a-4fb7-85a7-934cf12eae1b tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-141e948f-3502-414a-b69a-48c3c559fbfc.929515d4-d6d8-4346-88c5-4873f2c404f7 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:56 devstack sudo[106076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-141e948f-3502-414a-b69a-48c3c559fbfc.929515d4-d6d8-4346-88c5-4873f2c404f7
Jul 14 16:42:56 devstack sudo[106076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:56 devstack sudo[106076]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6acff4c2-e91a-4fb7-85a7-934cf12eae1b tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-141e948f-3502-414a-b69a-48c3c559fbfc.929515d4-d6d8-4346-88c5-4873f2c404f7" returned: 0 in 0.249s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6acff4c2-e91a-4fb7-85a7-934cf12eae1b tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-141e948f-3502-414a-b69a-48c3c559fbfc.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:56 devstack sudo[106079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-141e948f-3502-414a-b69a-48c3c559fbfc.info
Jul 14 16:42:56 devstack sudo[106079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:56 devstack sudo[106079]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6acff4c2-e91a-4fb7-85a7-934cf12eae1b tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-141e948f-3502-414a-b69a-48c3c559fbfc.info" returned: 0 in 0.344s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:56 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-6acff4c2-e91a-4fb7-85a7-934cf12eae1b tempest-ProjectMemberTests-1242181671 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-141e948f-3502-414a-b69a-48c3c559fbfc.info is being set with open permissions: ugo+rw
Jul 14 16:42:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6acff4c2-e91a-4fb7-85a7-934cf12eae1b tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-141e948f-3502-414a-b69a-48c3c559fbfc.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:56 devstack sudo[106082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-141e948f-3502-414a-b69a-48c3c559fbfc.info
Jul 14 16:42:56 devstack sudo[106082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:57 devstack sudo[106082]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6acff4c2-e91a-4fb7-85a7-934cf12eae1b tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-141e948f-3502-414a-b69a-48c3c559fbfc.info" returned: 0 in 0.282s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6acff4c2-e91a-4fb7-85a7-934cf12eae1b tempest-ProjectMemberTests-1242181671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.249s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:42:57 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-6acff4c2-e91a-4fb7-85a7-934cf12eae1b tempest-ProjectMemberTests-1242181671 None] Create snapshot completed successfully
Jul 14 16:42:57 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8ea36d8-4fdf-4027-9f30-31a5cc0f64b1 tempest-SnapshotDependencyTests-572517903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:42:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f8ea36d8-4fdf-4027-9f30-31a5cc0f64b1 tempest-SnapshotDependencyTests-572517903 None] Flow 'volume_create_manager' (7698e81d-9db4-46d3-b8af-0d2cb945de39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:42:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f8ea36d8-4fdf-4027-9f30-31a5cc0f64b1 tempest-SnapshotDependencyTests-572517903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16ab5ee7-0d32-47f5-b905-bff226e4fde3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:42:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f8ea36d8-4fdf-4027-9f30-31a5cc0f64b1 tempest-SnapshotDependencyTests-572517903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16ab5ee7-0d32-47f5-b905-bff226e4fde3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:42:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1122602645',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2ae62bf-65b8-4128-888b-b9229805e223,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e054d1a451d4a4d9a0ed6303b6908d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:42:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:42:58Z,use_quota=True,user_id='81d9eb7a1ecd48e6a1ac9f4bafbd7df7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:42:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f8ea36d8-4fdf-4027-9f30-31a5cc0f64b1 tempest-SnapshotDependencyTests-572517903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a9c33df-f24f-4b83-9cd4-dc7f9cdcd260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:42:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f8ea36d8-4fdf-4027-9f30-31a5cc0f64b1 tempest-SnapshotDependencyTests-572517903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a9c33df-f24f-4b83-9cd4-dc7f9cdcd260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:42:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f8ea36d8-4fdf-4027-9f30-31a5cc0f64b1 tempest-SnapshotDependencyTests-572517903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (914bbbc3-cd6d-43bc-b8e4-79b2f9df9890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:42:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f8ea36d8-4fdf-4027-9f30-31a5cc0f64b1 tempest-SnapshotDependencyTests-572517903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (914bbbc3-cd6d-43bc-b8e4-79b2f9df9890) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2ae62bf-65b8-4128-888b-b9229805e223', 'volume_name': 'volume-a2ae62bf-65b8-4128-888b-b9229805e223', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:42:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f8ea36d8-4fdf-4027-9f30-31a5cc0f64b1 tempest-SnapshotDependencyTests-572517903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cb5cbfe-5ff2-4d0e-8eb4-882949a4b468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:42:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f8ea36d8-4fdf-4027-9f30-31a5cc0f64b1 tempest-SnapshotDependencyTests-572517903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cb5cbfe-5ff2-4d0e-8eb4-882949a4b468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:42:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f8ea36d8-4fdf-4027-9f30-31a5cc0f64b1 tempest-SnapshotDependencyTests-572517903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4254d3d1-bbb3-4746-9e24-422df8be43a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:42:57 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-f8ea36d8-4fdf-4027-9f30-31a5cc0f64b1 tempest-SnapshotDependencyTests-572517903 None] Volume a2ae62bf-65b8-4128-888b-b9229805e223: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2ae62bf-65b8-4128-888b-b9229805e223', 'volume_size': 1}
Jul 14 16:42:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f8ea36d8-4fdf-4027-9f30-31a5cc0f64b1 tempest-SnapshotDependencyTests-572517903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:42:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f8ea36d8-4fdf-4027-9f30-31a5cc0f64b1 tempest-SnapshotDependencyTests-572517903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:42:57 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f8ea36d8-4fdf-4027-9f30-31a5cc0f64b1 tempest-SnapshotDependencyTests-572517903 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:42:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1122602645',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2ae62bf-65b8-4128-888b-b9229805e223,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e054d1a451d4a4d9a0ed6303b6908d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:42:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:42:58Z,use_quota=True,user_id='81d9eb7a1ecd48e6a1ac9f4bafbd7df7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:42:57 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-f8ea36d8-4fdf-4027-9f30-31a5cc0f64b1 tempest-SnapshotDependencyTests-572517903 None] Creating volume a2ae62bf-65b8-4128-888b-b9229805e223 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:42:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f8ea36d8-4fdf-4027-9f30-31a5cc0f64b1 tempest-SnapshotDependencyTests-572517903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:42:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f8ea36d8-4fdf-4027-9f30-31a5cc0f64b1 tempest-SnapshotDependencyTests-572517903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:42:57 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f8ea36d8-4fdf-4027-9f30-31a5cc0f64b1 tempest-SnapshotDependencyTests-572517903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:42:57 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f8ea36d8-4fdf-4027-9f30-31a5cc0f64b1 tempest-SnapshotDependencyTests-572517903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:42:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f8ea36d8-4fdf-4027-9f30-31a5cc0f64b1 tempest-SnapshotDependencyTests-572517903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:42:57 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f8ea36d8-4fdf-4027-9f30-31a5cc0f64b1 tempest-SnapshotDependencyTests-572517903 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:42:57 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-f8ea36d8-4fdf-4027-9f30-31a5cc0f64b1 tempest-SnapshotDependencyTests-572517903 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:42:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f8ea36d8-4fdf-4027-9f30-31a5cc0f64b1 tempest-SnapshotDependencyTests-572517903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a2ae62bf-65b8-4128-888b-b9229805e223 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:57 devstack sudo[106085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a2ae62bf-65b8-4128-888b-b9229805e223 1073741824
Jul 14 16:42:57 devstack sudo[106085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:58 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-560e0851-d405-4453-b0a6-7f4360a2f0a0 tempest-ProjectMemberTests-1242181671 None] Acquiring lock "cinder-929515d4-d6d8-4346-88c5-4873f2c404f7-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:42:58 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-560e0851-d405-4453-b0a6-7f4360a2f0a0 tempest-ProjectMemberTests-1242181671 None] Lock "cinder-929515d4-d6d8-4346-88c5-4873f2c404f7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:42:58 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-560e0851-d405-4453-b0a6-7f4360a2f0a0 tempest-ProjectMemberTests-1242181671 None] Acquiring lock "cinder-quobyte-141e948f-3502-414a-b69a-48c3c559fbfc" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:42:58 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-560e0851-d405-4453-b0a6-7f4360a2f0a0 tempest-ProjectMemberTests-1242181671 None] Lock "cinder-quobyte-141e948f-3502-414a-b69a-48c3c559fbfc" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:42:58 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-560e0851-d405-4453-b0a6-7f4360a2f0a0 tempest-ProjectMemberTests-1242181671 None] Acquiring lock "cinder-quobyte-929515d4-d6d8-4346-88c5-4873f2c404f7" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:42:58 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-560e0851-d405-4453-b0a6-7f4360a2f0a0 tempest-ProjectMemberTests-1242181671 None] Lock "cinder-quobyte-929515d4-d6d8-4346-88c5-4873f2c404f7" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:42:58 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-560e0851-d405-4453-b0a6-7f4360a2f0a0 tempest-ProjectMemberTests-1242181671 None] Deleting offline snapshot 929515d4-d6d8-4346-88c5-4873f2c404f7 of volume 141e948f-3502-414a-b69a-48c3c559fbfc {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 16:42:58 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-560e0851-d405-4453-b0a6-7f4360a2f0a0 tempest-ProjectMemberTests-1242181671 None] snapshot_file for this snap is: volume-141e948f-3502-414a-b69a-48c3c559fbfc.929515d4-d6d8-4346-88c5-4873f2c404f7 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 16:42:58 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8081628-be5e-484d-98e8-4c1d00753efa]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:42:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-560e0851-d405-4453-b0a6-7f4360a2f0a0 tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-141e948f-3502-414a-b69a-48c3c559fbfc.929515d4-d6d8-4346-88c5-4873f2c404f7 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:58 devstack sudo[106089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-141e948f-3502-414a-b69a-48c3c559fbfc.929515d4-d6d8-4346-88c5-4873f2c404f7
Jul 14 16:42:58 devstack sudo[106089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:58 devstack sudo[106085]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f8ea36d8-4fdf-4027-9f30-31a5cc0f64b1 tempest-SnapshotDependencyTests-572517903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a2ae62bf-65b8-4128-888b-b9229805e223 1073741824" returned: 0 in 0.457s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:58 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:INSERT=49,cinder:UPDATE=175,cinder:SELECT=156,cinder:DELETE=13 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 16:42:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f8ea36d8-4fdf-4027-9f30-31a5cc0f64b1 tempest-SnapshotDependencyTests-572517903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a2ae62bf-65b8-4128-888b-b9229805e223 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:58 devstack sudo[106093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a2ae62bf-65b8-4128-888b-b9229805e223
Jul 14 16:42:58 devstack sudo[106093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:58 devstack sudo[106089]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-560e0851-d405-4453-b0a6-7f4360a2f0a0 tempest-ProjectMemberTests-1242181671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-141e948f-3502-414a-b69a-48c3c559fbfc.929515d4-d6d8-4346-88c5-4873f2c404f7" returned: 0 in 0.377s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:58 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-560e0851-d405-4453-b0a6-7f4360a2f0a0 tempest-ProjectMemberTests-1242181671 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-141e948f-3502-414a-b69a-48c3c559fbfc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 16:42:58 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[54061d47-b33b-48f1-afc3-9da46df781a3]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:42:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-560e0851-d405-4453-b0a6-7f4360a2f0a0 tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-141e948f-3502-414a-b69a-48c3c559fbfc {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:58 devstack sudo[106093]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:58 devstack sudo[106098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-141e948f-3502-414a-b69a-48c3c559fbfc
Jul 14 16:42:58 devstack sudo[106098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f8ea36d8-4fdf-4027-9f30-31a5cc0f64b1 tempest-SnapshotDependencyTests-572517903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a2ae62bf-65b8-4128-888b-b9229805e223" returned: 0 in 0.267s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:58 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f8ea36d8-4fdf-4027-9f30-31a5cc0f64b1 tempest-SnapshotDependencyTests-572517903 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:42:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f8ea36d8-4fdf-4027-9f30-31a5cc0f64b1 tempest-SnapshotDependencyTests-572517903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:42:58 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f8ea36d8-4fdf-4027-9f30-31a5cc0f64b1 tempest-SnapshotDependencyTests-572517903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4254d3d1-bbb3-4746-9e24-422df8be43a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2ae62bf-65b8-4128-888b-b9229805e223', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:42:58 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f8ea36d8-4fdf-4027-9f30-31a5cc0f64b1 tempest-SnapshotDependencyTests-572517903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53333878-a409-4f63-84e8-541b8717cb7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:42:58 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-f8ea36d8-4fdf-4027-9f30-31a5cc0f64b1 tempest-SnapshotDependencyTests-572517903 None] Volume volume-a2ae62bf-65b8-4128-888b-b9229805e223 (a2ae62bf-65b8-4128-888b-b9229805e223): created successfully
Jul 14 16:42:58 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f8ea36d8-4fdf-4027-9f30-31a5cc0f64b1 tempest-SnapshotDependencyTests-572517903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53333878-a409-4f63-84e8-541b8717cb7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:42:58 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f8ea36d8-4fdf-4027-9f30-31a5cc0f64b1 tempest-SnapshotDependencyTests-572517903 None] Flow 'volume_create_manager' (7698e81d-9db4-46d3-b8af-0d2cb945de39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:42:58 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-f8ea36d8-4fdf-4027-9f30-31a5cc0f64b1 tempest-SnapshotDependencyTests-572517903 None] Created volume successfully.
Jul 14 16:42:58 devstack sudo[106098]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-560e0851-d405-4453-b0a6-7f4360a2f0a0 tempest-ProjectMemberTests-1242181671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-141e948f-3502-414a-b69a-48c3c559fbfc" returned: 0 in 0.379s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-560e0851-d405-4453-b0a6-7f4360a2f0a0 tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-141e948f-3502-414a-b69a-48c3c559fbfc.929515d4-d6d8-4346-88c5-4873f2c404f7 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:59 devstack sudo[106104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-141e948f-3502-414a-b69a-48c3c559fbfc.929515d4-d6d8-4346-88c5-4873f2c404f7
Jul 14 16:42:59 devstack sudo[106104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ac2d47da-0112-4e51-be6d-9967c2e73ba5 tempest-SnapshotDependencyTests-572517903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:42:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ac2d47da-0112-4e51-be6d-9967c2e73ba5 tempest-SnapshotDependencyTests-572517903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:42:59 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-ac2d47da-0112-4e51-be6d-9967c2e73ba5 tempest-SnapshotDependencyTests-572517903 None] Creating offline snapshot a49285db-ffa5-4ad5-866d-2aa6a35ef0b4 of volume a2ae62bf-65b8-4128-888b-b9229805e223 {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 16:42:59 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f576e4c-5819-4c7d-b92d-2239590df41e]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:42:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ac2d47da-0112-4e51-be6d-9967c2e73ba5 tempest-SnapshotDependencyTests-572517903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a2ae62bf-65b8-4128-888b-b9229805e223 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:59 devstack sudo[106106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a2ae62bf-65b8-4128-888b-b9229805e223
Jul 14 16:42:59 devstack sudo[106106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:59 devstack sudo[106104]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-560e0851-d405-4453-b0a6-7f4360a2f0a0 tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-141e948f-3502-414a-b69a-48c3c559fbfc.929515d4-d6d8-4346-88c5-4873f2c404f7" returned: 0 in 0.371s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-560e0851-d405-4453-b0a6-7f4360a2f0a0 tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-141e948f-3502-414a-b69a-48c3c559fbfc.929515d4-d6d8-4346-88c5-4873f2c404f7 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:59 devstack sudo[106111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-141e948f-3502-414a-b69a-48c3c559fbfc.929515d4-d6d8-4346-88c5-4873f2c404f7
Jul 14 16:42:59 devstack sudo[106111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:59 devstack sudo[106106]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ac2d47da-0112-4e51-be6d-9967c2e73ba5 tempest-SnapshotDependencyTests-572517903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a2ae62bf-65b8-4128-888b-b9229805e223" returned: 0 in 0.393s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ac2d47da-0112-4e51-be6d-9967c2e73ba5 tempest-SnapshotDependencyTests-572517903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a2ae62bf-65b8-4128-888b-b9229805e223,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a2ae62bf-65b8-4128-888b-b9229805e223.a49285db-ffa5-4ad5-866d-2aa6a35ef0b4 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:42:59 devstack sudo[106117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a2ae62bf-65b8-4128-888b-b9229805e223,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a2ae62bf-65b8-4128-888b-b9229805e223.a49285db-ffa5-4ad5-866d-2aa6a35ef0b4 1G
Jul 14 16:42:59 devstack sudo[106117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:42:59 devstack sudo[106111]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-560e0851-d405-4453-b0a6-7f4360a2f0a0 tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-141e948f-3502-414a-b69a-48c3c559fbfc.929515d4-d6d8-4346-88c5-4873f2c404f7" returned: 0 in 0.278s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:59 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-560e0851-d405-4453-b0a6-7f4360a2f0a0 tempest-ProjectMemberTests-1242181671 None] Lock "cinder-quobyte-929515d4-d6d8-4346-88c5-4873f2c404f7" released by "_delete_snapshot" :: held 1.510s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:42:59 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-560e0851-d405-4453-b0a6-7f4360a2f0a0 tempest-ProjectMemberTests-1242181671 None] Lock "cinder-quobyte-141e948f-3502-414a-b69a-48c3c559fbfc" released by "delete_snapshot" :: held 1.533s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:42:59 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-560e0851-d405-4453-b0a6-7f4360a2f0a0 tempest-ProjectMemberTests-1242181671 None] Created reservations ['d12ea8a1-3e80-4756-a72d-9cb4c5d0f67f', '8cae42f0-b71a-47c2-955f-6b3a9f6bc5dc', 'ecc97ade-63e6-463b-915e-f3100dee667b', 'a3105617-68fe-4ed0-ad26-5c38dfbb7015'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:42:59 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-560e0851-d405-4453-b0a6-7f4360a2f0a0 tempest-ProjectMemberTests-1242181671 None] Delete snapshot completed successfully.
Jul 14 16:42:59 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-560e0851-d405-4453-b0a6-7f4360a2f0a0 tempest-ProjectMemberTests-1242181671 None] Lock "cinder-929515d4-d6d8-4346-88c5-4873f2c404f7-delete_snapshot" released by "delete_snapshot" :: held 1.678s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:42:59 devstack sudo[106117]: pam_unix(sudo:session): session closed for user root
Jul 14 16:42:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ac2d47da-0112-4e51-be6d-9967c2e73ba5 tempest-SnapshotDependencyTests-572517903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a2ae62bf-65b8-4128-888b-b9229805e223,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a2ae62bf-65b8-4128-888b-b9229805e223.a49285db-ffa5-4ad5-866d-2aa6a35ef0b4 1G" returned: 0 in 0.418s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:42:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ac2d47da-0112-4e51-be6d-9967c2e73ba5 tempest-SnapshotDependencyTests-572517903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2ae62bf-65b8-4128-888b-b9229805e223 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a2ae62bf-65b8-4128-888b-b9229805e223.a49285db-ffa5-4ad5-866d-2aa6a35ef0b4 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:43:00 devstack sudo[106123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2ae62bf-65b8-4128-888b-b9229805e223 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a2ae62bf-65b8-4128-888b-b9229805e223.a49285db-ffa5-4ad5-866d-2aa6a35ef0b4
Jul 14 16:43:00 devstack sudo[106123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:43:00 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-12da155e-5c00-4aad-84a5-8dc73164915e tempest-ProjectMemberTests-1242181671 None] Acquiring lock "cinder-141e948f-3502-414a-b69a-48c3c559fbfc-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:43:00 devstack sudo[106123]: pam_unix(sudo:session): session closed for user root
Jul 14 16:43:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ac2d47da-0112-4e51-be6d-9967c2e73ba5 tempest-SnapshotDependencyTests-572517903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2ae62bf-65b8-4128-888b-b9229805e223 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a2ae62bf-65b8-4128-888b-b9229805e223.a49285db-ffa5-4ad5-866d-2aa6a35ef0b4" returned: 0 in 0.301s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:43:00 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-ac2d47da-0112-4e51-be6d-9967c2e73ba5 tempest-SnapshotDependencyTests-572517903 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a2ae62bf-65b8-4128-888b-b9229805e223.a49285db-ffa5-4ad5-866d-2aa6a35ef0b4 is being set with open permissions: ugo+rw
Jul 14 16:43:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ac2d47da-0112-4e51-be6d-9967c2e73ba5 tempest-SnapshotDependencyTests-572517903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a2ae62bf-65b8-4128-888b-b9229805e223.a49285db-ffa5-4ad5-866d-2aa6a35ef0b4 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:43:00 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-12da155e-5c00-4aad-84a5-8dc73164915e tempest-ProjectMemberTests-1242181671 None] Lock "cinder-141e948f-3502-414a-b69a-48c3c559fbfc-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:43:00 devstack sudo[106129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a2ae62bf-65b8-4128-888b-b9229805e223.a49285db-ffa5-4ad5-866d-2aa6a35ef0b4
Jul 14 16:43:00 devstack sudo[106129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:43:00 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-12da155e-5c00-4aad-84a5-8dc73164915e tempest-ProjectMemberTests-1242181671 None] Acquiring lock "cinder-quobyte-141e948f-3502-414a-b69a-48c3c559fbfc" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:43:00 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-12da155e-5c00-4aad-84a5-8dc73164915e tempest-ProjectMemberTests-1242181671 None] Lock "cinder-quobyte-141e948f-3502-414a-b69a-48c3c559fbfc" acquired by "delete_volume" :: waited 0.022s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:43:00 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f81e052-dd8f-46f3-8572-4d84b95d7546]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:43:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-12da155e-5c00-4aad-84a5-8dc73164915e tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-141e948f-3502-414a-b69a-48c3c559fbfc {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:43:00 devstack sudo[106131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-141e948f-3502-414a-b69a-48c3c559fbfc
Jul 14 16:43:00 devstack sudo[106131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:43:00 devstack sudo[106129]: pam_unix(sudo:session): session closed for user root
Jul 14 16:43:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ac2d47da-0112-4e51-be6d-9967c2e73ba5 tempest-SnapshotDependencyTests-572517903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a2ae62bf-65b8-4128-888b-b9229805e223.a49285db-ffa5-4ad5-866d-2aa6a35ef0b4" returned: 0 in 0.263s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:43:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ac2d47da-0112-4e51-be6d-9967c2e73ba5 tempest-SnapshotDependencyTests-572517903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a2ae62bf-65b8-4128-888b-b9229805e223.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:43:00 devstack sudo[106134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a2ae62bf-65b8-4128-888b-b9229805e223.info
Jul 14 16:43:00 devstack sudo[106134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:43:00 devstack sudo[106131]: pam_unix(sudo:session): session closed for user root
Jul 14 16:43:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-12da155e-5c00-4aad-84a5-8dc73164915e tempest-ProjectMemberTests-1242181671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-141e948f-3502-414a-b69a-48c3c559fbfc" returned: 0 in 0.390s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:43:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-12da155e-5c00-4aad-84a5-8dc73164915e tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-141e948f-3502-414a-b69a-48c3c559fbfc {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:43:00 devstack sudo[106140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-141e948f-3502-414a-b69a-48c3c559fbfc
Jul 14 16:43:00 devstack sudo[106140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:43:00 devstack sudo[106134]: pam_unix(sudo:session): session closed for user root
Jul 14 16:43:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ac2d47da-0112-4e51-be6d-9967c2e73ba5 tempest-SnapshotDependencyTests-572517903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a2ae62bf-65b8-4128-888b-b9229805e223.info" returned: 0 in 0.269s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:43:00 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-ac2d47da-0112-4e51-be6d-9967c2e73ba5 tempest-SnapshotDependencyTests-572517903 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a2ae62bf-65b8-4128-888b-b9229805e223.info is being set with open permissions: ugo+rw
Jul 14 16:43:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ac2d47da-0112-4e51-be6d-9967c2e73ba5 tempest-SnapshotDependencyTests-572517903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a2ae62bf-65b8-4128-888b-b9229805e223.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:43:00 devstack sudo[106142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a2ae62bf-65b8-4128-888b-b9229805e223.info
Jul 14 16:43:00 devstack sudo[106142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:43:01 devstack sudo[106140]: pam_unix(sudo:session): session closed for user root
Jul 14 16:43:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-12da155e-5c00-4aad-84a5-8dc73164915e tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-141e948f-3502-414a-b69a-48c3c559fbfc" returned: 0 in 0.270s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:43:01 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-12da155e-5c00-4aad-84a5-8dc73164915e tempest-ProjectMemberTests-1242181671 None] Lock "cinder-quobyte-141e948f-3502-414a-b69a-48c3c559fbfc" released by "delete_volume" :: held 0.716s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:43:01 devstack sudo[106142]: pam_unix(sudo:session): session closed for user root
Jul 14 16:43:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ac2d47da-0112-4e51-be6d-9967c2e73ba5 tempest-SnapshotDependencyTests-572517903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a2ae62bf-65b8-4128-888b-b9229805e223.info" returned: 0 in 0.262s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:43:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ac2d47da-0112-4e51-be6d-9967c2e73ba5 tempest-SnapshotDependencyTests-572517903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.998s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:43:01 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-12da155e-5c00-4aad-84a5-8dc73164915e tempest-ProjectMemberTests-1242181671 None] Created reservations ['2129bb00-8dad-476d-be70-9d6c154750a6', '44c7f364-6eef-444f-a4e3-5cc9feee6ce5', '0b098d6d-25c5-4df6-8501-68d19dec3040', '8b315fbf-4f11-47ac-9c80-c5a29e533346'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:43:01 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-ac2d47da-0112-4e51-be6d-9967c2e73ba5 tempest-SnapshotDependencyTests-572517903 None] Create snapshot completed successfully
Jul 14 16:43:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-12da155e-5c00-4aad-84a5-8dc73164915e tempest-ProjectMemberTests-1242181671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:43:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-12da155e-5c00-4aad-84a5-8dc73164915e tempest-ProjectMemberTests-1242181671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:43:01 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-12da155e-5c00-4aad-84a5-8dc73164915e tempest-ProjectMemberTests-1242181671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:43:01 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-12da155e-5c00-4aad-84a5-8dc73164915e tempest-ProjectMemberTests-1242181671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:43:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-12da155e-5c00-4aad-84a5-8dc73164915e tempest-ProjectMemberTests-1242181671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:43:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-12da155e-5c00-4aad-84a5-8dc73164915e tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:43:01 devstack sudo[106146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:43:01 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:43:01 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root
Jul 14 16:43:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-12da155e-5c00-4aad-84a5-8dc73164915e tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.263s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:43:01 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-12da155e-5c00-4aad-84a5-8dc73164915e tempest-ProjectMemberTests-1242181671 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:43:01 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-12da155e-5c00-4aad-84a5-8dc73164915e tempest-ProjectMemberTests-1242181671 None] Deleted volume successfully.
Jul 14 16:43:01 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-12da155e-5c00-4aad-84a5-8dc73164915e tempest-ProjectMemberTests-1242181671 None] Lock "cinder-141e948f-3502-414a-b69a-48c3c559fbfc-delete_volume" released by "delete_volume" :: held 1.226s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:43:01 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4c21072-fee8-490f-ae7b-1ca6569dbdd2 tempest-ProjectMemberTests-1242181671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:43:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a4c21072-fee8-490f-ae7b-1ca6569dbdd2 tempest-ProjectMemberTests-1242181671 None] Flow 'volume_create_manager' (a96ce2de-e5fb-4416-a8d1-4fe740f494c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:43:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a4c21072-fee8-490f-ae7b-1ca6569dbdd2 tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (680712e3-3d2d-498b-97c3-b7833bc8a940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:43:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a4c21072-fee8-490f-ae7b-1ca6569dbdd2 tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (680712e3-3d2d-498b-97c3-b7833bc8a940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:43:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1446771412',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87ce036a-4a71-4c35-bff6-ed1762e56110,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dfc230bd6d54b87b4b187751f9a7039',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:43:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:43:02Z,use_quota=True,user_id='68f1fe3510e3473e91988f26916b8e51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:43:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a4c21072-fee8-490f-ae7b-1ca6569dbdd2 tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5894cf2c-83a2-4dc4-b0cd-bbae328d288b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:43:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a4c21072-fee8-490f-ae7b-1ca6569dbdd2 tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5894cf2c-83a2-4dc4-b0cd-bbae328d288b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:43:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a4c21072-fee8-490f-ae7b-1ca6569dbdd2 tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17c87754-3a81-4851-835d-a3e41d1e0399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:43:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a4c21072-fee8-490f-ae7b-1ca6569dbdd2 tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17c87754-3a81-4851-835d-a3e41d1e0399) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87ce036a-4a71-4c35-bff6-ed1762e56110', 'volume_name': 'volume-87ce036a-4a71-4c35-bff6-ed1762e56110', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:43:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a4c21072-fee8-490f-ae7b-1ca6569dbdd2 tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a911c962-3474-4a66-943a-807d534c703d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:43:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a4c21072-fee8-490f-ae7b-1ca6569dbdd2 tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a911c962-3474-4a66-943a-807d534c703d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:43:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a4c21072-fee8-490f-ae7b-1ca6569dbdd2 tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a6d9208-ba2e-44e8-8ca3-d90702032752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:43:01 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-a4c21072-fee8-490f-ae7b-1ca6569dbdd2 tempest-ProjectMemberTests-1242181671 None] Volume 87ce036a-4a71-4c35-bff6-ed1762e56110: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87ce036a-4a71-4c35-bff6-ed1762e56110', 'volume_size': 1}
Jul 14 16:43:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a4c21072-fee8-490f-ae7b-1ca6569dbdd2 tempest-ProjectMemberTests-1242181671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:43:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a4c21072-fee8-490f-ae7b-1ca6569dbdd2 tempest-ProjectMemberTests-1242181671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:43:01 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a4c21072-fee8-490f-ae7b-1ca6569dbdd2 tempest-ProjectMemberTests-1242181671 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:43:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1446771412',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87ce036a-4a71-4c35-bff6-ed1762e56110,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dfc230bd6d54b87b4b187751f9a7039',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:43:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:43:02Z,use_quota=True,user_id='68f1fe3510e3473e91988f26916b8e51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:43:01 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-a4c21072-fee8-490f-ae7b-1ca6569dbdd2 tempest-ProjectMemberTests-1242181671 None] Creating volume 87ce036a-4a71-4c35-bff6-ed1762e56110 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:43:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a4c21072-fee8-490f-ae7b-1ca6569dbdd2 tempest-ProjectMemberTests-1242181671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:43:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a4c21072-fee8-490f-ae7b-1ca6569dbdd2 tempest-ProjectMemberTests-1242181671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:43:01 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a4c21072-fee8-490f-ae7b-1ca6569dbdd2 tempest-ProjectMemberTests-1242181671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:43:01 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a4c21072-fee8-490f-ae7b-1ca6569dbdd2 tempest-ProjectMemberTests-1242181671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:43:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a4c21072-fee8-490f-ae7b-1ca6569dbdd2 tempest-ProjectMemberTests-1242181671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:43:01 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a4c21072-fee8-490f-ae7b-1ca6569dbdd2 tempest-ProjectMemberTests-1242181671 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:43:01 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-a4c21072-fee8-490f-ae7b-1ca6569dbdd2 tempest-ProjectMemberTests-1242181671 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:43:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a4c21072-fee8-490f-ae7b-1ca6569dbdd2 tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-87ce036a-4a71-4c35-bff6-ed1762e56110 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:43:02 devstack sudo[106149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-87ce036a-4a71-4c35-bff6-ed1762e56110 1073741824
Jul 14 16:43:02 devstack sudo[106149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:43:02 devstack sudo[106149]: pam_unix(sudo:session): session closed for user root
Jul 14 16:43:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a4c21072-fee8-490f-ae7b-1ca6569dbdd2 tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-87ce036a-4a71-4c35-bff6-ed1762e56110 1073741824" returned: 0 in 0.461s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:43:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a4c21072-fee8-490f-ae7b-1ca6569dbdd2 tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-87ce036a-4a71-4c35-bff6-ed1762e56110 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:43:02 devstack sudo[106155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-87ce036a-4a71-4c35-bff6-ed1762e56110
Jul 14 16:43:02 devstack sudo[106155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:43:02 devstack sudo[106155]: pam_unix(sudo:session): session closed for user root
Jul 14 16:43:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a4c21072-fee8-490f-ae7b-1ca6569dbdd2 tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-87ce036a-4a71-4c35-bff6-ed1762e56110" returned: 0 in 0.276s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:43:02 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a4c21072-fee8-490f-ae7b-1ca6569dbdd2 tempest-ProjectMemberTests-1242181671 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:43:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a4c21072-fee8-490f-ae7b-1ca6569dbdd2 tempest-ProjectMemberTests-1242181671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:43:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a4c21072-fee8-490f-ae7b-1ca6569dbdd2 tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a6d9208-ba2e-44e8-8ca3-d90702032752) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87ce036a-4a71-4c35-bff6-ed1762e56110', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:43:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a4c21072-fee8-490f-ae7b-1ca6569dbdd2 tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf728d3a-61e4-4d13-855c-02019ec81849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:43:02 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-a4c21072-fee8-490f-ae7b-1ca6569dbdd2 tempest-ProjectMemberTests-1242181671 None] Volume volume-87ce036a-4a71-4c35-bff6-ed1762e56110 (87ce036a-4a71-4c35-bff6-ed1762e56110): created successfully
Jul 14 16:43:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a4c21072-fee8-490f-ae7b-1ca6569dbdd2 tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf728d3a-61e4-4d13-855c-02019ec81849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:43:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a4c21072-fee8-490f-ae7b-1ca6569dbdd2 tempest-ProjectMemberTests-1242181671 None] Flow 'volume_create_manager' (a96ce2de-e5fb-4416-a8d1-4fe740f494c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:43:02 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-a4c21072-fee8-490f-ae7b-1ca6569dbdd2 tempest-ProjectMemberTests-1242181671 None] Created volume successfully.
Jul 14 16:43:02 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2815d40-e66f-469f-b04d-14078a930dbb tempest-SnapshotDependencyTests-572517903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:43:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e2815d40-e66f-469f-b04d-14078a930dbb tempest-SnapshotDependencyTests-572517903 None] Flow 'volume_create_manager' (18de71f8-8c79-487f-9345-5f65273aabeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:43:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e2815d40-e66f-469f-b04d-14078a930dbb tempest-SnapshotDependencyTests-572517903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db444d6c-d721-4b30-a8f9-290ed26813a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:43:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e2815d40-e66f-469f-b04d-14078a930dbb tempest-SnapshotDependencyTests-572517903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db444d6c-d721-4b30-a8f9-290ed26813a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:43:03Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50843e78-4f4a-4b26-be59-79a93650656a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e054d1a451d4a4d9a0ed6303b6908d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:43:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a49285db-ffa5-4ad5-866d-2aa6a35ef0b4,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:43:03Z,use_quota=True,user_id='81d9eb7a1ecd48e6a1ac9f4bafbd7df7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:43:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e2815d40-e66f-469f-b04d-14078a930dbb tempest-SnapshotDependencyTests-572517903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b849b148-1bd3-4801-b1f2-c6df9c9f807d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:43:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e2815d40-e66f-469f-b04d-14078a930dbb tempest-SnapshotDependencyTests-572517903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b849b148-1bd3-4801-b1f2-c6df9c9f807d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:43:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e2815d40-e66f-469f-b04d-14078a930dbb tempest-SnapshotDependencyTests-572517903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75ecf605-b9d1-45b8-a1d9-e0f9eeb95637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:43:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e2815d40-e66f-469f-b04d-14078a930dbb tempest-SnapshotDependencyTests-572517903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75ecf605-b9d1-45b8-a1d9-e0f9eeb95637) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '50843e78-4f4a-4b26-be59-79a93650656a', 'volume_name': 'volume-50843e78-4f4a-4b26-be59-79a93650656a', 'volume_size': 1, 'snapshot_id': 'a49285db-ffa5-4ad5-866d-2aa6a35ef0b4'}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:43:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e2815d40-e66f-469f-b04d-14078a930dbb tempest-SnapshotDependencyTests-572517903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f13fce5d-db20-44c3-ab72-ba18661468ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:43:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e2815d40-e66f-469f-b04d-14078a930dbb tempest-SnapshotDependencyTests-572517903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f13fce5d-db20-44c3-ab72-ba18661468ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:43:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e2815d40-e66f-469f-b04d-14078a930dbb tempest-SnapshotDependencyTests-572517903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aba9bc7f-e395-46ae-b6f7-c2ed0aa2bac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:43:03 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-e2815d40-e66f-469f-b04d-14078a930dbb tempest-SnapshotDependencyTests-572517903 None] Volume 50843e78-4f4a-4b26-be59-79a93650656a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-50843e78-4f4a-4b26-be59-79a93650656a', 'volume_size': 1, 'snapshot_id': 'a49285db-ffa5-4ad5-866d-2aa6a35ef0b4'}
Jul 14 16:43:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e2815d40-e66f-469f-b04d-14078a930dbb tempest-SnapshotDependencyTests-572517903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:43:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e2815d40-e66f-469f-b04d-14078a930dbb tempest-SnapshotDependencyTests-572517903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:43:03 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e2815d40-e66f-469f-b04d-14078a930dbb tempest-SnapshotDependencyTests-572517903 None] Acquiring lock "cinder-quobyte-a49285db-ffa5-4ad5-866d-2aa6a35ef0b4-50843e78-4f4a-4b26-be59-79a93650656a" by "_create_volume_from_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:43:03 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e2815d40-e66f-469f-b04d-14078a930dbb tempest-SnapshotDependencyTests-572517903 None] Lock "cinder-quobyte-a49285db-ffa5-4ad5-866d-2aa6a35ef0b4-50843e78-4f4a-4b26-be59-79a93650656a" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:43:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-e2815d40-e66f-469f-b04d-14078a930dbb tempest-SnapshotDependencyTests-572517903 None] Creating volume 50843e78-4f4a-4b26-be59-79a93650656a from snapshot a49285db-ffa5-4ad5-866d-2aa6a35ef0b4 {{(pid=87166) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 14 16:43:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e2815d40-e66f-469f-b04d-14078a930dbb tempest-SnapshotDependencyTests-572517903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:43:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e2815d40-e66f-469f-b04d-14078a930dbb tempest-SnapshotDependencyTests-572517903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:43:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-e2815d40-e66f-469f-b04d-14078a930dbb tempest-SnapshotDependencyTests-572517903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:43:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-e2815d40-e66f-469f-b04d-14078a930dbb tempest-SnapshotDependencyTests-572517903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:43:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e2815d40-e66f-469f-b04d-14078a930dbb tempest-SnapshotDependencyTests-572517903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:43:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-e2815d40-e66f-469f-b04d-14078a930dbb tempest-SnapshotDependencyTests-572517903 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:43:03 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e2815d40-e66f-469f-b04d-14078a930dbb tempest-SnapshotDependencyTests-572517903 None] Acquiring lock "cinder-quobyte-50843e78-4f4a-4b26-be59-79a93650656a" by "_copy_volume_from_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:43:03 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e2815d40-e66f-469f-b04d-14078a930dbb tempest-SnapshotDependencyTests-572517903 None] Lock "cinder-quobyte-50843e78-4f4a-4b26-be59-79a93650656a" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:43:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-e2815d40-e66f-469f-b04d-14078a930dbb tempest-SnapshotDependencyTests-572517903 None] snapshot: a49285db-ffa5-4ad5-866d-2aa6a35ef0b4, volume: 50843e78-4f4a-4b26-be59-79a93650656a,  {{(pid=87166) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 14 16:43:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e2815d40-e66f-469f-b04d-14078a930dbb tempest-SnapshotDependencyTests-572517903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:43:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e2815d40-e66f-469f-b04d-14078a930dbb tempest-SnapshotDependencyTests-572517903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:43:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-e2815d40-e66f-469f-b04d-14078a930dbb tempest-SnapshotDependencyTests-572517903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:43:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-e2815d40-e66f-469f-b04d-14078a930dbb tempest-SnapshotDependencyTests-572517903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:43:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e2815d40-e66f-469f-b04d-14078a930dbb tempest-SnapshotDependencyTests-572517903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:43:03 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[4327b830-6ba4-4562-adf1-e0819a2d69ca]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:43:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e2815d40-e66f-469f-b04d-14078a930dbb tempest-SnapshotDependencyTests-572517903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a2ae62bf-65b8-4128-888b-b9229805e223.a49285db-ffa5-4ad5-866d-2aa6a35ef0b4 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:43:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-52212ec3-3288-48f1-b43f-bb2bb6754341 tempest-ProjectMemberTests-1242181671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:43:03 devstack sudo[106158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a2ae62bf-65b8-4128-888b-b9229805e223.a49285db-ffa5-4ad5-866d-2aa6a35ef0b4
Jul 14 16:43:03 devstack sudo[106158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:43:03 devstack sudo[106158]: pam_unix(sudo:session): session closed for user root
Jul 14 16:43:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e2815d40-e66f-469f-b04d-14078a930dbb tempest-SnapshotDependencyTests-572517903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a2ae62bf-65b8-4128-888b-b9229805e223.a49285db-ffa5-4ad5-866d-2aa6a35ef0b4" returned: 0 in 0.377s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:43:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-e2815d40-e66f-469f-b04d-14078a930dbb tempest-SnapshotDependencyTests-572517903 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2ae62bf-65b8-4128-888b-b9229805e223(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 16:43:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-e2815d40-e66f-469f-b04d-14078a930dbb tempest-SnapshotDependencyTests-572517903 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a2ae62bf-65b8-4128-888b-b9229805e223 {{(pid=87166) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 14 16:43:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-e2815d40-e66f-469f-b04d-14078a930dbb tempest-SnapshotDependencyTests-572517903 None] Creating direct copy from snapshot {{(pid=87166) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 14 16:43:03 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5bca628-cb1f-492f-8eb7-245e81941221]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:43:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e2815d40-e66f-469f-b04d-14078a930dbb tempest-SnapshotDependencyTests-572517903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a2ae62bf-65b8-4128-888b-b9229805e223 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:43:03 devstack sudo[106164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a2ae62bf-65b8-4128-888b-b9229805e223
Jul 14 16:43:03 devstack sudo[106164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:43:03 devstack sudo[106164]: pam_unix(sudo:session): session closed for user root
Jul 14 16:43:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e2815d40-e66f-469f-b04d-14078a930dbb tempest-SnapshotDependencyTests-572517903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a2ae62bf-65b8-4128-888b-b9229805e223" returned: 0 in 0.372s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:43:03 devstack cinder-volume[87166]: DEBUG cinder.utils [None req-e2815d40-e66f-469f-b04d-14078a930dbb tempest-SnapshotDependencyTests-572517903 None] Path /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-50843e78-4f4a-4b26-be59-79a93650656a not found in is_blk_device check {{(pid=87166) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 14 16:43:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e2815d40-e66f-469f-b04d-14078a930dbb tempest-SnapshotDependencyTests-572517903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a2ae62bf-65b8-4128-888b-b9229805e223 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-50843e78-4f4a-4b26-be59-79a93650656a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:43:03 devstack sudo[106169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a2ae62bf-65b8-4128-888b-b9229805e223 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-50843e78-4f4a-4b26-be59-79a93650656a
Jul 14 16:43:03 devstack sudo[106169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:43:07 devstack sudo[106169]: pam_unix(sudo:session): session closed for user root
Jul 14 16:43:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e2815d40-e66f-469f-b04d-14078a930dbb tempest-SnapshotDependencyTests-572517903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a2ae62bf-65b8-4128-888b-b9229805e223 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-50843e78-4f4a-4b26-be59-79a93650656a" returned: 0 in 4.120s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:43:08 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b3246bf-38d8-46f3-9c62-5d40feafce7c]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:43:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e2815d40-e66f-469f-b04d-14078a930dbb tempest-SnapshotDependencyTests-572517903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a2ae62bf-65b8-4128-888b-b9229805e223 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:43:08 devstack sudo[106182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a2ae62bf-65b8-4128-888b-b9229805e223
Jul 14 16:43:08 devstack sudo[106182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:43:08 devstack sudo[106182]: pam_unix(sudo:session): session closed for user root
Jul 14 16:43:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e2815d40-e66f-469f-b04d-14078a930dbb tempest-SnapshotDependencyTests-572517903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a2ae62bf-65b8-4128-888b-b9229805e223" returned: 0 in 0.528s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:43:08 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-e2815d40-e66f-469f-b04d-14078a930dbb tempest-SnapshotDependencyTests-572517903 None] Image conversion details: src /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a2ae62bf-65b8-4128-888b-b9229805e223, size 1024.00 MB, duration 4.12 sec, destination /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-50843e78-4f4a-4b26-be59-79a93650656a {{(pid=87166) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 14 16:43:08 devstack cinder-volume[87166]: INFO cinder.image.image_utils [None req-e2815d40-e66f-469f-b04d-14078a930dbb tempest-SnapshotDependencyTests-572517903 None] Converted 1024.00 MB image at 248.44 MB/s
Jul 14 16:43:08 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-e2815d40-e66f-469f-b04d-14078a930dbb tempest-SnapshotDependencyTests-572517903 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-50843e78-4f4a-4b26-be59-79a93650656a is being set with open permissions: ugo+rw
Jul 14 16:43:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e2815d40-e66f-469f-b04d-14078a930dbb tempest-SnapshotDependencyTests-572517903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-50843e78-4f4a-4b26-be59-79a93650656a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:43:08 devstack sudo[106187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-50843e78-4f4a-4b26-be59-79a93650656a
Jul 14 16:43:08 devstack sudo[106187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:43:08 devstack sudo[106187]: pam_unix(sudo:session): session closed for user root
Jul 14 16:43:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e2815d40-e66f-469f-b04d-14078a930dbb tempest-SnapshotDependencyTests-572517903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-50843e78-4f4a-4b26-be59-79a93650656a" returned: 0 in 0.243s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:43:08 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e2815d40-e66f-469f-b04d-14078a930dbb tempest-SnapshotDependencyTests-572517903 None] Lock "cinder-quobyte-50843e78-4f4a-4b26-be59-79a93650656a" released by "_copy_volume_from_snapshot" :: held 5.736s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:43:08 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e2815d40-e66f-469f-b04d-14078a930dbb tempest-SnapshotDependencyTests-572517903 None] Lock "cinder-quobyte-a49285db-ffa5-4ad5-866d-2aa6a35ef0b4-50843e78-4f4a-4b26-be59-79a93650656a" released by "_create_volume_from_snapshot" :: held 5.762s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:43:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e2815d40-e66f-469f-b04d-14078a930dbb tempest-SnapshotDependencyTests-572517903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.779s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:43:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-52212ec3-3288-48f1-b43f-bb2bb6754341 tempest-ProjectMemberTests-1242181671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.643s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:43:08 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-52212ec3-3288-48f1-b43f-bb2bb6754341 tempest-ProjectMemberTests-1242181671 None] Creating offline snapshot 2893ae50-5465-4550-95de-8be7a47ddea3 of volume 87ce036a-4a71-4c35-bff6-ed1762e56110 {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 16:43:08 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e2815d40-e66f-469f-b04d-14078a930dbb tempest-SnapshotDependencyTests-572517903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aba9bc7f-e395-46ae-b6f7-c2ed0aa2bac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50843e78-4f4a-4b26-be59-79a93650656a', 'volume_size': 1, 'snapshot_id': 'a49285db-ffa5-4ad5-866d-2aa6a35ef0b4'}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:43:08 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e2815d40-e66f-469f-b04d-14078a930dbb tempest-SnapshotDependencyTests-572517903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e521653e-3bfd-47f7-9b80-2d1bd2f0c99b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:43:08 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[274c031c-2411-4213-b20f-722ea98b4fd3]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:43:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-52212ec3-3288-48f1-b43f-bb2bb6754341 tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-87ce036a-4a71-4c35-bff6-ed1762e56110 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:43:08 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-e2815d40-e66f-469f-b04d-14078a930dbb tempest-SnapshotDependencyTests-572517903 None] Volume volume-50843e78-4f4a-4b26-be59-79a93650656a (50843e78-4f4a-4b26-be59-79a93650656a): created successfully
Jul 14 16:43:08 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e2815d40-e66f-469f-b04d-14078a930dbb tempest-SnapshotDependencyTests-572517903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e521653e-3bfd-47f7-9b80-2d1bd2f0c99b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:43:08 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e2815d40-e66f-469f-b04d-14078a930dbb tempest-SnapshotDependencyTests-572517903 None] Flow 'volume_create_manager' (18de71f8-8c79-487f-9345-5f65273aabeb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:43:08 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-e2815d40-e66f-469f-b04d-14078a930dbb tempest-SnapshotDependencyTests-572517903 None] Created volume successfully.
Jul 14 16:43:08 devstack sudo[106190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-87ce036a-4a71-4c35-bff6-ed1762e56110
Jul 14 16:43:08 devstack sudo[106190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:43:09 devstack sudo[106190]: pam_unix(sudo:session): session closed for user root
Jul 14 16:43:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-52212ec3-3288-48f1-b43f-bb2bb6754341 tempest-ProjectMemberTests-1242181671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-87ce036a-4a71-4c35-bff6-ed1762e56110" returned: 0 in 0.373s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:43:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-52212ec3-3288-48f1-b43f-bb2bb6754341 tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-87ce036a-4a71-4c35-bff6-ed1762e56110,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-87ce036a-4a71-4c35-bff6-ed1762e56110.2893ae50-5465-4550-95de-8be7a47ddea3 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:43:09 devstack sudo[106229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-87ce036a-4a71-4c35-bff6-ed1762e56110,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-87ce036a-4a71-4c35-bff6-ed1762e56110.2893ae50-5465-4550-95de-8be7a47ddea3 1G
Jul 14 16:43:09 devstack sudo[106229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:43:09 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0241d117-870e-4c0f-b7fd-31542e256361 tempest-SnapshotDependencyTests-572517903 None] Acquiring lock "cinder-a49285db-ffa5-4ad5-866d-2aa6a35ef0b4-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:43:09 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0241d117-870e-4c0f-b7fd-31542e256361 tempest-SnapshotDependencyTests-572517903 None] Lock "cinder-a49285db-ffa5-4ad5-866d-2aa6a35ef0b4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:43:09 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0241d117-870e-4c0f-b7fd-31542e256361 tempest-SnapshotDependencyTests-572517903 None] Acquiring lock "cinder-quobyte-a2ae62bf-65b8-4128-888b-b9229805e223" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:43:09 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0241d117-870e-4c0f-b7fd-31542e256361 tempest-SnapshotDependencyTests-572517903 None] Lock "cinder-quobyte-a2ae62bf-65b8-4128-888b-b9229805e223" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:43:09 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0241d117-870e-4c0f-b7fd-31542e256361 tempest-SnapshotDependencyTests-572517903 None] Acquiring lock "cinder-quobyte-a49285db-ffa5-4ad5-866d-2aa6a35ef0b4" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:43:09 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0241d117-870e-4c0f-b7fd-31542e256361 tempest-SnapshotDependencyTests-572517903 None] Lock "cinder-quobyte-a49285db-ffa5-4ad5-866d-2aa6a35ef0b4" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:43:09 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-0241d117-870e-4c0f-b7fd-31542e256361 tempest-SnapshotDependencyTests-572517903 None] Deleting offline snapshot a49285db-ffa5-4ad5-866d-2aa6a35ef0b4 of volume a2ae62bf-65b8-4128-888b-b9229805e223 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 16:43:09 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-0241d117-870e-4c0f-b7fd-31542e256361 tempest-SnapshotDependencyTests-572517903 None] snapshot_file for this snap is: volume-a2ae62bf-65b8-4128-888b-b9229805e223.a49285db-ffa5-4ad5-866d-2aa6a35ef0b4 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 16:43:09 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8b2a10-9262-45ce-bc4e-ec413c69660f]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:43:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0241d117-870e-4c0f-b7fd-31542e256361 tempest-SnapshotDependencyTests-572517903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a2ae62bf-65b8-4128-888b-b9229805e223.a49285db-ffa5-4ad5-866d-2aa6a35ef0b4 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:43:09 devstack sudo[106229]: pam_unix(sudo:session): session closed for user root
Jul 14 16:43:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-52212ec3-3288-48f1-b43f-bb2bb6754341 tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-87ce036a-4a71-4c35-bff6-ed1762e56110,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-87ce036a-4a71-4c35-bff6-ed1762e56110.2893ae50-5465-4550-95de-8be7a47ddea3 1G" returned: 0 in 0.417s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:43:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-52212ec3-3288-48f1-b43f-bb2bb6754341 tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87ce036a-4a71-4c35-bff6-ed1762e56110 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-87ce036a-4a71-4c35-bff6-ed1762e56110.2893ae50-5465-4550-95de-8be7a47ddea3 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:43:09 devstack sudo[106239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87ce036a-4a71-4c35-bff6-ed1762e56110 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-87ce036a-4a71-4c35-bff6-ed1762e56110.2893ae50-5465-4550-95de-8be7a47ddea3
Jul 14 16:43:09 devstack sudo[106239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:43:09 devstack sudo[106238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a2ae62bf-65b8-4128-888b-b9229805e223.a49285db-ffa5-4ad5-866d-2aa6a35ef0b4
Jul 14 16:43:09 devstack sudo[106238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:43:09 devstack sudo[106239]: pam_unix(sudo:session): session closed for user root
Jul 14 16:43:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-52212ec3-3288-48f1-b43f-bb2bb6754341 tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87ce036a-4a71-4c35-bff6-ed1762e56110 -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-87ce036a-4a71-4c35-bff6-ed1762e56110.2893ae50-5465-4550-95de-8be7a47ddea3" returned: 0 in 0.294s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:43:09 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-52212ec3-3288-48f1-b43f-bb2bb6754341 tempest-ProjectMemberTests-1242181671 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-87ce036a-4a71-4c35-bff6-ed1762e56110.2893ae50-5465-4550-95de-8be7a47ddea3 is being set with open permissions: ugo+rw
Jul 14 16:43:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-52212ec3-3288-48f1-b43f-bb2bb6754341 tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-87ce036a-4a71-4c35-bff6-ed1762e56110.2893ae50-5465-4550-95de-8be7a47ddea3 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:43:09 devstack sudo[106248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-87ce036a-4a71-4c35-bff6-ed1762e56110.2893ae50-5465-4550-95de-8be7a47ddea3
Jul 14 16:43:09 devstack sudo[106248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:43:09 devstack sudo[106238]: pam_unix(sudo:session): session closed for user root
Jul 14 16:43:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0241d117-870e-4c0f-b7fd-31542e256361 tempest-SnapshotDependencyTests-572517903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a2ae62bf-65b8-4128-888b-b9229805e223.a49285db-ffa5-4ad5-866d-2aa6a35ef0b4" returned: 0 in 0.372s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:43:09 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-0241d117-870e-4c0f-b7fd-31542e256361 tempest-SnapshotDependencyTests-572517903 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2ae62bf-65b8-4128-888b-b9229805e223(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 16:43:10 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[85348613-9a8b-4050-bd32-8dc5ad30ac24]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:43:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0241d117-870e-4c0f-b7fd-31542e256361 tempest-SnapshotDependencyTests-572517903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a2ae62bf-65b8-4128-888b-b9229805e223 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:43:10 devstack sudo[106250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a2ae62bf-65b8-4128-888b-b9229805e223
Jul 14 16:43:10 devstack sudo[106250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:43:10 devstack sudo[106248]: pam_unix(sudo:session): session closed for user root
Jul 14 16:43:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-52212ec3-3288-48f1-b43f-bb2bb6754341 tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-87ce036a-4a71-4c35-bff6-ed1762e56110.2893ae50-5465-4550-95de-8be7a47ddea3" returned: 0 in 0.247s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:43:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-52212ec3-3288-48f1-b43f-bb2bb6754341 tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-87ce036a-4a71-4c35-bff6-ed1762e56110.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:43:10 devstack sudo[106253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-87ce036a-4a71-4c35-bff6-ed1762e56110.info
Jul 14 16:43:10 devstack sudo[106253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:43:10 devstack sudo[106250]: pam_unix(sudo:session): session closed for user root
Jul 14 16:43:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0241d117-870e-4c0f-b7fd-31542e256361 tempest-SnapshotDependencyTests-572517903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a2ae62bf-65b8-4128-888b-b9229805e223" returned: 0 in 0.358s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:43:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0241d117-870e-4c0f-b7fd-31542e256361 tempest-SnapshotDependencyTests-572517903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a2ae62bf-65b8-4128-888b-b9229805e223.a49285db-ffa5-4ad5-866d-2aa6a35ef0b4 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:43:10 devstack sudo[106258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a2ae62bf-65b8-4128-888b-b9229805e223.a49285db-ffa5-4ad5-866d-2aa6a35ef0b4
Jul 14 16:43:10 devstack sudo[106258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:43:10 devstack sudo[106253]: pam_unix(sudo:session): session closed for user root
Jul 14 16:43:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-52212ec3-3288-48f1-b43f-bb2bb6754341 tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-87ce036a-4a71-4c35-bff6-ed1762e56110.info" returned: 0 in 0.265s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:43:10 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-52212ec3-3288-48f1-b43f-bb2bb6754341 tempest-ProjectMemberTests-1242181671 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-87ce036a-4a71-4c35-bff6-ed1762e56110.info is being set with open permissions: ugo+rw
Jul 14 16:43:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-52212ec3-3288-48f1-b43f-bb2bb6754341 tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-87ce036a-4a71-4c35-bff6-ed1762e56110.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:43:10 devstack sudo[106261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-87ce036a-4a71-4c35-bff6-ed1762e56110.info
Jul 14 16:43:10 devstack sudo[106261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:43:10 devstack sudo[106258]: pam_unix(sudo:session): session closed for user root
Jul 14 16:43:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0241d117-870e-4c0f-b7fd-31542e256361 tempest-SnapshotDependencyTests-572517903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a2ae62bf-65b8-4128-888b-b9229805e223.a49285db-ffa5-4ad5-866d-2aa6a35ef0b4" returned: 0 in 0.330s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:43:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0241d117-870e-4c0f-b7fd-31542e256361 tempest-SnapshotDependencyTests-572517903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a2ae62bf-65b8-4128-888b-b9229805e223.a49285db-ffa5-4ad5-866d-2aa6a35ef0b4 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:43:10 devstack sudo[106261]: pam_unix(sudo:session): session closed for user root
Jul 14 16:43:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-52212ec3-3288-48f1-b43f-bb2bb6754341 tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-87ce036a-4a71-4c35-bff6-ed1762e56110.info" returned: 0 in 0.250s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:43:10 devstack sudo[106267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a2ae62bf-65b8-4128-888b-b9229805e223.a49285db-ffa5-4ad5-866d-2aa6a35ef0b4
Jul 14 16:43:10 devstack sudo[106267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:43:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-52212ec3-3288-48f1-b43f-bb2bb6754341 tempest-ProjectMemberTests-1242181671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.945s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:43:10 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-52212ec3-3288-48f1-b43f-bb2bb6754341 tempest-ProjectMemberTests-1242181671 None] Create snapshot completed successfully
Jul 14 16:43:10 devstack sudo[106267]: pam_unix(sudo:session): session closed for user root
Jul 14 16:43:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0241d117-870e-4c0f-b7fd-31542e256361 tempest-SnapshotDependencyTests-572517903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a2ae62bf-65b8-4128-888b-b9229805e223.a49285db-ffa5-4ad5-866d-2aa6a35ef0b4" returned: 0 in 0.241s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:43:10 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0241d117-870e-4c0f-b7fd-31542e256361 tempest-SnapshotDependencyTests-572517903 None] Lock "cinder-quobyte-a49285db-ffa5-4ad5-866d-2aa6a35ef0b4" released by "_delete_snapshot" :: held 1.395s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:43:10 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0241d117-870e-4c0f-b7fd-31542e256361 tempest-SnapshotDependencyTests-572517903 None] Lock "cinder-quobyte-a2ae62bf-65b8-4128-888b-b9229805e223" released by "delete_snapshot" :: held 1.415s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:43:11 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-0241d117-870e-4c0f-b7fd-31542e256361 tempest-SnapshotDependencyTests-572517903 None] Created reservations ['9d616904-34fb-4386-8fc4-aaa08a90082b', '7413ae0d-7b89-451e-a9aa-70de8b0b92f2', '75bfce7d-0c2f-4e5a-b691-1fd0650f4e54', '361ceb3a-8546-42f6-a526-7819419fd879'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:43:11 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-0241d117-870e-4c0f-b7fd-31542e256361 tempest-SnapshotDependencyTests-572517903 None] Delete snapshot completed successfully.
Jul 14 16:43:11 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0241d117-870e-4c0f-b7fd-31542e256361 tempest-SnapshotDependencyTests-572517903 None] Lock "cinder-a49285db-ffa5-4ad5-866d-2aa6a35ef0b4-delete_snapshot" released by "delete_snapshot" :: held 1.537s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:43:11 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-596b0109-188c-469c-ae86-416b2bdc536d tempest-ProjectMemberTests-1242181671 None] Acquiring lock "cinder-2893ae50-5465-4550-95de-8be7a47ddea3-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:43:11 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-596b0109-188c-469c-ae86-416b2bdc536d tempest-ProjectMemberTests-1242181671 None] Lock "cinder-2893ae50-5465-4550-95de-8be7a47ddea3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:43:11 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-596b0109-188c-469c-ae86-416b2bdc536d tempest-ProjectMemberTests-1242181671 None] Acquiring lock "cinder-quobyte-87ce036a-4a71-4c35-bff6-ed1762e56110" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:43:11 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-596b0109-188c-469c-ae86-416b2bdc536d tempest-ProjectMemberTests-1242181671 None] Lock "cinder-quobyte-87ce036a-4a71-4c35-bff6-ed1762e56110" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:43:11 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-596b0109-188c-469c-ae86-416b2bdc536d tempest-ProjectMemberTests-1242181671 None] Acquiring lock "cinder-quobyte-2893ae50-5465-4550-95de-8be7a47ddea3" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:43:11 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-596b0109-188c-469c-ae86-416b2bdc536d tempest-ProjectMemberTests-1242181671 None] Lock "cinder-quobyte-2893ae50-5465-4550-95de-8be7a47ddea3" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:43:11 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-596b0109-188c-469c-ae86-416b2bdc536d tempest-ProjectMemberTests-1242181671 None] Deleting offline snapshot 2893ae50-5465-4550-95de-8be7a47ddea3 of volume 87ce036a-4a71-4c35-bff6-ed1762e56110 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 16:43:11 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-596b0109-188c-469c-ae86-416b2bdc536d tempest-ProjectMemberTests-1242181671 None] snapshot_file for this snap is: volume-87ce036a-4a71-4c35-bff6-ed1762e56110.2893ae50-5465-4550-95de-8be7a47ddea3 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 16:43:11 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[b646e959-1580-426a-b8bf-c0968fc4aadb]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:43:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-596b0109-188c-469c-ae86-416b2bdc536d tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-87ce036a-4a71-4c35-bff6-ed1762e56110.2893ae50-5465-4550-95de-8be7a47ddea3 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:43:11 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f9caeec1-b6d8-4158-9a5d-81ce0a9cc47f tempest-SnapshotDependencyTests-572517903 None] Acquiring lock "cinder-a2ae62bf-65b8-4128-888b-b9229805e223-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:43:11 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f9caeec1-b6d8-4158-9a5d-81ce0a9cc47f tempest-SnapshotDependencyTests-572517903 None] Lock "cinder-a2ae62bf-65b8-4128-888b-b9229805e223-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:43:11 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f9caeec1-b6d8-4158-9a5d-81ce0a9cc47f tempest-SnapshotDependencyTests-572517903 None] Acquiring lock "cinder-quobyte-a2ae62bf-65b8-4128-888b-b9229805e223" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:43:11 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f9caeec1-b6d8-4158-9a5d-81ce0a9cc47f tempest-SnapshotDependencyTests-572517903 None] Lock "cinder-quobyte-a2ae62bf-65b8-4128-888b-b9229805e223" acquired by "delete_volume" :: waited 0.017s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:43:11 devstack sudo[106270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-87ce036a-4a71-4c35-bff6-ed1762e56110.2893ae50-5465-4550-95de-8be7a47ddea3
Jul 14 16:43:11 devstack sudo[106270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:43:11 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec6a2d21-757b-4019-aab5-b7ea0db4e81b]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:43:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f9caeec1-b6d8-4158-9a5d-81ce0a9cc47f tempest-SnapshotDependencyTests-572517903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a2ae62bf-65b8-4128-888b-b9229805e223 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:43:11 devstack sudo[106272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a2ae62bf-65b8-4128-888b-b9229805e223
Jul 14 16:43:11 devstack sudo[106272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:43:12 devstack sudo[106270]: pam_unix(sudo:session): session closed for user root
Jul 14 16:43:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-596b0109-188c-469c-ae86-416b2bdc536d tempest-ProjectMemberTests-1242181671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-87ce036a-4a71-4c35-bff6-ed1762e56110.2893ae50-5465-4550-95de-8be7a47ddea3" returned: 0 in 0.362s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:43:12 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-596b0109-188c-469c-ae86-416b2bdc536d tempest-ProjectMemberTests-1242181671 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87ce036a-4a71-4c35-bff6-ed1762e56110(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 16:43:12 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eadc8c7-72e7-4227-9da4-90a3c1ee696b]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:43:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-596b0109-188c-469c-ae86-416b2bdc536d tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-87ce036a-4a71-4c35-bff6-ed1762e56110 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:43:12 devstack sudo[106272]: pam_unix(sudo:session): session closed for user root
Jul 14 16:43:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f9caeec1-b6d8-4158-9a5d-81ce0a9cc47f tempest-SnapshotDependencyTests-572517903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a2ae62bf-65b8-4128-888b-b9229805e223" returned: 0 in 0.361s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:43:12 devstack sudo[106277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-87ce036a-4a71-4c35-bff6-ed1762e56110
Jul 14 16:43:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f9caeec1-b6d8-4158-9a5d-81ce0a9cc47f tempest-SnapshotDependencyTests-572517903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a2ae62bf-65b8-4128-888b-b9229805e223 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:43:12 devstack sudo[106277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:43:12 devstack sudo[106282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a2ae62bf-65b8-4128-888b-b9229805e223
Jul 14 16:43:12 devstack sudo[106282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:43:12 devstack sudo[106277]: pam_unix(sudo:session): session closed for user root
Jul 14 16:43:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-596b0109-188c-469c-ae86-416b2bdc536d tempest-ProjectMemberTests-1242181671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-87ce036a-4a71-4c35-bff6-ed1762e56110" returned: 0 in 0.358s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:43:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-596b0109-188c-469c-ae86-416b2bdc536d tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-87ce036a-4a71-4c35-bff6-ed1762e56110.2893ae50-5465-4550-95de-8be7a47ddea3 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:43:12 devstack sudo[106282]: pam_unix(sudo:session): session closed for user root
Jul 14 16:43:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f9caeec1-b6d8-4158-9a5d-81ce0a9cc47f tempest-SnapshotDependencyTests-572517903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-a2ae62bf-65b8-4128-888b-b9229805e223" returned: 0 in 0.267s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:43:12 devstack sudo[106288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-87ce036a-4a71-4c35-bff6-ed1762e56110.2893ae50-5465-4550-95de-8be7a47ddea3
Jul 14 16:43:12 devstack sudo[106288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:43:12 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f9caeec1-b6d8-4158-9a5d-81ce0a9cc47f tempest-SnapshotDependencyTests-572517903 None] Lock "cinder-quobyte-a2ae62bf-65b8-4128-888b-b9229805e223" released by "delete_volume" :: held 0.689s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:43:12 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-f9caeec1-b6d8-4158-9a5d-81ce0a9cc47f tempest-SnapshotDependencyTests-572517903 None] Created reservations ['ec33e911-362c-4a7b-beb8-c73865ab86c0', '6e9943cd-d38a-461d-a5cd-1dd9ecb38c6c', 'b291fed7-e25f-4ea0-be0d-489b3d91d738', '00e40f6b-6623-4d8b-b126-5f819833db77'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:43:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f9caeec1-b6d8-4158-9a5d-81ce0a9cc47f tempest-SnapshotDependencyTests-572517903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:43:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f9caeec1-b6d8-4158-9a5d-81ce0a9cc47f tempest-SnapshotDependencyTests-572517903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:43:12 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f9caeec1-b6d8-4158-9a5d-81ce0a9cc47f tempest-SnapshotDependencyTests-572517903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:43:12 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f9caeec1-b6d8-4158-9a5d-81ce0a9cc47f tempest-SnapshotDependencyTests-572517903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:43:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f9caeec1-b6d8-4158-9a5d-81ce0a9cc47f tempest-SnapshotDependencyTests-572517903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:43:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f9caeec1-b6d8-4158-9a5d-81ce0a9cc47f tempest-SnapshotDependencyTests-572517903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:43:12 devstack sudo[106296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:43:12 devstack sudo[106296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:43:12 devstack sudo[106288]: pam_unix(sudo:session): session closed for user root
Jul 14 16:43:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-596b0109-188c-469c-ae86-416b2bdc536d tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-87ce036a-4a71-4c35-bff6-ed1762e56110.2893ae50-5465-4550-95de-8be7a47ddea3" returned: 0 in 0.360s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:43:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-596b0109-188c-469c-ae86-416b2bdc536d tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-87ce036a-4a71-4c35-bff6-ed1762e56110.2893ae50-5465-4550-95de-8be7a47ddea3 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:43:12 devstack sudo[106302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-87ce036a-4a71-4c35-bff6-ed1762e56110.2893ae50-5465-4550-95de-8be7a47ddea3
Jul 14 16:43:12 devstack sudo[106302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:43:12 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-dd6279e8-d21d-4ed2-a6ad-8d989a943952 tempest-SnapshotDependencyTests-572517903 None] Acquiring lock "cinder-50843e78-4f4a-4b26-be59-79a93650656a-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:43:12 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-dd6279e8-d21d-4ed2-a6ad-8d989a943952 tempest-SnapshotDependencyTests-572517903 None] Lock "cinder-50843e78-4f4a-4b26-be59-79a93650656a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:43:12 devstack sudo[106296]: pam_unix(sudo:session): session closed for user root
Jul 14 16:43:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f9caeec1-b6d8-4158-9a5d-81ce0a9cc47f tempest-SnapshotDependencyTests-572517903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.290s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:43:12 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-f9caeec1-b6d8-4158-9a5d-81ce0a9cc47f tempest-SnapshotDependencyTests-572517903 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:43:12 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-f9caeec1-b6d8-4158-9a5d-81ce0a9cc47f tempest-SnapshotDependencyTests-572517903 None] Deleted volume successfully.
Jul 14 16:43:12 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-dd6279e8-d21d-4ed2-a6ad-8d989a943952 tempest-SnapshotDependencyTests-572517903 None] Acquiring lock "cinder-quobyte-50843e78-4f4a-4b26-be59-79a93650656a" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:43:12 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f9caeec1-b6d8-4158-9a5d-81ce0a9cc47f tempest-SnapshotDependencyTests-572517903 None] Lock "cinder-a2ae62bf-65b8-4128-888b-b9229805e223-delete_volume" released by "delete_volume" :: held 1.221s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:43:12 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-dd6279e8-d21d-4ed2-a6ad-8d989a943952 tempest-SnapshotDependencyTests-572517903 None] Lock "cinder-quobyte-50843e78-4f4a-4b26-be59-79a93650656a" acquired by "delete_volume" :: waited 0.017s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:43:13 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[237b59ee-a6c4-4c5a-946f-ff968b9b76a7]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:43:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-dd6279e8-d21d-4ed2-a6ad-8d989a943952 tempest-SnapshotDependencyTests-572517903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-50843e78-4f4a-4b26-be59-79a93650656a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:43:13 devstack sudo[106302]: pam_unix(sudo:session): session closed for user root
Jul 14 16:43:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-596b0109-188c-469c-ae86-416b2bdc536d tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-87ce036a-4a71-4c35-bff6-ed1762e56110.2893ae50-5465-4550-95de-8be7a47ddea3" returned: 0 in 0.293s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:43:13 devstack sudo[106305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-50843e78-4f4a-4b26-be59-79a93650656a
Jul 14 16:43:13 devstack sudo[106305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:43:13 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-596b0109-188c-469c-ae86-416b2bdc536d tempest-ProjectMemberTests-1242181671 None] Lock "cinder-quobyte-2893ae50-5465-4550-95de-8be7a47ddea3" released by "_delete_snapshot" :: held 1.497s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:43:13 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-596b0109-188c-469c-ae86-416b2bdc536d tempest-ProjectMemberTests-1242181671 None] Lock "cinder-quobyte-87ce036a-4a71-4c35-bff6-ed1762e56110" released by "delete_snapshot" :: held 1.523s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:43:13 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-596b0109-188c-469c-ae86-416b2bdc536d tempest-ProjectMemberTests-1242181671 None] Created reservations ['94358409-a2b2-4365-a4f5-ee3828003bd7', '23a2c812-f9a2-4965-9e18-91662360604c', '0b6dae67-42a5-4e17-b6d3-85ff2c34d177', '6142aff7-18d9-4874-ac4b-348bee01ece4'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:43:13 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-596b0109-188c-469c-ae86-416b2bdc536d tempest-ProjectMemberTests-1242181671 None] Delete snapshot completed successfully.
Jul 14 16:43:13 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-596b0109-188c-469c-ae86-416b2bdc536d tempest-ProjectMemberTests-1242181671 None] Lock "cinder-2893ae50-5465-4550-95de-8be7a47ddea3-delete_snapshot" released by "delete_snapshot" :: held 1.690s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:43:13 devstack sudo[106305]: pam_unix(sudo:session): session closed for user root
Jul 14 16:43:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-dd6279e8-d21d-4ed2-a6ad-8d989a943952 tempest-SnapshotDependencyTests-572517903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-50843e78-4f4a-4b26-be59-79a93650656a" returned: 0 in 0.382s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:43:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-dd6279e8-d21d-4ed2-a6ad-8d989a943952 tempest-SnapshotDependencyTests-572517903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-50843e78-4f4a-4b26-be59-79a93650656a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:43:13 devstack sudo[106312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-50843e78-4f4a-4b26-be59-79a93650656a
Jul 14 16:43:13 devstack sudo[106312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:43:13 devstack sudo[106312]: pam_unix(sudo:session): session closed for user root
Jul 14 16:43:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-dd6279e8-d21d-4ed2-a6ad-8d989a943952 tempest-SnapshotDependencyTests-572517903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-50843e78-4f4a-4b26-be59-79a93650656a" returned: 0 in 0.251s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:43:13 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-dd6279e8-d21d-4ed2-a6ad-8d989a943952 tempest-SnapshotDependencyTests-572517903 None] Lock "cinder-quobyte-50843e78-4f4a-4b26-be59-79a93650656a" released by "delete_volume" :: held 0.685s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:43:13 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-dd6279e8-d21d-4ed2-a6ad-8d989a943952 tempest-SnapshotDependencyTests-572517903 None] Created reservations ['78fb02e7-0a5e-4ec1-bb42-e77e0795fbac', '3adb3394-2e6c-4aae-8e8b-774493b84151', '3862a100-015a-436c-9e08-367ee365343e', '60251fd2-a9b5-42e6-97f8-bb97743a8af9'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:43:13 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c30c79c4-fb70-4cf3-a84a-1606743932e1 tempest-ProjectMemberTests-1242181671 None] Acquiring lock "cinder-87ce036a-4a71-4c35-bff6-ed1762e56110-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:43:13 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c30c79c4-fb70-4cf3-a84a-1606743932e1 tempest-ProjectMemberTests-1242181671 None] Lock "cinder-87ce036a-4a71-4c35-bff6-ed1762e56110-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:43:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-dd6279e8-d21d-4ed2-a6ad-8d989a943952 tempest-SnapshotDependencyTests-572517903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:43:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-dd6279e8-d21d-4ed2-a6ad-8d989a943952 tempest-SnapshotDependencyTests-572517903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:43:13 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-dd6279e8-d21d-4ed2-a6ad-8d989a943952 tempest-SnapshotDependencyTests-572517903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:43:13 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-dd6279e8-d21d-4ed2-a6ad-8d989a943952 tempest-SnapshotDependencyTests-572517903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:43:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-dd6279e8-d21d-4ed2-a6ad-8d989a943952 tempest-SnapshotDependencyTests-572517903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:43:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-dd6279e8-d21d-4ed2-a6ad-8d989a943952 tempest-SnapshotDependencyTests-572517903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:43:13 devstack sudo[106315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:43:13 devstack sudo[106315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:43:13 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c30c79c4-fb70-4cf3-a84a-1606743932e1 tempest-ProjectMemberTests-1242181671 None] Acquiring lock "cinder-quobyte-87ce036a-4a71-4c35-bff6-ed1762e56110" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:43:13 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c30c79c4-fb70-4cf3-a84a-1606743932e1 tempest-ProjectMemberTests-1242181671 None] Lock "cinder-quobyte-87ce036a-4a71-4c35-bff6-ed1762e56110" acquired by "delete_volume" :: waited 0.015s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:43:13 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb45d2f-e6ef-4db1-9fbc-5910631f4324]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:43:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c30c79c4-fb70-4cf3-a84a-1606743932e1 tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-87ce036a-4a71-4c35-bff6-ed1762e56110 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:43:14 devstack sudo[106317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-87ce036a-4a71-4c35-bff6-ed1762e56110
Jul 14 16:43:14 devstack sudo[106317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:43:14 devstack sudo[106315]: pam_unix(sudo:session): session closed for user root
Jul 14 16:43:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-dd6279e8-d21d-4ed2-a6ad-8d989a943952 tempest-SnapshotDependencyTests-572517903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.265s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:43:14 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-dd6279e8-d21d-4ed2-a6ad-8d989a943952 tempest-SnapshotDependencyTests-572517903 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:43:14 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-dd6279e8-d21d-4ed2-a6ad-8d989a943952 tempest-SnapshotDependencyTests-572517903 None] Deleted volume successfully.
Jul 14 16:43:14 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-dd6279e8-d21d-4ed2-a6ad-8d989a943952 tempest-SnapshotDependencyTests-572517903 None] Lock "cinder-50843e78-4f4a-4b26-be59-79a93650656a-delete_volume" released by "delete_volume" :: held 1.218s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:43:14 devstack sudo[106317]: pam_unix(sudo:session): session closed for user root
Jul 14 16:43:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c30c79c4-fb70-4cf3-a84a-1606743932e1 tempest-ProjectMemberTests-1242181671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-87ce036a-4a71-4c35-bff6-ed1762e56110" returned: 0 in 0.384s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:43:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c30c79c4-fb70-4cf3-a84a-1606743932e1 tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-87ce036a-4a71-4c35-bff6-ed1762e56110 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:43:14 devstack sudo[106323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-87ce036a-4a71-4c35-bff6-ed1762e56110
Jul 14 16:43:14 devstack sudo[106323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:43:14 devstack sudo[106323]: pam_unix(sudo:session): session closed for user root
Jul 14 16:43:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c30c79c4-fb70-4cf3-a84a-1606743932e1 tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-87ce036a-4a71-4c35-bff6-ed1762e56110" returned: 0 in 0.266s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:43:14 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c30c79c4-fb70-4cf3-a84a-1606743932e1 tempest-ProjectMemberTests-1242181671 None] Lock "cinder-quobyte-87ce036a-4a71-4c35-bff6-ed1762e56110" released by "delete_volume" :: held 0.705s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:43:14 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-c30c79c4-fb70-4cf3-a84a-1606743932e1 tempest-ProjectMemberTests-1242181671 None] Created reservations ['7503944d-4e51-45e5-808d-4cf0103dd33c', '00d80476-7bc4-445c-a6f1-0f59e82c47d7', 'a26e5e36-3142-45a8-941f-da0dbb59797d', '00ed4cad-05df-4f05-87eb-f9d3ab988a4a'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:43:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c30c79c4-fb70-4cf3-a84a-1606743932e1 tempest-ProjectMemberTests-1242181671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:43:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c30c79c4-fb70-4cf3-a84a-1606743932e1 tempest-ProjectMemberTests-1242181671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:43:14 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-c30c79c4-fb70-4cf3-a84a-1606743932e1 tempest-ProjectMemberTests-1242181671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:43:14 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-c30c79c4-fb70-4cf3-a84a-1606743932e1 tempest-ProjectMemberTests-1242181671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:43:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c30c79c4-fb70-4cf3-a84a-1606743932e1 tempest-ProjectMemberTests-1242181671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:43:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c30c79c4-fb70-4cf3-a84a-1606743932e1 tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:43:14 devstack sudo[106326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:43:14 devstack sudo[106326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:43:15 devstack sudo[106326]: pam_unix(sudo:session): session closed for user root
Jul 14 16:43:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c30c79c4-fb70-4cf3-a84a-1606743932e1 tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.283s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:43:15 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-c30c79c4-fb70-4cf3-a84a-1606743932e1 tempest-ProjectMemberTests-1242181671 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:43:15 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-c30c79c4-fb70-4cf3-a84a-1606743932e1 tempest-ProjectMemberTests-1242181671 None] Deleted volume successfully.
Jul 14 16:43:15 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c30c79c4-fb70-4cf3-a84a-1606743932e1 tempest-ProjectMemberTests-1242181671 None] Lock "cinder-87ce036a-4a71-4c35-bff6-ed1762e56110-delete_volume" released by "delete_volume" :: held 1.255s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:43:15 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee595762-4b98-4db3-bdfc-d8aefd96082b tempest-ProjectMemberTests-1242181671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:43:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ee595762-4b98-4db3-bdfc-d8aefd96082b tempest-ProjectMemberTests-1242181671 None] Flow 'volume_create_manager' (37bcc818-7ccf-4bfc-be48-08a1a91838e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:43:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ee595762-4b98-4db3-bdfc-d8aefd96082b tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1887f58-1e90-4ce2-83f7-ab5925e1455d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:43:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ee595762-4b98-4db3-bdfc-d8aefd96082b tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1887f58-1e90-4ce2-83f7-ab5925e1455d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:43:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1568320214',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca0303de-360b-459f-b178-3907439eef8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dfc230bd6d54b87b4b187751f9a7039',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:43:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:43:15Z,use_quota=True,user_id='68f1fe3510e3473e91988f26916b8e51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:43:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ee595762-4b98-4db3-bdfc-d8aefd96082b tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2a1b424-f53d-45bd-9af1-121d6dc18b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:43:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ee595762-4b98-4db3-bdfc-d8aefd96082b tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2a1b424-f53d-45bd-9af1-121d6dc18b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:43:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ee595762-4b98-4db3-bdfc-d8aefd96082b tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d634a368-dbd0-4748-84d2-fff9f4c51fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:43:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ee595762-4b98-4db3-bdfc-d8aefd96082b tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d634a368-dbd0-4748-84d2-fff9f4c51fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca0303de-360b-459f-b178-3907439eef8d', 'volume_name': 'volume-ca0303de-360b-459f-b178-3907439eef8d', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:43:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ee595762-4b98-4db3-bdfc-d8aefd96082b tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06270f7f-293b-4870-8605-de496b9f73d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:43:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ee595762-4b98-4db3-bdfc-d8aefd96082b tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06270f7f-293b-4870-8605-de496b9f73d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:43:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ee595762-4b98-4db3-bdfc-d8aefd96082b tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00602d68-8bab-4f65-b64f-e3c08b46bae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:43:15 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-ee595762-4b98-4db3-bdfc-d8aefd96082b tempest-ProjectMemberTests-1242181671 None] Volume ca0303de-360b-459f-b178-3907439eef8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca0303de-360b-459f-b178-3907439eef8d', 'volume_size': 1}
Jul 14 16:43:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ee595762-4b98-4db3-bdfc-d8aefd96082b tempest-ProjectMemberTests-1242181671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:43:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ee595762-4b98-4db3-bdfc-d8aefd96082b tempest-ProjectMemberTests-1242181671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:43:15 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ee595762-4b98-4db3-bdfc-d8aefd96082b tempest-ProjectMemberTests-1242181671 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:43:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1568320214',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca0303de-360b-459f-b178-3907439eef8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dfc230bd6d54b87b4b187751f9a7039',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:43:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:43:15Z,use_quota=True,user_id='68f1fe3510e3473e91988f26916b8e51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:43:15 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-ee595762-4b98-4db3-bdfc-d8aefd96082b tempest-ProjectMemberTests-1242181671 None] Creating volume ca0303de-360b-459f-b178-3907439eef8d {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:43:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ee595762-4b98-4db3-bdfc-d8aefd96082b tempest-ProjectMemberTests-1242181671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:43:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ee595762-4b98-4db3-bdfc-d8aefd96082b tempest-ProjectMemberTests-1242181671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:43:15 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ee595762-4b98-4db3-bdfc-d8aefd96082b tempest-ProjectMemberTests-1242181671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:43:15 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ee595762-4b98-4db3-bdfc-d8aefd96082b tempest-ProjectMemberTests-1242181671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:43:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ee595762-4b98-4db3-bdfc-d8aefd96082b tempest-ProjectMemberTests-1242181671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:43:15 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ee595762-4b98-4db3-bdfc-d8aefd96082b tempest-ProjectMemberTests-1242181671 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:43:15 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-ee595762-4b98-4db3-bdfc-d8aefd96082b tempest-ProjectMemberTests-1242181671 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:43:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ee595762-4b98-4db3-bdfc-d8aefd96082b tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ca0303de-360b-459f-b178-3907439eef8d 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:43:15 devstack sudo[106330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ca0303de-360b-459f-b178-3907439eef8d 1073741824
Jul 14 16:43:15 devstack sudo[106330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:43:16 devstack sudo[106330]: pam_unix(sudo:session): session closed for user root
Jul 14 16:43:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ee595762-4b98-4db3-bdfc-d8aefd96082b tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ca0303de-360b-459f-b178-3907439eef8d 1073741824" returned: 0 in 0.457s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:43:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ee595762-4b98-4db3-bdfc-d8aefd96082b tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ca0303de-360b-459f-b178-3907439eef8d {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:43:16 devstack sudo[106335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ca0303de-360b-459f-b178-3907439eef8d
Jul 14 16:43:16 devstack sudo[106335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:43:16 devstack sudo[106335]: pam_unix(sudo:session): session closed for user root
Jul 14 16:43:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ee595762-4b98-4db3-bdfc-d8aefd96082b tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ca0303de-360b-459f-b178-3907439eef8d" returned: 0 in 0.249s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:43:16 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ee595762-4b98-4db3-bdfc-d8aefd96082b tempest-ProjectMemberTests-1242181671 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:43:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ee595762-4b98-4db3-bdfc-d8aefd96082b tempest-ProjectMemberTests-1242181671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:43:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ee595762-4b98-4db3-bdfc-d8aefd96082b tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00602d68-8bab-4f65-b64f-e3c08b46bae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca0303de-360b-459f-b178-3907439eef8d', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:43:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ee595762-4b98-4db3-bdfc-d8aefd96082b tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dee6418d-1483-48d2-9c3f-7b9de59be7e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:43:16 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-ee595762-4b98-4db3-bdfc-d8aefd96082b tempest-ProjectMemberTests-1242181671 None] Volume volume-ca0303de-360b-459f-b178-3907439eef8d (ca0303de-360b-459f-b178-3907439eef8d): created successfully
Jul 14 16:43:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ee595762-4b98-4db3-bdfc-d8aefd96082b tempest-ProjectMemberTests-1242181671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dee6418d-1483-48d2-9c3f-7b9de59be7e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:43:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ee595762-4b98-4db3-bdfc-d8aefd96082b tempest-ProjectMemberTests-1242181671 None] Flow 'volume_create_manager' (37bcc818-7ccf-4bfc-be48-08a1a91838e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:43:16 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-ee595762-4b98-4db3-bdfc-d8aefd96082b tempest-ProjectMemberTests-1242181671 None] Created volume successfully.
Jul 14 16:43:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-56822004-d819-4b3a-8b21-c8fee353c2a8 tempest-ProjectMemberTests-1242181671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:43:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-56822004-d819-4b3a-8b21-c8fee353c2a8 tempest-ProjectMemberTests-1242181671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:43:16 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-56822004-d819-4b3a-8b21-c8fee353c2a8 tempest-ProjectMemberTests-1242181671 None] Creating offline snapshot 25bbf50d-9c91-4264-8b77-6b826d99bd74 of volume ca0303de-360b-459f-b178-3907439eef8d {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 14 16:43:16 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[9357d45f-4354-4a80-941c-776a61e72c79]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:43:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-56822004-d819-4b3a-8b21-c8fee353c2a8 tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ca0303de-360b-459f-b178-3907439eef8d {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:43:16 devstack sudo[106338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ca0303de-360b-459f-b178-3907439eef8d
Jul 14 16:43:16 devstack sudo[106338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:43:17 devstack sudo[106338]: pam_unix(sudo:session): session closed for user root
Jul 14 16:43:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-56822004-d819-4b3a-8b21-c8fee353c2a8 tempest-ProjectMemberTests-1242181671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ca0303de-360b-459f-b178-3907439eef8d" returned: 0 in 0.477s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:43:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-56822004-d819-4b3a-8b21-c8fee353c2a8 tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ca0303de-360b-459f-b178-3907439eef8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ca0303de-360b-459f-b178-3907439eef8d.25bbf50d-9c91-4264-8b77-6b826d99bd74 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:43:17 devstack sudo[106343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ca0303de-360b-459f-b178-3907439eef8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ca0303de-360b-459f-b178-3907439eef8d.25bbf50d-9c91-4264-8b77-6b826d99bd74 1G
Jul 14 16:43:17 devstack sudo[106343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:43:17 devstack sudo[106343]: pam_unix(sudo:session): session closed for user root
Jul 14 16:43:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-56822004-d819-4b3a-8b21-c8fee353c2a8 tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ca0303de-360b-459f-b178-3907439eef8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ca0303de-360b-459f-b178-3907439eef8d.25bbf50d-9c91-4264-8b77-6b826d99bd74 1G" returned: 0 in 0.484s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:43:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-56822004-d819-4b3a-8b21-c8fee353c2a8 tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca0303de-360b-459f-b178-3907439eef8d -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ca0303de-360b-459f-b178-3907439eef8d.25bbf50d-9c91-4264-8b77-6b826d99bd74 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:43:17 devstack sudo[106350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca0303de-360b-459f-b178-3907439eef8d -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ca0303de-360b-459f-b178-3907439eef8d.25bbf50d-9c91-4264-8b77-6b826d99bd74
Jul 14 16:43:17 devstack sudo[106350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:43:17 devstack sudo[106350]: pam_unix(sudo:session): session closed for user root
Jul 14 16:43:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-56822004-d819-4b3a-8b21-c8fee353c2a8 tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca0303de-360b-459f-b178-3907439eef8d -F qcow2 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ca0303de-360b-459f-b178-3907439eef8d.25bbf50d-9c91-4264-8b77-6b826d99bd74" returned: 0 in 0.312s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:43:17 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-56822004-d819-4b3a-8b21-c8fee353c2a8 tempest-ProjectMemberTests-1242181671 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ca0303de-360b-459f-b178-3907439eef8d.25bbf50d-9c91-4264-8b77-6b826d99bd74 is being set with open permissions: ugo+rw
Jul 14 16:43:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-56822004-d819-4b3a-8b21-c8fee353c2a8 tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ca0303de-360b-459f-b178-3907439eef8d.25bbf50d-9c91-4264-8b77-6b826d99bd74 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:43:17 devstack sudo[106355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ca0303de-360b-459f-b178-3907439eef8d.25bbf50d-9c91-4264-8b77-6b826d99bd74
Jul 14 16:43:17 devstack sudo[106355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:43:18 devstack sudo[106355]: pam_unix(sudo:session): session closed for user root
Jul 14 16:43:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-56822004-d819-4b3a-8b21-c8fee353c2a8 tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ca0303de-360b-459f-b178-3907439eef8d.25bbf50d-9c91-4264-8b77-6b826d99bd74" returned: 0 in 0.267s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:43:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-56822004-d819-4b3a-8b21-c8fee353c2a8 tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ca0303de-360b-459f-b178-3907439eef8d.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:43:18 devstack sudo[106358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ca0303de-360b-459f-b178-3907439eef8d.info
Jul 14 16:43:18 devstack sudo[106358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:43:18 devstack sudo[106358]: pam_unix(sudo:session): session closed for user root
Jul 14 16:43:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-56822004-d819-4b3a-8b21-c8fee353c2a8 tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ca0303de-360b-459f-b178-3907439eef8d.info" returned: 0 in 0.265s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:43:18 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-56822004-d819-4b3a-8b21-c8fee353c2a8 tempest-ProjectMemberTests-1242181671 None] /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ca0303de-360b-459f-b178-3907439eef8d.info is being set with open permissions: ugo+rw
Jul 14 16:43:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-56822004-d819-4b3a-8b21-c8fee353c2a8 tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ca0303de-360b-459f-b178-3907439eef8d.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:43:18 devstack sudo[106361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ca0303de-360b-459f-b178-3907439eef8d.info
Jul 14 16:43:18 devstack sudo[106361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:43:18 devstack sudo[106361]: pam_unix(sudo:session): session closed for user root
Jul 14 16:43:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-56822004-d819-4b3a-8b21-c8fee353c2a8 tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ca0303de-360b-459f-b178-3907439eef8d.info" returned: 0 in 0.261s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:43:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-56822004-d819-4b3a-8b21-c8fee353c2a8 tempest-ProjectMemberTests-1242181671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.159s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:43:18 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-56822004-d819-4b3a-8b21-c8fee353c2a8 tempest-ProjectMemberTests-1242181671 None] Create snapshot completed successfully
Jul 14 16:43:19 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-dc2b6366-2d92-43cf-8039-941e1adcacae tempest-ProjectMemberTests-1242181671 None] Acquiring lock "cinder-25bbf50d-9c91-4264-8b77-6b826d99bd74-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:43:19 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-dc2b6366-2d92-43cf-8039-941e1adcacae tempest-ProjectMemberTests-1242181671 None] Lock "cinder-25bbf50d-9c91-4264-8b77-6b826d99bd74-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:43:19 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-dc2b6366-2d92-43cf-8039-941e1adcacae tempest-ProjectMemberTests-1242181671 None] Acquiring lock "cinder-quobyte-ca0303de-360b-459f-b178-3907439eef8d" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:43:20 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-dc2b6366-2d92-43cf-8039-941e1adcacae tempest-ProjectMemberTests-1242181671 None] Lock "cinder-quobyte-ca0303de-360b-459f-b178-3907439eef8d" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:43:20 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-dc2b6366-2d92-43cf-8039-941e1adcacae tempest-ProjectMemberTests-1242181671 None] Acquiring lock "cinder-quobyte-25bbf50d-9c91-4264-8b77-6b826d99bd74" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:43:20 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-dc2b6366-2d92-43cf-8039-941e1adcacae tempest-ProjectMemberTests-1242181671 None] Lock "cinder-quobyte-25bbf50d-9c91-4264-8b77-6b826d99bd74" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:43:20 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-dc2b6366-2d92-43cf-8039-941e1adcacae tempest-ProjectMemberTests-1242181671 None] Deleting offline snapshot 25bbf50d-9c91-4264-8b77-6b826d99bd74 of volume ca0303de-360b-459f-b178-3907439eef8d {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 14 16:43:20 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-dc2b6366-2d92-43cf-8039-941e1adcacae tempest-ProjectMemberTests-1242181671 None] snapshot_file for this snap is: volume-ca0303de-360b-459f-b178-3907439eef8d.25bbf50d-9c91-4264-8b77-6b826d99bd74 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 14 16:43:20 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[134495b1-cf82-4c28-b81e-0d1e5aadc87d]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:43:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-dc2b6366-2d92-43cf-8039-941e1adcacae tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ca0303de-360b-459f-b178-3907439eef8d.25bbf50d-9c91-4264-8b77-6b826d99bd74 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:43:20 devstack sudo[106366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ca0303de-360b-459f-b178-3907439eef8d.25bbf50d-9c91-4264-8b77-6b826d99bd74
Jul 14 16:43:20 devstack sudo[106366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:43:20 devstack sudo[106366]: pam_unix(sudo:session): session closed for user root
Jul 14 16:43:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-dc2b6366-2d92-43cf-8039-941e1adcacae tempest-ProjectMemberTests-1242181671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ca0303de-360b-459f-b178-3907439eef8d.25bbf50d-9c91-4264-8b77-6b826d99bd74" returned: 0 in 0.425s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:43:20 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-dc2b6366-2d92-43cf-8039-941e1adcacae tempest-ProjectMemberTests-1242181671 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ca0303de-360b-459f-b178-3907439eef8d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 14 16:43:20 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab269451-1436-430d-aec3-2337bd33b4b5]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:43:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-dc2b6366-2d92-43cf-8039-941e1adcacae tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ca0303de-360b-459f-b178-3907439eef8d {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:43:20 devstack sudo[106371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ca0303de-360b-459f-b178-3907439eef8d
Jul 14 16:43:20 devstack sudo[106371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:43:20 devstack sudo[106371]: pam_unix(sudo:session): session closed for user root
Jul 14 16:43:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-dc2b6366-2d92-43cf-8039-941e1adcacae tempest-ProjectMemberTests-1242181671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ca0303de-360b-459f-b178-3907439eef8d" returned: 0 in 0.402s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:43:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-dc2b6366-2d92-43cf-8039-941e1adcacae tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ca0303de-360b-459f-b178-3907439eef8d.25bbf50d-9c91-4264-8b77-6b826d99bd74 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:43:20 devstack sudo[106376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ca0303de-360b-459f-b178-3907439eef8d.25bbf50d-9c91-4264-8b77-6b826d99bd74
Jul 14 16:43:20 devstack sudo[106376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:43:21 devstack sudo[106376]: pam_unix(sudo:session): session closed for user root
Jul 14 16:43:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-dc2b6366-2d92-43cf-8039-941e1adcacae tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ca0303de-360b-459f-b178-3907439eef8d.25bbf50d-9c91-4264-8b77-6b826d99bd74" returned: 0 in 0.401s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:43:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-dc2b6366-2d92-43cf-8039-941e1adcacae tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ca0303de-360b-459f-b178-3907439eef8d.25bbf50d-9c91-4264-8b77-6b826d99bd74 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:43:21 devstack sudo[106383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ca0303de-360b-459f-b178-3907439eef8d.25bbf50d-9c91-4264-8b77-6b826d99bd74
Jul 14 16:43:21 devstack sudo[106383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:43:21 devstack sudo[106383]: pam_unix(sudo:session): session closed for user root
Jul 14 16:43:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-dc2b6366-2d92-43cf-8039-941e1adcacae tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ca0303de-360b-459f-b178-3907439eef8d.25bbf50d-9c91-4264-8b77-6b826d99bd74" returned: 0 in 0.270s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:43:21 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-dc2b6366-2d92-43cf-8039-941e1adcacae tempest-ProjectMemberTests-1242181671 None] Lock "cinder-quobyte-25bbf50d-9c91-4264-8b77-6b826d99bd74" released by "_delete_snapshot" :: held 1.613s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:43:21 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-dc2b6366-2d92-43cf-8039-941e1adcacae tempest-ProjectMemberTests-1242181671 None] Lock "cinder-quobyte-ca0303de-360b-459f-b178-3907439eef8d" released by "delete_snapshot" :: held 1.640s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:43:21 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-dc2b6366-2d92-43cf-8039-941e1adcacae tempest-ProjectMemberTests-1242181671 None] Created reservations ['2f7869d7-0431-415b-aa84-85324c768cbb', 'fdd08c7b-7c04-4df0-a854-806a584a3899', 'd6546c9a-81a1-4c30-8b26-7eb3c801b3ee', 'b6590ba2-4acf-405f-87d1-4ec07f69e829'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:43:21 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-dc2b6366-2d92-43cf-8039-941e1adcacae tempest-ProjectMemberTests-1242181671 None] Delete snapshot completed successfully.
Jul 14 16:43:21 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-dc2b6366-2d92-43cf-8039-941e1adcacae tempest-ProjectMemberTests-1242181671 None] Lock "cinder-25bbf50d-9c91-4264-8b77-6b826d99bd74-delete_snapshot" released by "delete_snapshot" :: held 1.795s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:43:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-acaa0c42-97ac-44ee-86ef-d79f04f57275 tempest-ProjectMemberTests-1242181671 None] Acquiring lock "cinder-ca0303de-360b-459f-b178-3907439eef8d-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:43:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-acaa0c42-97ac-44ee-86ef-d79f04f57275 tempest-ProjectMemberTests-1242181671 None] Lock "cinder-ca0303de-360b-459f-b178-3907439eef8d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:43:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-acaa0c42-97ac-44ee-86ef-d79f04f57275 tempest-ProjectMemberTests-1242181671 None] Acquiring lock "cinder-quobyte-ca0303de-360b-459f-b178-3907439eef8d" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:43:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-acaa0c42-97ac-44ee-86ef-d79f04f57275 tempest-ProjectMemberTests-1242181671 None] Lock "cinder-quobyte-ca0303de-360b-459f-b178-3907439eef8d" acquired by "delete_volume" :: waited 0.015s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:43:22 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b8fa12-d95e-4bfa-9f3b-33c03e0a2c08]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:43:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-acaa0c42-97ac-44ee-86ef-d79f04f57275 tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ca0303de-360b-459f-b178-3907439eef8d {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:43:22 devstack sudo[106386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ca0303de-360b-459f-b178-3907439eef8d
Jul 14 16:43:22 devstack sudo[106386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:43:22 devstack sudo[106386]: pam_unix(sudo:session): session closed for user root
Jul 14 16:43:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-acaa0c42-97ac-44ee-86ef-d79f04f57275 tempest-ProjectMemberTests-1242181671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ca0303de-360b-459f-b178-3907439eef8d" returned: 0 in 0.374s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:43:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-acaa0c42-97ac-44ee-86ef-d79f04f57275 tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ca0303de-360b-459f-b178-3907439eef8d {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:43:22 devstack sudo[106391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ca0303de-360b-459f-b178-3907439eef8d
Jul 14 16:43:22 devstack sudo[106391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:43:22 devstack sudo[106391]: pam_unix(sudo:session): session closed for user root
Jul 14 16:43:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-acaa0c42-97ac-44ee-86ef-d79f04f57275 tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-ca0303de-360b-459f-b178-3907439eef8d" returned: 0 in 0.259s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:43:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-acaa0c42-97ac-44ee-86ef-d79f04f57275 tempest-ProjectMemberTests-1242181671 None] Lock "cinder-quobyte-ca0303de-360b-459f-b178-3907439eef8d" released by "delete_volume" :: held 0.699s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:43:23 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-acaa0c42-97ac-44ee-86ef-d79f04f57275 tempest-ProjectMemberTests-1242181671 None] Created reservations ['e14c63ab-a03c-416b-8c3f-7355f1f1154c', 'd7b5d58d-f137-49fe-82de-36a0ce55601a', 'bb919c62-86d8-4192-8046-a42f5c5b7496', 'fe3bb7d7-699a-4a95-b98e-2454c2532b7b'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:43:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-acaa0c42-97ac-44ee-86ef-d79f04f57275 tempest-ProjectMemberTests-1242181671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:43:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-acaa0c42-97ac-44ee-86ef-d79f04f57275 tempest-ProjectMemberTests-1242181671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:43:23 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-acaa0c42-97ac-44ee-86ef-d79f04f57275 tempest-ProjectMemberTests-1242181671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:43:23 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-acaa0c42-97ac-44ee-86ef-d79f04f57275 tempest-ProjectMemberTests-1242181671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:43:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-acaa0c42-97ac-44ee-86ef-d79f04f57275 tempest-ProjectMemberTests-1242181671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:43:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-acaa0c42-97ac-44ee-86ef-d79f04f57275 tempest-ProjectMemberTests-1242181671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:43:23 devstack sudo[106394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:43:23 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:43:23 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root
Jul 14 16:43:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-acaa0c42-97ac-44ee-86ef-d79f04f57275 tempest-ProjectMemberTests-1242181671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.270s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:43:23 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-acaa0c42-97ac-44ee-86ef-d79f04f57275 tempest-ProjectMemberTests-1242181671 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:43:23 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-acaa0c42-97ac-44ee-86ef-d79f04f57275 tempest-ProjectMemberTests-1242181671 None] Deleted volume successfully.
Jul 14 16:43:23 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-acaa0c42-97ac-44ee-86ef-d79f04f57275 tempest-ProjectMemberTests-1242181671 None] Lock "cinder-ca0303de-360b-459f-b178-3907439eef8d-delete_volume" released by "delete_volume" :: held 1.219s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:43:26 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e572717-17a0-45da-9626-c3a179a16c18 tempest-ProjectReaderTests-1064167523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:43:26 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8e572717-17a0-45da-9626-c3a179a16c18 tempest-ProjectReaderTests-1064167523 None] Flow 'volume_create_manager' (ed7df014-e4e5-4e58-9a4e-60b0fa84d070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:43:26 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8e572717-17a0-45da-9626-c3a179a16c18 tempest-ProjectReaderTests-1064167523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15173b08-269f-4cca-ab8d-84dd1a017196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:43:26 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8e572717-17a0-45da-9626-c3a179a16c18 tempest-ProjectReaderTests-1064167523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15173b08-269f-4cca-ab8d-84dd1a017196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:43:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1583010758',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bea30a0f-c766-4396-9247-42554c85607a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6eb19c1fcb14b72aef3805e4379f2e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:43:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:43:27Z,use_quota=True,user_id='8c8a7127783b449aa932afbf13fcf1d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:43:26 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8e572717-17a0-45da-9626-c3a179a16c18 tempest-ProjectReaderTests-1064167523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aeb2d0d7-a114-41be-8e71-d0d9c539f397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:43:26 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8e572717-17a0-45da-9626-c3a179a16c18 tempest-ProjectReaderTests-1064167523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aeb2d0d7-a114-41be-8e71-d0d9c539f397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:43:26 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8e572717-17a0-45da-9626-c3a179a16c18 tempest-ProjectReaderTests-1064167523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dd907a9-7d4c-4480-9304-03df8ea10575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:43:26 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8e572717-17a0-45da-9626-c3a179a16c18 tempest-ProjectReaderTests-1064167523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dd907a9-7d4c-4480-9304-03df8ea10575) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bea30a0f-c766-4396-9247-42554c85607a', 'volume_name': 'volume-bea30a0f-c766-4396-9247-42554c85607a', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:43:26 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8e572717-17a0-45da-9626-c3a179a16c18 tempest-ProjectReaderTests-1064167523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (902c79a0-ce1a-42d7-bb5f-825a54772a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:43:26 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8e572717-17a0-45da-9626-c3a179a16c18 tempest-ProjectReaderTests-1064167523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (902c79a0-ce1a-42d7-bb5f-825a54772a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:43:26 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8e572717-17a0-45da-9626-c3a179a16c18 tempest-ProjectReaderTests-1064167523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d2f239c-5e70-4e75-9454-a57d6ba7c30b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:43:26 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-8e572717-17a0-45da-9626-c3a179a16c18 tempest-ProjectReaderTests-1064167523 None] Volume bea30a0f-c766-4396-9247-42554c85607a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bea30a0f-c766-4396-9247-42554c85607a', 'volume_size': 1}
Jul 14 16:43:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-8e572717-17a0-45da-9626-c3a179a16c18 tempest-ProjectReaderTests-1064167523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:43:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-8e572717-17a0-45da-9626-c3a179a16c18 tempest-ProjectReaderTests-1064167523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:43:26 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-8e572717-17a0-45da-9626-c3a179a16c18 tempest-ProjectReaderTests-1064167523 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:43:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1583010758',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bea30a0f-c766-4396-9247-42554c85607a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6eb19c1fcb14b72aef3805e4379f2e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:43:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:43:27Z,use_quota=True,user_id='8c8a7127783b449aa932afbf13fcf1d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:43:26 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-8e572717-17a0-45da-9626-c3a179a16c18 tempest-ProjectReaderTests-1064167523 None] Creating volume bea30a0f-c766-4396-9247-42554c85607a {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:43:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-8e572717-17a0-45da-9626-c3a179a16c18 tempest-ProjectReaderTests-1064167523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:43:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-8e572717-17a0-45da-9626-c3a179a16c18 tempest-ProjectReaderTests-1064167523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:43:26 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-8e572717-17a0-45da-9626-c3a179a16c18 tempest-ProjectReaderTests-1064167523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:43:26 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-8e572717-17a0-45da-9626-c3a179a16c18 tempest-ProjectReaderTests-1064167523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:43:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-8e572717-17a0-45da-9626-c3a179a16c18 tempest-ProjectReaderTests-1064167523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:43:26 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-8e572717-17a0-45da-9626-c3a179a16c18 tempest-ProjectReaderTests-1064167523 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:43:26 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-8e572717-17a0-45da-9626-c3a179a16c18 tempest-ProjectReaderTests-1064167523 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:43:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-8e572717-17a0-45da-9626-c3a179a16c18 tempest-ProjectReaderTests-1064167523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-bea30a0f-c766-4396-9247-42554c85607a 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:43:27 devstack sudo[106397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-bea30a0f-c766-4396-9247-42554c85607a 1073741824
Jul 14 16:43:27 devstack sudo[106397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:43:27 devstack sudo[106397]: pam_unix(sudo:session): session closed for user root
Jul 14 16:43:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-8e572717-17a0-45da-9626-c3a179a16c18 tempest-ProjectReaderTests-1064167523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-bea30a0f-c766-4396-9247-42554c85607a 1073741824" returned: 0 in 0.426s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:43:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-8e572717-17a0-45da-9626-c3a179a16c18 tempest-ProjectReaderTests-1064167523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-bea30a0f-c766-4396-9247-42554c85607a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:43:27 devstack sudo[106402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-bea30a0f-c766-4396-9247-42554c85607a
Jul 14 16:43:27 devstack sudo[106402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:43:27 devstack sudo[106402]: pam_unix(sudo:session): session closed for user root
Jul 14 16:43:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-8e572717-17a0-45da-9626-c3a179a16c18 tempest-ProjectReaderTests-1064167523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-bea30a0f-c766-4396-9247-42554c85607a" returned: 0 in 0.259s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:43:27 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-8e572717-17a0-45da-9626-c3a179a16c18 tempest-ProjectReaderTests-1064167523 None] <== create_volume: return (725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:43:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-8e572717-17a0-45da-9626-c3a179a16c18 tempest-ProjectReaderTests-1064167523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:43:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8e572717-17a0-45da-9626-c3a179a16c18 tempest-ProjectReaderTests-1064167523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d2f239c-5e70-4e75-9454-a57d6ba7c30b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bea30a0f-c766-4396-9247-42554c85607a', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:43:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8e572717-17a0-45da-9626-c3a179a16c18 tempest-ProjectReaderTests-1064167523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fd75c5b-79c2-47ba-9bcf-7ccb88ba2dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:43:27 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-8e572717-17a0-45da-9626-c3a179a16c18 tempest-ProjectReaderTests-1064167523 None] Volume volume-bea30a0f-c766-4396-9247-42554c85607a (bea30a0f-c766-4396-9247-42554c85607a): created successfully
Jul 14 16:43:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8e572717-17a0-45da-9626-c3a179a16c18 tempest-ProjectReaderTests-1064167523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fd75c5b-79c2-47ba-9bcf-7ccb88ba2dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:43:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8e572717-17a0-45da-9626-c3a179a16c18 tempest-ProjectReaderTests-1064167523 None] Flow 'volume_create_manager' (ed7df014-e4e5-4e58-9a4e-60b0fa84d070) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:43:27 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-8e572717-17a0-45da-9626-c3a179a16c18 tempest-ProjectReaderTests-1064167523 None] Created volume successfully.
Jul 14 16:43:28 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-5581c099-d95b-4fe0-bee8-1e8aebb93b01 tempest-ProjectReaderTests-1064167523 None] Acquiring lock "cinder-bea30a0f-c766-4396-9247-42554c85607a-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:43:28 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-5581c099-d95b-4fe0-bee8-1e8aebb93b01 tempest-ProjectReaderTests-1064167523 None] Lock "cinder-bea30a0f-c766-4396-9247-42554c85607a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:43:28 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-5581c099-d95b-4fe0-bee8-1e8aebb93b01 tempest-ProjectReaderTests-1064167523 None] Acquiring lock "cinder-quobyte-bea30a0f-c766-4396-9247-42554c85607a" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:43:28 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-5581c099-d95b-4fe0-bee8-1e8aebb93b01 tempest-ProjectReaderTests-1064167523 None] Lock "cinder-quobyte-bea30a0f-c766-4396-9247-42554c85607a" acquired by "delete_volume" :: waited 0.019s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:43:28 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[be51bafe-96af-4e45-bca4-692b6b488b02]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:43:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5581c099-d95b-4fe0-bee8-1e8aebb93b01 tempest-ProjectReaderTests-1064167523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-bea30a0f-c766-4396-9247-42554c85607a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:43:28 devstack sudo[106405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-bea30a0f-c766-4396-9247-42554c85607a
Jul 14 16:43:28 devstack sudo[106405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:43:28 devstack sudo[106405]: pam_unix(sudo:session): session closed for user root
Jul 14 16:43:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5581c099-d95b-4fe0-bee8-1e8aebb93b01 tempest-ProjectReaderTests-1064167523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-bea30a0f-c766-4396-9247-42554c85607a" returned: 0 in 0.357s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:43:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5581c099-d95b-4fe0-bee8-1e8aebb93b01 tempest-ProjectReaderTests-1064167523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-bea30a0f-c766-4396-9247-42554c85607a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:43:28 devstack sudo[106410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-bea30a0f-c766-4396-9247-42554c85607a
Jul 14 16:43:28 devstack sudo[106410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:43:28 devstack sudo[106410]: pam_unix(sudo:session): session closed for user root
Jul 14 16:43:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5581c099-d95b-4fe0-bee8-1e8aebb93b01 tempest-ProjectReaderTests-1064167523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-bea30a0f-c766-4396-9247-42554c85607a" returned: 0 in 0.242s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:43:28 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-5581c099-d95b-4fe0-bee8-1e8aebb93b01 tempest-ProjectReaderTests-1064167523 None] Lock "cinder-quobyte-bea30a0f-c766-4396-9247-42554c85607a" released by "delete_volume" :: held 0.636s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:43:28 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-5581c099-d95b-4fe0-bee8-1e8aebb93b01 tempest-ProjectReaderTests-1064167523 None] Created reservations ['8385ea43-8859-4859-a18d-9ddb7f7ba0b3', '1c471758-7ec6-4bef-8be3-180607fa0386', '89f9c5a9-0eb8-4e75-9c4e-84d0f9dff218', '953959a3-8d1e-4cba-8c0b-eef2bc4e063f'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:43:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5581c099-d95b-4fe0-bee8-1e8aebb93b01 tempest-ProjectReaderTests-1064167523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:43:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5581c099-d95b-4fe0-bee8-1e8aebb93b01 tempest-ProjectReaderTests-1064167523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:43:28 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5581c099-d95b-4fe0-bee8-1e8aebb93b01 tempest-ProjectReaderTests-1064167523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:43:28 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5581c099-d95b-4fe0-bee8-1e8aebb93b01 tempest-ProjectReaderTests-1064167523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:43:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5581c099-d95b-4fe0-bee8-1e8aebb93b01 tempest-ProjectReaderTests-1064167523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:43:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5581c099-d95b-4fe0-bee8-1e8aebb93b01 tempest-ProjectReaderTests-1064167523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:43:28 devstack sudo[106413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:43:28 devstack sudo[106413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:43:29 devstack sudo[106413]: pam_unix(sudo:session): session closed for user root
Jul 14 16:43:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5581c099-d95b-4fe0-bee8-1e8aebb93b01 tempest-ProjectReaderTests-1064167523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.254s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:43:29 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-5581c099-d95b-4fe0-bee8-1e8aebb93b01 tempest-ProjectReaderTests-1064167523 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:43:29 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-5581c099-d95b-4fe0-bee8-1e8aebb93b01 tempest-ProjectReaderTests-1064167523 None] Deleted volume successfully.
Jul 14 16:43:29 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-5581c099-d95b-4fe0-bee8-1e8aebb93b01 tempest-ProjectReaderTests-1064167523 None] Lock "cinder-bea30a0f-c766-4396-9247-42554c85607a-delete_volume" released by "delete_volume" :: held 1.077s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:43:29 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef6c7a93-5b2b-4055-aa0b-3f1413b1efe4 tempest-ProjectReaderTests-1064167523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 14 16:43:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ef6c7a93-5b2b-4055-aa0b-3f1413b1efe4 tempest-ProjectReaderTests-1064167523 None] Flow 'volume_create_manager' (028abd82-76a7-4b4c-bb5d-a02797c05404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:43:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ef6c7a93-5b2b-4055-aa0b-3f1413b1efe4 tempest-ProjectReaderTests-1064167523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3f0441b-d899-47aa-b2d8-abad6b45db70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:43:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ef6c7a93-5b2b-4055-aa0b-3f1413b1efe4 tempest-ProjectReaderTests-1064167523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3f0441b-d899-47aa-b2d8-abad6b45db70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:43:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2067137603',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e88846f8-344d-4275-b5e3-a25b313638d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6eb19c1fcb14b72aef3805e4379f2e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:43:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:43:30Z,use_quota=True,user_id='8c8a7127783b449aa932afbf13fcf1d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:43:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ef6c7a93-5b2b-4055-aa0b-3f1413b1efe4 tempest-ProjectReaderTests-1064167523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (493a00e1-7f26-4dd6-8544-a06da923ff0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:43:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ef6c7a93-5b2b-4055-aa0b-3f1413b1efe4 tempest-ProjectReaderTests-1064167523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (493a00e1-7f26-4dd6-8544-a06da923ff0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:43:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ef6c7a93-5b2b-4055-aa0b-3f1413b1efe4 tempest-ProjectReaderTests-1064167523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7afe819-4582-4983-8458-0f28359d5577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:43:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ef6c7a93-5b2b-4055-aa0b-3f1413b1efe4 tempest-ProjectReaderTests-1064167523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7afe819-4582-4983-8458-0f28359d5577) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e88846f8-344d-4275-b5e3-a25b313638d4', 'volume_name': 'volume-e88846f8-344d-4275-b5e3-a25b313638d4', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:43:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ef6c7a93-5b2b-4055-aa0b-3f1413b1efe4 tempest-ProjectReaderTests-1064167523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50d933d6-52b0-42ad-aa71-b000e460aa8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:43:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ef6c7a93-5b2b-4055-aa0b-3f1413b1efe4 tempest-ProjectReaderTests-1064167523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50d933d6-52b0-42ad-aa71-b000e460aa8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:43:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ef6c7a93-5b2b-4055-aa0b-3f1413b1efe4 tempest-ProjectReaderTests-1064167523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f7f4261-6cca-4c4f-883d-f1c918f91f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:43:29 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-ef6c7a93-5b2b-4055-aa0b-3f1413b1efe4 tempest-ProjectReaderTests-1064167523 None] Volume e88846f8-344d-4275-b5e3-a25b313638d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e88846f8-344d-4275-b5e3-a25b313638d4', 'volume_size': 1}
Jul 14 16:43:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ef6c7a93-5b2b-4055-aa0b-3f1413b1efe4 tempest-ProjectReaderTests-1064167523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:43:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ef6c7a93-5b2b-4055-aa0b-3f1413b1efe4 tempest-ProjectReaderTests-1064167523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:43:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ef6c7a93-5b2b-4055-aa0b-3f1413b1efe4 tempest-ProjectReaderTests-1064167523 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x74f781ab0ef0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-14T14:43:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2067137603',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e88846f8-344d-4275-b5e3-a25b313638d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6eb19c1fcb14b72aef3805e4379f2e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-14T14:43:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-14T14:43:30Z,use_quota=True,user_id='8c8a7127783b449aa932afbf13fcf1d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295975a8-7473-4c67-ae77-00c5a99e1ba1),volume_type_id=295975a8-7473-4c67-ae77-00c5a99e1ba1)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 14 16:43:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-ef6c7a93-5b2b-4055-aa0b-3f1413b1efe4 tempest-ProjectReaderTests-1064167523 None] Creating volume e88846f8-344d-4275-b5e3-a25b313638d4 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 14 16:43:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ef6c7a93-5b2b-4055-aa0b-3f1413b1efe4 tempest-ProjectReaderTests-1064167523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:43:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ef6c7a93-5b2b-4055-aa0b-3f1413b1efe4 tempest-ProjectReaderTests-1064167523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:43:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ef6c7a93-5b2b-4055-aa0b-3f1413b1efe4 tempest-ProjectReaderTests-1064167523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:43:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ef6c7a93-5b2b-4055-aa0b-3f1413b1efe4 tempest-ProjectReaderTests-1064167523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:43:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ef6c7a93-5b2b-4055-aa0b-3f1413b1efe4 tempest-ProjectReaderTests-1064167523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:43:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ef6c7a93-5b2b-4055-aa0b-3f1413b1efe4 tempest-ProjectReaderTests-1064167523 None] Selected osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 14 16:43:29 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-ef6c7a93-5b2b-4055-aa0b-3f1413b1efe4 tempest-ProjectReaderTests-1064167523 None] casted to osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052
Jul 14 16:43:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ef6c7a93-5b2b-4055-aa0b-3f1413b1efe4 tempest-ProjectReaderTests-1064167523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e88846f8-344d-4275-b5e3-a25b313638d4 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:43:29 devstack sudo[106417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e88846f8-344d-4275-b5e3-a25b313638d4 1073741824
Jul 14 16:43:29 devstack sudo[106417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:43:30 devstack sudo[106417]: pam_unix(sudo:session): session closed for user root
Jul 14 16:43:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ef6c7a93-5b2b-4055-aa0b-3f1413b1efe4 tempest-ProjectReaderTests-1064167523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e88846f8-344d-4275-b5e3-a25b313638d4 1073741824" returned: 0 in 0.431s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:43:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ef6c7a93-5b2b-4055-aa0b-3f1413b1efe4 tempest-ProjectReaderTests-1064167523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e88846f8-344d-4275-b5e3-a25b313638d4 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:43:30 devstack sudo[106422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e88846f8-344d-4275-b5e3-a25b313638d4
Jul 14 16:43:30 devstack sudo[106422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:43:30 devstack sudo[106422]: pam_unix(sudo:session): session closed for user root
Jul 14 16:43:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ef6c7a93-5b2b-4055-aa0b-3f1413b1efe4 tempest-ProjectReaderTests-1064167523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e88846f8-344d-4275-b5e3-a25b313638d4" returned: 0 in 0.240s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:43:30 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ef6c7a93-5b2b-4055-aa0b-3f1413b1efe4 tempest-ProjectReaderTests-1064167523 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 14 16:43:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ef6c7a93-5b2b-4055-aa0b-3f1413b1efe4 tempest-ProjectReaderTests-1064167523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:43:30 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ef6c7a93-5b2b-4055-aa0b-3f1413b1efe4 tempest-ProjectReaderTests-1064167523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f7f4261-6cca-4c4f-883d-f1c918f91f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e88846f8-344d-4275-b5e3-a25b313638d4', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:43:30 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ef6c7a93-5b2b-4055-aa0b-3f1413b1efe4 tempest-ProjectReaderTests-1064167523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3fb665d-e97a-4b98-beb7-ee259fbf6b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 14 16:43:30 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-ef6c7a93-5b2b-4055-aa0b-3f1413b1efe4 tempest-ProjectReaderTests-1064167523 None] Volume volume-e88846f8-344d-4275-b5e3-a25b313638d4 (e88846f8-344d-4275-b5e3-a25b313638d4): created successfully
Jul 14 16:43:30 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ef6c7a93-5b2b-4055-aa0b-3f1413b1efe4 tempest-ProjectReaderTests-1064167523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3fb665d-e97a-4b98-beb7-ee259fbf6b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 14 16:43:30 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ef6c7a93-5b2b-4055-aa0b-3f1413b1efe4 tempest-ProjectReaderTests-1064167523 None] Flow 'volume_create_manager' (028abd82-76a7-4b4c-bb5d-a02797c05404) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 14 16:43:30 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-ef6c7a93-5b2b-4055-aa0b-3f1413b1efe4 tempest-ProjectReaderTests-1064167523 None] Created volume successfully.
Jul 14 16:43:30 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0ccb5b4f-73e3-4001-b4ef-420ee033aa6a tempest-ProjectReaderTests-1064167523 None] Acquiring lock "cinder-e88846f8-344d-4275-b5e3-a25b313638d4-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:43:30 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0ccb5b4f-73e3-4001-b4ef-420ee033aa6a tempest-ProjectReaderTests-1064167523 None] Lock "cinder-e88846f8-344d-4275-b5e3-a25b313638d4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:43:30 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0ccb5b4f-73e3-4001-b4ef-420ee033aa6a tempest-ProjectReaderTests-1064167523 None] Acquiring lock "cinder-quobyte-e88846f8-344d-4275-b5e3-a25b313638d4" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 14 16:43:30 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0ccb5b4f-73e3-4001-b4ef-420ee033aa6a tempest-ProjectReaderTests-1064167523 None] Lock "cinder-quobyte-e88846f8-344d-4275-b5e3-a25b313638d4" acquired by "delete_volume" :: waited 0.016s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 14 16:43:30 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c0e441-97b7-4ab8-a95b-8cf6818803f1]: (4, 'qcow2') {{(pid=87911) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 14 16:43:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0ccb5b4f-73e3-4001-b4ef-420ee033aa6a tempest-ProjectReaderTests-1064167523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e88846f8-344d-4275-b5e3-a25b313638d4 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:43:30 devstack sudo[106425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e88846f8-344d-4275-b5e3-a25b313638d4
Jul 14 16:43:30 devstack sudo[106425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:43:31 devstack sudo[106425]: pam_unix(sudo:session): session closed for user root
Jul 14 16:43:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0ccb5b4f-73e3-4001-b4ef-420ee033aa6a tempest-ProjectReaderTests-1064167523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e88846f8-344d-4275-b5e3-a25b313638d4" returned: 0 in 0.365s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:43:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0ccb5b4f-73e3-4001-b4ef-420ee033aa6a tempest-ProjectReaderTests-1064167523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e88846f8-344d-4275-b5e3-a25b313638d4 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:43:31 devstack sudo[106430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e88846f8-344d-4275-b5e3-a25b313638d4
Jul 14 16:43:31 devstack sudo[106430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:43:31 devstack sudo[106430]: pam_unix(sudo:session): session closed for user root
Jul 14 16:43:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0ccb5b4f-73e3-4001-b4ef-420ee033aa6a tempest-ProjectReaderTests-1064167523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c/volume-e88846f8-344d-4275-b5e3-a25b313638d4" returned: 0 in 0.255s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:43:31 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0ccb5b4f-73e3-4001-b4ef-420ee033aa6a tempest-ProjectReaderTests-1064167523 None] Lock "cinder-quobyte-e88846f8-344d-4275-b5e3-a25b313638d4" released by "delete_volume" :: held 0.658s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:43:31 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-0ccb5b4f-73e3-4001-b4ef-420ee033aa6a tempest-ProjectReaderTests-1064167523 None] Created reservations ['f32edfe3-7efb-4f2b-8d8f-ddbe0ff6c2f7', '8262c1bf-cce7-4547-9f7e-4b7f14e3c9cd', 'd96b8790-f081-4de5-a981-6101a8fb1eee', '48a24ae6-32c1-4519-acde-c14624c4993f'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 14 16:43:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0ccb5b4f-73e3-4001-b4ef-420ee033aa6a tempest-ProjectReaderTests-1064167523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:43:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0ccb5b4f-73e3-4001-b4ef-420ee033aa6a tempest-ProjectReaderTests-1064167523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:43:31 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0ccb5b4f-73e3-4001-b4ef-420ee033aa6a tempest-ProjectReaderTests-1064167523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:43:31 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0ccb5b4f-73e3-4001-b4ef-420ee033aa6a tempest-ProjectReaderTests-1064167523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:43:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0ccb5b4f-73e3-4001-b4ef-420ee033aa6a tempest-ProjectReaderTests-1064167523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:43:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0ccb5b4f-73e3-4001-b4ef-420ee033aa6a tempest-ProjectReaderTests-1064167523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:43:31 devstack sudo[106433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:43:31 devstack sudo[106433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:43:31 devstack sudo[106433]: pam_unix(sudo:session): session closed for user root
Jul 14 16:43:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0ccb5b4f-73e3-4001-b4ef-420ee033aa6a tempest-ProjectReaderTests-1064167523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.245s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:43:31 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-0ccb5b4f-73e3-4001-b4ef-420ee033aa6a tempest-ProjectReaderTests-1064167523 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:43:31 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-0ccb5b4f-73e3-4001-b4ef-420ee033aa6a tempest-ProjectReaderTests-1064167523 None] Deleted volume successfully.
Jul 14 16:43:31 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0ccb5b4f-73e3-4001-b4ef-420ee033aa6a tempest-ProjectReaderTests-1064167523 None] Lock "cinder-e88846f8-344d-4275-b5e3-a25b313638d4-delete_volume" released by "delete_volume" :: held 1.097s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 14 16:43:35 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 16:43:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 14 16:43:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 14 16:43:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 14 16:43:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-659a6477-ea7f-4604-8bc6-c6318e6af052'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 14 16:43:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 14 16:43:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 14 16:43:35 devstack sudo[106442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c
Jul 14 16:43:35 devstack sudo[106442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 14 16:43:35 devstack sudo[106442]: pam_unix(sudo:session): session closed for user root
Jul 14 16:43:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8c2fab1d64ee3983a76b2cb43191662c" returned: 0 in 0.250s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 14 16:43:35 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 14 16:43:35 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] Running periodic task VolumeManager._thread_info {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 14 16:43:35 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] thread count: 29 {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 14 16:43:35 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0dfeccbe-3744-4fcc-995e-8bec75204983 None None] thread info: [<_MainThread(MainThread, started 128606490927232)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128606415432960)>, <Thread(Thread-3 (stat_writer), started daemon 128606378859328)>, <Thread(Rabbit-heartbeat, started daemon 128606379646144)>, <Thread(Thread-5 (_runner), started daemon 128606377685824)>, <Thread(Thread-7 (_runner), started daemon 128606377701888)>, <Thread(fd_logger, started daemon 128606377091392)>, <Thread(privsep_reader, started daemon 128606375782080)>, <Thread(tpool_thread_0, started daemon 128606365607616)>, <Thread(tpool_thread_1, started daemon 128606357214912)>, <Thread(tpool_thread_2, started daemon 128606348822208)>, <Thread(tpool_thread_3, started daemon 128606340413120)>, <Thread(tpool_thread_4, started daemon 128606332004032)>, <Thread(tpool_thread_5, started daemon 128606323594944)>, <Thread(tpool_thread_6, started daemon 128606315185856)>, <Thread(tpool_thread_7, started daemon 128606306776768)>, <Thread(tpool_thread_8, started daemon 128606298367680)>, <Thread(tpool_thread_9, started daemon 128606289958592)>, <Thread(tpool_thread_10, started daemon 128606281549504)>, <Thread(tpool_thread_11, started daemon 128606273140416)>, <Thread(tpool_thread_12, started daemon 128606264731328)>, <Thread(tpool_thread_13, started daemon 128606256322240)>, <Thread(tpool_thread_14, started daemon 128606247913152)>, <Thread(tpool_thread_15, started daemon 128606239504064)>, <Thread(tpool_thread_16, started daemon 128606231094976)>, <Thread(tpool_thread_17, started daemon 128606222685888)>, <Thread(tpool_thread_18, started daemon 128606214276800)>, <Thread(tpool_thread_19, started daemon 128606205867712)>, <Thread(Rabbit-heartbeat, started daemon 128606368169344)>] {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 14 16:43:41 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:SELECT=82,cinder:INSERT=32,cinder:UPDATE=118,cinder:DELETE=11 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 14 16:43:41 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:UPDATE=95,cinder:DELETE=7,cinder:SELECT=78,cinder:INSERT=25 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}